I understand your warning, but such thing was implemented in our application. For example, we have list of subscriptions with rating bar. And we have two adapters: Subscription Adapter and RateRecyclerAdapter. And we can remove rating by pressing “close icon” and we can remove subscriptions by pressing appropriate action in overflow menu. And all animations works great.

I think the reason, from the point of view of the RecyclerView, is that we have only one adapter. But we know that this adapter, for example, is a rating bar wrapper. So it just delegates responsibilities to wrapped adapter.