As I understand it, Crow believes he should work with the Phantom Thieves more sincerely. At least inform Ren of his situation so that he can be 'in' on the plan, whatever that entails, and they can deal with the rest later...

[Granted, Raven doesn't have the full scope of what's to come. All he knows is what could happen. His brow furrows in serious thought at that...]

I know that Shido's Palace is the tipping point. Sparrow's Shadow told me a fair bit.