As an example why was he not on the floor in crunch time against the Knicks when Toronto had the lead. Instead Toronto played Calderon, DD, Barbosa and Kleiza - and undersized lineup and all below average defenders. Yes, he had five fouls, but with four or five minutes left he should have been on the floor.
I also believe he saw limited playing time in the 4th against the Lakers. Would you rather have DD or JJ guarding Kobe? Especially when JJ only had 3 personal fouls.