Yeah, he presumably wanted to get Charles back into midfield and it would've happened sooner had Holgate not had an absolute Ali Dia up at Sunderland.
If you think logically about it, Martin maybe did a good job taking Holgate out of the team after the Sunderland horror show.