He knows that Charles won't hurt Warren, and even if Warren tried anything, Charles could stop him, so he figures that perhaps a little privacy for their conversation would be appreciated. He doesn't like everyone knowing his business, after all.

He will wait outside the door though, just in case.