The departure of one of the President’s few totally trusted aides adds to the sense that the sky is falling