Summers said in a statement that the decision to step down from the public is his way to "rebuild trust" with those closest with him.