Esper called his brief tenure as leader of the Pentagon "the honor and privilege of a lifetime."