The Gilded Age's Ward McAllister's real life downfall after memoir disaster

The Gilded Age season 3, episode 7 saw Ward McAllister publish his memoir, Society as I Have Found It, which led to his downfall - but what happened to the real Ward McAllister.