Spencer Stewart Marsh built the Marsh House, now the Marsh-Warthen-Clements House, in 1836. When the Civil War came to northwest Georgia, he moved his family south to Cassville, Georgia, and Union troops occupied the house. The family returned to LaFayette after the war to find the furniture and household items missing and the downstairs floors stained with blood and marked with hoofprints. Many bullets were lodged in the outer walls, and bullet holes pierced the glass, remnants from the battle fought in downtown LaFayette on June 24, 1864.
Walker Counter purchased the house in 2003, and a restoration is underway.