The stone foundation is all that remains of the Kingston Depot, where during their pursuit of Andrews’ Raiders, Captain William A. Fuller, Jeff Cain, and Anthony Murphy exchanged the yard engine Yonah, which they borrowed from the Cooper’s Iron Works in Cartersville, for the locomotive William R. Smith. This engine, located a short distance north of town, took the pursuers close to Adairsville on this leg of the Great Locomotive Chase.

The Federals burned the Kingston business district and the depot upon departing the area on November 13, 1864. This wanton destruction was seen as a prelude to the total warfare methods Major General William T. Sherman inflicted on the civilian population on the March to the Sea.