There wasn't a "wrong side of the tracks" when growing up in the first house next to the Chicago and Northwestern Railroad in Sullivan, WI in the 1960s and 70s because the village was far too small to have such distinctions. :-)  I do remember one summer day walking through the tall grass of the right-of-way between the fire station and the lumber yard, and discovering the old concrete foundations of depot had been demolished and removed. I was as sad as can be, and it sparked my lifelong love of History. Since Sullivan was the halfway point of the mainline between Milwaukee and Madison, WI there, at one time, were two passengers and three freights a day through town. It was also, at that time, the main route taken by the Great Circus Train from Baraboo for the circus parade in Milwaukee.