The [early] locomotives put forth so much smoke that the downwind side of the tracks was less desirable, and it generally was on the poor side of town, thus the phrase "the wrong side of the tracks".

From Nothing Like It In The World