Paoli station was... and still is, a one-story tan brick building that was constructed by the Pennsylvania Railroad in 1953 at a cost of $140,000. It replaced an earlier Victorian depot built in 1893.

In February of 2017, the first phase of a $48 million dollar project known as the Paoli Intermodal Transportation Center (ITC) Project commenced. The proposed project's goal was to expand and relocate the station to a new site near the existing facility. Fortunately, this did NOT happen and the station, though not all that impressive, was saved serving as an example of what the Pennsy (and SEPTA) "looked like" here during the last half of the 20th century. Ardmore has a similar, though not identical building, which will not survive the wrecking ball when it is replaced in 2021. Upgrades included replacing the two low-level side platforms with a high-level island platform, constructing a pedestrian overpass over the tracks, and adding elevators and ramps. A ribbon-cutting ceremony for the first phase of the project was held on September 23, 2019. Originally, the station had four tracks, however the center tracks were removed in 2017 in a seemingly shortsighted move to allow for the construction of a center high-level platform.