Close to the main train station of Orleans --'Gare d'Orleans'--- sits the beautiful church of Saint Paterne. There is a very nice view of it from the burger at the second floor of the station's mall.
If you want to get to Orleans by train, you have to know the city has two train stations. The first one is the 'Gare des Aubrais', which is quite far from the town center. Most of the trains stop at this station. From there you have to take one of the free trains that go to the train station in the town center: 'Gares d'Orleans'.