The oldest parts of Linköping Castle stems from the 1100s and the castle is the oldest secular building in Sweden. Large parts of Linkoping burned down in 1700, including the town hall.
http://visitlinkoping.se/index.php/en/castles-and-manors/link%C3%B6pings-slott