Apart from all the watch boutiques down Rhone Road and the PP Museum, there are also non-watch things.
The old (medieval) town up the hill and St Peter's Cathedral are fun to explore. When you get to the Place de la Madelaine, a roundabout surprise awaits. The Fountain Jet d'Eau on the lake is fun to stroll to and along the promenade. There is even a swimming pool built into the lake near the Jet so you can watch crazy people freeze outdoors in May