We tried a solar powered birdbath once and it was a colossal failure up here in the frozen tundra! Unlike solar lights, it takes a lot of sun power to run a fountain or a bird bath during the day all day. Most of the time it never worked or only ran once in a while. Maybe it would work better in the south though, but a very overcast or rainy day might still be a challenge.
To run the pump in our small garden pond, we had to figure out how to get electricity outside and it wasn't too hard. You might start out with something like the K-Mart Red Fountain---it's under $50 and requires no set up. If you have electricity in our garage, you could run an extension cord from there.
It is a lot of work for us to establish and maintain our small garden pond each year (it has to be taken down in the fall and then everything is cleaned up and the small recirculating waterfall and mister/dripper device is set up again in the spring.) Despite the work of it, we've never regretted having a pond though---we sometimes see hummingbirds flying through the mist and leaf bathing.
Sometimes I think that Western hummingbirds are more inclined to use a water feature---maybe the heat is greater out there and this helps. It is so much fun to watch though.
Michael and Kathi Rock