Sure is. I do it all the time (:
It's a lot cooler than swimming during the day when it becomes so hot outside.
For me its depending on if there is light in the pool. It freaks me out not being able to see whats under the pool water. I'm okay as long as I can see the bottom. But thats just me ^.^