Yes
You could get by without one but after 30 minutes or so in the water you will be chilled uncomfortably. Of course you could always get out for a bit, warm up, and then go back in. It also depends on how much body fat you have. Lots of fat will keep you warm. If you are skinny you will be cold.