I did the morning trip and was very, very happy, especially after seeing the ocean in the afternoon. The wind got up quite a bit.
I'd recommend signing up for the morning. If the water looks really rough, ask if you can wait for the afternoon to see if it calms down.