High winds+ kayak/canoe= Disaster!
I can only imagine being in a yak is worse, but I know how you felt being in those high winds. I've had some horrible experiences being in a canoe at high winds.. The two worse times were the paddle flying out of the canoe and started blowing away with the water and i had literally less than 5 seconds to get otherwise i woulda been absolutely screwed! I was out on a pond bigger than 80 acres and in the middle of it
After that i ALWAYS keep the paddle IN the canoe!
Other experience was similar to yours. Was mild winds in the morning and kicked up so bad i almost never made it home. My canoe kept flipping around and was near impossible to keep straight let alone trying to get back to the launch. It was so stupid and dangerous for me to even stay out that day.