I've pretty much figured out how to stay warm in the kayak even during these cold days. I typically start with a layer of UnderArmor (top and bottom) to wick away moisture, then a cotton t-shirt, then a thin layer of fleece (awesome stuff and totally essential) and then a windbreaker or rain top. I have a pair of neoprene kayak gloves purchased from LL Bean that are form fitting and keep my hands warm so long as I do not soak them. On my legs I will wear jeans or sweats (over the UnderArmor) and then a pair of booted chest waders. The only thing I haven't gotten right are the feet. I'm still looking for a really good pair of socks that I can wear with those waders.
Maybe try the battery operate in soles they sell at bass pro or the socks both are wireless with a remote they are right near the men's shoes far left of the store when you walk in
