Kia ora Annabel
I think the kayaking trip sounds like a lot of fun! There are some beaut bays run by DoC to stay at. Otherwise camping on the beach. I have only kayaked once, and didn't tip out either. It can get quite some chop on Queen Charlette though, and is really weather dependent. Perhaps except an extra day either side to be safe.