It's you. I've been fishing around alligators all my life and one was never aggressive, the most they do is follow you around hoping to steal your fish, which can obviously be very disconcerting if you aren't used to it. If they do more than that and try to really invade your personal space it's because they've been fed by people and are looking for a handout. I did spook one on my kayak once and it inadvertently rocked me a little.
My Granny lived in LaBelle, Florida for a few years. It's a bit inland. But it rained, oh lawd, it rained. And there was an alligator walking up her street. They are scary looking critters.
I used to handle and feed the alligators at one of the zoos I worked at. They were pretty laid back. Actually very smart. All the wild ones I’ve interacted with were similar. The problem is when people feed them - they aren’t scared any longer. Which is what was most likely happening with the kayaker.