I'm thinking there's something to it. Apparently at some point it was assumed that he was the heir apparent to the Late Show, and I read he's getting somewhere between $8-$10 million because he didn't get the spot. He also had already accepted a day time gig hosting a game show, and had been shopping 2-3 show ideas to cable channels (non-talk shows).
I figured once the news hit that CBS was "exploring options" for the Late Late Show, and that he wasn't getting The Late Show that his time was done. I was also surprised to read that his ratings took a hit when Seth Meyers took over Late Night. I take that to mean he did better up against Jimmy Fallon. I've watched a few of Meyers' show, and while I give him some slack because it's still new, I haven't been very impressed. His shows are usually kinda boring and his skits are usually really bad. His funniest segments are his interactions with Fred Armisen, who is by far the best part of the show and he's not even on it all the time.