I don't believe that one facet discredits an entire story. There were aspects of Woodward and Bernstein's reporting on the Watergate break-in and cover up that were not accurate. That didn't mean that EVERYTHING else was false. "Anybody with any common sense" should be able to deduce by now that John Kelly has been at least one of the sources for these allegations. As a career military serviceman, Kelly is highly credible, and he was in a position to have heard what was said. Kelly is not a political hack. The average person would take the word of John Kelly in a minute over the word of Sarah Huckabee Sanders, Stephen Miller and Dan Bongino.
Jennifer Griffin referred to one of her sources as "umimpeachable". Who else could that include among former Trump Administration Officials, if not John Kelly? Look at Donald Trump's tweets over the weekend, he clearly believes that John Kelly is one of the sources for this story.
Having said that, Jeffrey Goldberg has promised that there would be more corroborating evidence brought forward in the coming days and weeks to confirm his reporting. If nothing surfaces, then he was just blowing smoke. We will just have to wait and see...