There's a difference between the brand and the on-field performance of the program. Most Michigan fans think that their brand and the historical performance of the program is elite. Just the former is.
UGA does not belong in the list of schools you mentioned. It is a great but not elite brand, the last 2 years of performance notwithstanding. IMO the "elite" brands of CFB are Alabama, Notre Dame, Michigan, Ohio St, Oklahoma, Texas, and USC. UGA, Tennessee, UF, etc. are in a tier below that. Clemson is in a tier below that. Brands are not built in the last 5, or even 25, years of performance.