It will never be perfect, but there are things that can be done to improve it. You can't just throw up your arms and suggest it will never be perfect.
It is a big boy business now. You can hire full-time employees who get more training. You can do a better job of finding conflicts or biases. A football official who went to Hoover High School and whose family member works in the SEC office in Birmingham (and has a brother rooting on Alabama) should never do a Bama game. While he may not ever think he gives Bama a break, we all have implicit or unconscious biases. A basketball official who has a picture on his Facebook page of being an LSU fan should never do LSU games.
In basketball, the number of games done by officials has become a problem. I think it was last year, I saw an official (maybe Doug Shows) do a late East Coast game one night, and he was then on a call the next late afternoon in a city several hours away. This has gone unchecked.
Also, officials are hardly ever publicly held accountable. The players are required to walk off the NCAAT floor and sit in front of the media within 5 minutes of the game's end, and officials don't publicly answer to anyone. I am not even suggesting that they should, but maybe face one AP pool reporter for some questions? Double standard.
In many things in life, you try to keep improving and at least strive for excellence, and there is nothing being done (that I have seen) for this to be the case in college officiating...and it's been happening for years now.