Yeah, but the slower officials could be stationed at each end, keeping them fresh and, hopefully, far less likely to be trying to make calls from bad angles because they're tired and thinking "SOMEthing must have happened -- better blow my whistle!"
The main goal is to never have a floor zone left unmonitored. Watch how often on fast breaks some officials are making judgements about whether a foul under the basket was an offensive foul or a defensive block from way out at the foul line or even further. Having someone permanently moored under each basket would ensure the many, many fast breaks some teams get each game are going to have a better chance of being fully seen by officials to be able to make the correct call instead of them not being in position to see it clearly.