I was there in 2002 (W 35-17). STARKville is very aptly named. There is nothing there but cow pastures, some small buildings, and athletic facilities. It was extremely windy and very cold.
We parked near the Hump, which reminded me of Western Kentucky's arena; and the baseball field, which was fairly nice. The football stadium looked like a Texas high school field and only ranks above Vandy among the SEC stadiums I've been to. I understand they have done some improvements since then...and they were sorely needed.
This was near the end of Sherrill's tenure, and the fans were extremely apathetic...barely any cowbell. The (at the time) new upper deck on the east side was almost completely empty, as was a large portion of the lower level. If I remember correctly, there weren't any seats set up in the endzones at that time.
I was in the official team travel party, and the host hotel didn't have enough rooms. So about 20 or so of us had to shift to another motel down the road that was -- by far -- the crummiest, creepiest place I have ever stayed. Most everyone slept in their clothes and used backpacks for pillows. The guy working the desk looked like the judge from Nothing But Trouble. There were stains on the walls and in the shower, lamps were broken (bulb sockets pulled out), wiring was hanging out of the outlets and switches, door wouldn't latch properly, windows were cracked, and the tv was partially melted....yes, melted. Fortunately, the team photographer was with us, took pics of everything, and all of those rooms were comped after sending copies of the pics and a letter to the corporate office.