I sat with my feet on an inch of ice/snow at the Cotton Bowl in 01-01-2001 with the temp holding steady at 32 all day long and watched UT get hammered by K-State. I'd rather the bowl games I attend be in the sun and in a warm climate, but unless it's in a dome, you have a good chance for crappy weather. It is winter after all.
I've been to a few Citrus/Cap One bowls and Outback bowls and it was pouring rain or rainy. UT-Ohio St in '96 (monsoon all game long), UT-Penn St in '94, UT-Penn St in '07.