You def. shouldn't let an "ass hat" get you feeling bad about yourself, you're done with high school (or at least the equivalent of it) and it's college time now (assuming that you go), so it's time to free yourself of excess baggage and let yourself have fun when you go. I was tied down for my whole freshman year with a girl that I didn't want to be with and it was the worst mistake I ever made because I lost the change to be in a relationship that I really wanted. Go have fun, enjoy yourself, and leave the rest of the crap behind!
After you talked to him he looked like you'd just mentally raped him. (he still deserved it) He knew you were out of his league so he put you down cause he figured you'd ralize it sooner or later.