I get talking to a couple of Liverpool fans who I know only relatively recently at my son's football and they always talk or ask about Spurs. And any time they praise us, almost like a knee jerk reaction, I put us down ("I'm used to disappointment", "this won't last", "typical Spurs" etc.). Both of them have commented on it by saying Spurs fans are generally quite pessimistic/miserable.
I have a season ticket in the East Upper, I go to 12-15 games a season and I'll join in with some of the singing albeit I'll never be accused of being an ultra. I'll never boo a player or the team but if I'm typical of a lot of Spurs fans (and not even the worst ones), we do seem to be an odd bunch.