You obviously don't know many Rugby Players.
The old adage that Rugby is a game for gentlemen to behave like hooligans MAY have been true once, but not in my lifetime.
However, rule changes and the professional game have meant that the gulf between top level, what you see on TV, and grass roots, what you might see at, say, Ashbrooke, is just as big as it is in football.
What we see on TV is often dull. Watching sixteen giants pushing against each other just isn't exciting.
But playing the game was, in my experience much more fun than football and that includes what you describe as the three pints in the Clubhouse.
To be honest any game where you don't understand the rules or the finer points of the technique is going to be boring.