Yeah, the refs do a difficult job, and the current legislation is simply not good enough for protecting their in game neutrality, nor ensuring their safety.
It's such an obvious thing it really is annoying that the FA are so slow on it.
1. The ref and helpers can only be spoken to by the captain, and only then without threatening language/behaviour. Once the ref decides the conversation has run it's course, a yellow must be produced for back-chat. A manager or non-captain player will be sent off for engaging in any conversation during the game about the ref's performance.
2. The ref must be given a platform to discuss decisions at the end of the game in a positive atmosphere, not one of blame or condemnation. It would help improve ref performance and fan-ref relations, in my opinion, for them to have such a public method of self-appraisal.
3. Stop the clock. Subjective tickity boo about injury time is a pain in the neck and one more rope around a ref's throat. When the ball goes dead past 90 mins, game over.
Yet to meet anyone who has ever disagreed with these principles!