I agree, but if you don't bring it in then defenders will just make themselves big and turn their backs and plead innocence when it hits their arm/hand and leave the ref with or without VAR to make a decision based on his/her view of the rules, so we will have decisions like this constantly.
Any change will be the same for both teams so the attacking team will gain an avantage but both teams can attack. The problem at the moment is some teams get decisions and some don't for the same incident, so simplifying it and getting the same correct decision consistantly is surely better than what we have now?