I am not sure that is actually possible. The cost for Saints v Pompey was expensive. Here , you woukd gave an issue with 2 sets or supporters plus any protesters wanting to turn up. I think a ban is sensible. Villa supporters would have been unlikely to get to Israel....especially if they are Muslim.
And yet away fans aren't routinely banned from attending matches in this country even when there's a risk of violence, as it's the job of the police to protect them.
Maybe you shouldn't be allowed to visit Qatar anymore incase there are citizens there wanting to target British Citizens due to our actions in Iraq?
Israeli sides don't play European games in Israel currently btw.