If my memory serves me right, I think that even if both teams encroach the penalty area the penalty has to be retaken. If he misses, and only his own team mates encroach the the miss, is still a miss. If he misses, and only the opposing players encroach, it will be retaken.....because those players then have an unfair advantage to get to the loose ball.