Mourinho said it right years ago when he said that a point away at the top teams is positive as long as you back it up with wins at home against those teams. The aim being getting as close to an average of 2 points per game against the big teams as you can. We aren't. Spurs, Liverpool and Chelsea at home would be the ones you'd consider 'big games' and we have 4 points from those three. Include our one away game against a 'big' team and that's 5 points from 4 games. Meh.
Or looking at it another way, bar the opening day loss, we have 4 points from 2 games at home against the big teams and we haven't lost away against any of the big teams.
Why are you discounting the first loss though? And the away stat... That's because we've only played one away game against a big team. And not won it.