Charlton manager Alan Pardew believes even the likes of Aston Villa should not be "sitting too comfortably" in this season's Premiership relegation battle.