A US judge has rejected a request to force YouTube to remove an anti-Muslim film trailer that has been blamed for causing deadly violence in the Middle East.