Mark Wahlberg found it difficult working alongside Martin Scorcese on The Departed as the pair were "constantly struggling" with one another.