A government ministerial driver who served in his post for six years has failed in his claim that a government department breached workplace legislation concerning his role.