The Obama administration has defended its decision to force out a black Agriculture Department employee over racially-tinged remarks at a banquet, despite evidence that they were misconstrued.