The Government has been accused of failing to take urgent action to tackle the issue of declining farm family incomes.