Labour could be reduced to a rump of five seats after the next election, some TDs fear as the party continues to slump in the polls.