Campaigners opposed to a new bill to ban stag hunting say they believe up to four Fianna Fáil TDs could vote against the legislation.