A number of rural Fine Gael TDs are reportedly reluctant to knock on doors canvassing for a Yes vote in the forthcoming marriage equality referendum.