A man who lives next door to a cemetery says he fears finding hundreds of human remains in his front garden.