A former court clerk fined for threatening to kill a man he thought was having an affair with his wife has lost an appeal against his conviction.