Nigerian police clashed violently with members of an Islamic sect that allegedly practices wife-swapping, leaving five people dead and 20 men in custody, officials said tonight.