Gunmen have stormed a luxury Libyan hotel popular with foreigners and have taken hostages after killing at least three guards, a security official has said.