How can I build up my boyfriend’s confidence in bed?

I’m in my mid-30s. I’ve met a new man who is fantastic — but for someone who is normally very confident, he’s surprisingly shy in bed.
When we have sex, it’s very unadventurous and with the lights off.