Friends with benefits dilema?

I started hanging out with this guy as friends then we started sleeping together. We have the agreement that it is just FWB and nothing more, but I am a girl(emotional) and I have already developed feelings for him. So when he tells me about a girl he likes, I get jealous. Should I tell him we need to stop having and just be friends or tell him that I have feelings for him?