My therapist suggests that I (22F) should end things with my boyfriend (22M). Any advice?

I'm going to do my best to clarify my situation. I really need some advice. My boyfriend and I have been in a relationship for nearly three years, yet in that time, I have only met his friends once, aside from our mutual acquaintances. He seldom invites me to family gatherings, which is fine to some extent, but I can sense that his family often wonders about my absence. I don’t feel the need to be at every event, but it does feel a bit odd. I would think that if his family wants me there, he would too. He says he just doesn’t think to invite me. When he plays games with his friends during our sleepovers, he prefers that I don’t talk to them because he wants to keep my presence a secret. I’ve been questioning things lately since he mentioned moving in with those friends, which would mean I wouldn’t be welcome to stay over at his place, and he'd be spending more time at my house. He rarely visits me at my home, where I live with my parents, while he has his own place right now. It hurts that he doesn’t spend more time with me. For some context, he grew up in a very religious household—more strict than mine. His family is quite conservative, to the point I often feel like I have to be on my best behavior around them. After three years, I’ve just started feeling comfortable around them. They are lovely people; they’re never unkind, but my lifestyle is different from theirs. When we first started dating, his mother was particularly protective of his virginity. I find it peculiar for parents to guard their adult children's virginity, and it made him hesitant to share personal matters with them, which I understand. He tends to keep a lot to himself, not just about sex, and doesn’t discuss much with his family. They seem to like me; his mother even initiated plans for us to have brunch together regularly, which I take as a sign that she appreciates me. We've talked about these issues before, and there was a point where we almost broke up. We both love each other and want our relationship to work because he’s my best friend. He's conflicted about moving in with his friends, understanding it might impact our relationship. However, I honestly don’t think his friends would mind much—I don’t know them well, but they seem laid-back. I was recently invited to a virtual game night with them, which was enjoyable, and I felt like I could be myself. But afterward, my boyfriend distanced himself again, and now I'm feeling lost about what to do. I appreciate him trying to change by inviting me to socialize with his friends, but I’ve also discussed this with my therapist. She believes the issue lies with him and that I shouldn’t feel hidden in a relationship. I agree with her but can’t help but wonder if I am overreacting or misinterpreting things because she is so firm about me considering a breakup. Perhaps I’m just being stubborn because I love him and don’t want to end things. It’s hard to tell if there is a genuine issue here or if I’m creating problems in my mind. I’m open to any questions, as I’m sure I’ve left out important details. Thank you. **TL;DR:** I feel like my boyfriend is ashamed of me and hides me from his family and friends. What do you think? Is this a valid reason to break up?