There’s nothing wrong with trying to stay in a place where your yetzer hara doesn’t have a chance. You don’t have to give him a chance. There’s a reason Hashem wants people to learn Torah so badly. Barasi yetzer hara, barasi torah tavlin. It’s not a fantasy world, it’s a very real facet of the world and one that Hashem wants us to be a part of as much as possible. It’s definitely the real world. It may feel too good to be true but it’s real alright. (And if you’re worried that you’re not in the real world because you never feel the yetzer hara and then what’s the point, perhaps it’s the yetzer hara that’s trying to get you to second guess your learning now?? This is just food for thought and not ch”v an accusation)
The real question is, do you want to keep learning, but are worried that you will never grow up and be responsible that way, OR are you in some way afraid to commit your life to a reliant parnassah? Neither is wrong or right, but you have to decide where you’re coming from before you can come to a decision.
It’s hard to give personal advice because as ‘i can only try’ said, to learn or not to learn depends on each individual person. But I think that if you feel yourself able, you should try to stay for as long as you can and see where it takes you. Don’t ever be embarrassed of doing what’s good for your spiritual growth. It’s tough because no one likes to feel like they’re on the receiving end of things. But if you do enjoy being in yeshiva and you feel that it’s good for you – stay. It’s a hard thing to end up regretting.
Good luck whatever you end up doing.