I think a lot of people are used to reading subs because of anime. I remember when I started watching anime I relied a lot on dubs and it took me a bit to adjust to watching subbed anime too. Now I have no issue with them and I'll watch sub over dub if I like the Japanese actors more. When you get used to reading the subs, it might get easier for you to start enjoying the content and voice acting more too (this was definitely the case for me looking back on my first subbed anime). It will take some time, but when you watch enough it will get easier as you adjust. I'd say that vtubers have given me more of an appreciation for Japanese than anime due to the more natural way they talk which has been cool.
It is worth noting that if vtubers just aren't your thing, that's completely ok too. If you are finding a particular vtubers' clips uninteresting, then they may not be your thing and that's also fine. Clips are taken from notable moments in a streamer's video, often comedic but not always, so watching these will be a good gage of who you like and want to see more of. There is a good variety of personalities and content among vtubers, so figuring that out is completely understandable.
If you aren't into gaming, which makes up many streams, there are other types of streams like karaoke, art, just chatting, English/Japanese learning, or ASMR. If you like a vtuber but aren't into one of those types, then it's also ok to just not watch that type. Overall, it's usually the vtubers themselves that's the main draw as opposed to the game they're playing or type of content (it can be a factor, but usually isn't the primary reason).
All of that said, it's also a good idea to keep an open mind, as your opinion may change, the translations may have errors, it will take time to adjust to subs (which is worth it imo), or you might just not gel with the clip you watched and there might be others of the vtuber you do like.
Another factor is the community too, which can be found on Youtube, Discord, Reddit and Twitter. Once you figure out who you like, it can add to the experience by participating in chats on live streams (English vtubers like Hololive EN, ID, and CN, and Independents are usually better for this than JP streamers in my experience, but it can still be fun even with the language barrier due to the previously mentioned point that the vtubers themselves are what make it fun to watch; I watched two Fubuki streams live and was surprised with how much I understood despite not knowing Japanese; also, there are translators in some chats for JP streamers for English viewers), talking with other people who enjoy the same vtubers, discussing streams, sharing fanart and memes, etc. Twitter is especially neat since you can directly tweet to and share your fanart with vtubers that they might share on stream. This also applies to Reddit and Discord to varying extents, depending on the vtuber and content.
It's also worth noting that Hololive EN are not the only vtubers who speak English. There are many independent English speaking vtubers on Twitch and Youtube, two of which are some of my absolute favorites (Haruka Karibu and Nyatasha Nyanners). The reason I enjoy Haruka is similar to many Hololive streamers, her streams have a comfy feeling that's nice to sit back to and watch, and Nyanners is really funny imo. Independents' communities tend to be smaller than Hololive, which can make them feel more connected at times. They're fun all the same though. Honestly them speaking English over Japanese doesn't mater to me. Each vtuber I like appeals to me for different reasons that make them unique and enjoyable, so the language doesn't really affect my enjoyment at all. So when you say that Hololive EN wasn't the same, personally I prefer that since I do like that each vtuber has their own unique identity and aren't just copying another person to be popular. In addition to independents, some of the Hololive girls do speak English fluently or semi-fluently, so English-only streams can be fun to watch. I can't speak for all of Hololive CN and ID, but I do know Moona and Artia speak English primarily in their streams.
With the variety of clips, content and personalities among vtubers, you have the ability to sit back and watch whatever person or content type you prefer, so I'd recommend just checking out different clips of vtubers to see what you like. In some cases, if you are in a particular mood, you might want to watch a stream, clip or vtuber that fits with that mood. For example, some vtubers have very energetic and comedic personalities while others are much more laid back and their streams have a more chill tone. Overall, I'd just say that you will adjust as you watch more subbed clips, and to keep an open mind while you discover who you like. Sorry for the essay, but I hope this helps, and that you have a lot of fun in the rabbit hole!
