Sure you can get a bachelors degree without being good in English. Have you been to China, Japan, Iran, Germany, etc. In all those countries, one doesn't have to know English to get bachelors. I am sure a lot of their graduates do know english but english is not a requirement.
I actually know students who are terrible in their english who will get their degree in US and at one of the top universities in the US too. The folks who do not communicate well in english....some of them are high earners because they are mostly in information analysis jobs, say like IT, etc. In other words, they have other attributes about them that make them successful economically. They are not generally in communication intensive jobs. In fact, Canada is saying its okay to be not so good in English if the applicant has other great attributes and these other attributes are demonstrated by having high points in other categories.
Canada is not differentiating the need for english ability based on the type of job (i.e. communication intensive vs not).
There are also lots of people who are bad in English who are not high earners in the US.
I agree the test is not easy to do great especially given the time limit.