English classes are not starting at fourth grade, but at first grade now.
I firmly believe that bilingualism is very important and is a strength in Quebec, and like you are saying, “the more languages we know, the better”.
The school language laws are not there to make it “difficult to raise a family” in Quebec, it is just important for children to understand both languages, especially the one of the majority around them. By doing so, they can increase their social circle and are able to speak/understand the people and culture around them, AND speak their parents first language.
Nobody would speak against Netherlands immigrant children learning Dutch AND English, why would it be different here?