Because brushing makes your pool cloudy has led you to think brushing's a bad thing!

NOT SO! Any algae still alive is knocked loose by brushing and the dead algae is moved around so it is more easily filtered out. I don't know of ANY time when brushing is bad for your pool. Be sure to watch your filter pressure and backwash when it goes up.