A trick I use with my pool is to rig the vacuum hose to one of the returns so it blows. In the PVC section of Home Depot you can adapt almost anything to anything. Then I go around the pool with the vacuum head, which is now blowing a jet of water, and stir up all the dust and any algae that's forming. This hits stuff that may not be easily reached by a brush too. Blow it into suspension. When I'm done that you can either do as Ted suggested or sometimes I just connect the vacuum up normally to the skimmer and leave the brush in the deep end making a temporary main drain. The stuff in suspension then gets sucked into the filter. WATCH THE PRESSURE though as sometimes with a lot of fine stuff the filter will plug easily.
Al