Checked the pool this morning before the filter kicked on. The pool was still clean from the vacuuming which means the "stuff" only comes out when the filter first turn on. I held a skimmer sock in front of the return when it first kicked on, held it there for about 5 minutes nothing in the bag.

The fact that the debris only enters when the filter first turns on, does that rule out some things?