Sounds like pollen to me, but it wouldn't hurt to shock the pool just to make sure. Is it settling in the same places every time? I find that in my pool sometimes the pollen will congregate between the return flow and the ends of the pool, tending to deposit in the corners like that.
Other than these deposits, how does your water look?

Janet
'