It could be the ladder was were the algae started and is still clinging on for dear life. Maybe you could take it out and clean it real good. Leave it out until the pool clears. That way you're taking it away from the whole equation.

Also, search the forum about adding a small amount of DE to your sand filter to give it an extra cleaning boost.