One of the main reasons for a floor drain is to improve circulation in the lower depths. If you only have returns just below the surface and skimmers, then you generally don't get good water circulation in the deep end. You can try pointing returns downwards, but that's still not as effective as having a main drain in the floor.

Richard