If the only problem is high CH, then there's no problem swimming. Is your chlorine level appropriate for your CYA level? (See the "best guess chart" link in my sig..)

Janet