Will a sealed container of water hold chlorine forever?

I need a gallon of unchlorinaded water every month. My plan was to put tap water in a gallon container seal it, put it in a closet and use it in a month. When I opened the contained I smelled the chlorine and it tested at 1ppm.

If the top was not sealed would all of the chlorine leave the water?