I believe so. All a pressure gauge is doing is letting the water pressure push up against it and give you a read out.

Yes, turn everything off. Unscrew the old one. Take it to the store if you want to get one just like it.

Add teflon tape to prevent a water leak and screw the new one in, fire up the pump and your back in business.