Is 56 degrees warm enough to swim in?

That is pretty cold. Not too cold to swim in, but you probably won't want to stay in long unless you are going to be swimming a workout (which will help warm you up). You can always wear wetsuits.