The proposed bathhouse would be built in a parking lot off Washington Boulevard and Atlantic Street, across from the South End fire station.