Groups urge caution around sea swims