In reply to Dave McKechnie:
Two ideas. First, Lake Annecy for the swimming, the scrambly little peaks around for the rest. Town of Annecy is attractive, almost seaside like on the lake. Lot further south, somewhere near the huge Serre Poncon lake (lots of water sports) such as Gap (near Ceuse) or Embrun.