In reply to ecrinscollective:
Never been to Kalymnos, however Siurana might fit the bill for you.
If you hire a car, you could climb in the day, it's busy over Easter, however because there are so many sectors, the days at the crag just don't really feel busy.
The climbing is a bit old school, bouldery and cruxy very often, however certainly an excellent range between 6a and 8a.
In the evening or rest days, you could drive down to the lake nearby and kayak or go for a dip, or go drive down to Tarragona and enjoy the beach there.
Other destinations in Spain might fit the bill (Costa Blanca maybe?) but I've never been to another one with a beach nearby.
Post edited at 09:39