In reply to flash13:
Kalymnos is so easy and so geared towards climbers that you don't really need to worry about any of those things!
You'll have trouble finding a bad crag, but you have to visit the grande grotte, I think it's a local bye-law or something, there are a couple of 7a/+ you'll be able to get on in the cave and plenty of easier stuff for your partner on panorama or afternoon, the two adjoining crags.
Also get to Secret Garden if you can, well worth the extra travel.
I've never found a bad restaurant yet, I agree that Aegean Tavern is top notch, I also liked Prego and Manifesto. If you have self catering facilities, all the local shops have a good range of fresh produce (including great bread) and groceries.
The only other thing I would say is to rent a scooter if you can, Panormos is a bit of a walk from any crag, scooters are dirt cheap and you can rent one on a standard driving licence, it massively increases the choice of crags. The roads are very quiet so even if you have never ridden a scooter, its not a stressful experience, make sure you wear at least a climbing helmet or the bike helmet supplied, ignore the hatless locals!