In reply to ianstevens:
If you are based in Queenstown take a harness. While there is bouldering at the Jardines, there is a lot more sport climbing around. It is fairly easy to find partners through the facebook page 'Queenstown climbing club' .
The better crags such as wye creek are approx 20 mins drive from Queenstown but the is also some crags within walking of the town itself.
You can hire guides which is good but expensive but would likely allow you to go on the bigger more adventurous missions such as chinamans bluff and the remarkables etc
Wanaka is nearby which also is mainly sport climbing. Payne's ford is a mission from queenstown but great, with hangdog being a climbing dedicated campsite.
Bouldering mecca is castle hill and you can hire mats in the nearby town of Springfield.
Enjoy!
the rest of NZ is limited to the options previously mentioned