In reply to JLS: Rule of law I think is probably the most important thing the state provides on a day to day basis. Defence is clearly important too but it might take a while to notice if the armed forced disappeared.
Most other things could be provided privately, if less efficiently.