In reply to keith-ratcliffe:
Nirvana - Love Buzz, originally by Shocking Blue, though Nirvana popularised it of course.
Foo Fighters' version of Baker Street is pretty good too.
The Band Played Waltzing Matilda as covered by The Pogues is better than their much simplified cover of Dirty Old Town, though less known.
Johnny Cash covering Nine Inch Nails' Hurt is also great, as is the rest of his covers album.