In reply to Chris the Tall:
> I gave up with the default app and use Downcast instead
Me too, but I use Overcast.
If you are in a car, Overcast works with Car Play to allow you to listen to podcasts without fiddling with the phone.
Another alternative is to set up an automatic play list so it will always play another podcast even if it has to switch to another program.