In reply to LastBoyScout:
I don't see a problem with gluing the insole in place - apart maybe from if the shoes get wet through then you can't remove it, so will take a bit longer to dry the shoe completely.
Or, as suggested above, replace with a stiffer insole. Salomon running shoes used to be terrible for this, their Ortholite insoles moved, and when wet would scrunch up and it would become very uncomfortable, so had to be replaced with another insole from other running shoes.