Analog audio has never been the Raspberry Pi's strong point.If you have a digital AVR or other amplifier you can plug your headphones into, that should solve most of the problem.
So you mean plug the Pi into a amp then the headphones into the amp headphone port?