Load filters on demand.
I think that a large cost of these pages is loading the php. If I'm right this should result in a small speed up - especially for 'raw' pages.