Just a fact: yesterday I was able to speed up one TYPO3 web site 7x times. I did it by optimizing TypoScript and web server environment. I guess I could do more but my customer did not want to touch one area that could speed up the loading a little more.
I like doing this kind of performance work. It is always a challenge and I like challenging work!