I've now tried installing the XAMPP package several times, using the installer and the zip file. The installer never reports any errors, and all the services are installed correctly and seem to run fine.
My problem is that I can't open the default start page. Not by trying http://localhost or by using http://127.0.0.1
I've disabled the firewall on my system so it shouldn't block any ports. I've even tried another Apache/MySQL/PHP installer called FOX something, but it didn'nt work either. Has anyone got any clue as to what could be stopping it from working?