For XAMPP for Windows Version 1.6.2
I downloaded the Icon Suite.
Here is what i did, i made a .jpg image with photoshop 32 by 32.
Then open up favicon.ico located in /htdocs directory with the program you downloaded (Icon Suite) and import image you made with photoshop or what ever program you my have, and save it. that about it.