PNG's look better, use transparency better but take more space.
Later versions of Internet Explorer have problems recognizing the PNG transparency but GIF transparency usually always shows, but its more pixelated.
Depends on the situation. PNG file sizes are pretty good in my opinion and have higher quality. View the link below for fixing the alpha issues with IE6. FF and Safari will display the alpha just fine.