The quickest way of converting image formats is to use ImageMagick. There are binary releases for most operating systems, however in my case I'm using it on OS X. So to install using brew from a terminal use:
brew install imagemagick
Once that is installed then just move to the folder you are interested in and use the following:
mogrify -format png *.jpg
Once that is completed the folder of jpegs should now have some png friends to play with.