web-cache-warmer is a script for warming website and FTP caches. It will download the URL(s) that you specify using the user agent string(s) that you specify. It can also recursively crawl sitemaps, and download the URLs contained within them.
Download