Mirror or download a website with a tool much better than wget

If you want to mirror a website, the simplest tool I know if is wget. Once you have used wget, you know the troubles associated with it. You also get added couple of files as search html files, which are useless and wastage of bandwidth for you as well as the webserver.

lftp -e \”mirror -c\”  <URL>

This will mirror the website for you and will not leave with all those un-necessary files.