Wget

Make a site mirror

Copy content of a remote site for offline viewing:

wget --mirror --no-parent --page-requisites --convert-links --adjust-extension \
  -U "Googlebot/2.1 (+http://www.google.com/bot.html)" \
  https://pi-tv.github.io \
  2>&1 | tee site-mirror.log

Check broken site links

wget --spider --recursive --no-directories --no-verbose --level=3 --wait=1 \
  https://pi-tv.github.io \
  2>&1 | tee site-check.log
  
grep -B1 'broken link!' site-check.log