The site crawl provides us a wealth of information, but to take this audit to the next amount, we must consult with the various search engines. However, serps don't love to present unrestricted use of their servers so we will just need to accept the subsequent best thing: webmaster https://www.youtube.com/watch?v=EVeTP0aV8gY