Technical SEO Question

[saul]

Anyone here know how to fix timed out pages found on ahrefs? I've been struggling for a bit on this particular problem and i haven't gotten a chance to get this fixed, Any help is highly appreciated!

 

[ElizabethRule]

I found this article and looks like it's an issue where the "URLs took too long to respond to Ahref's crawler's request." What does the ‘Timed out’ issue in Site Audit mean? | Help Center - Ahrefs

Could it be a general page speed issue? I ran a quick scan in Google PageSpeed insights and seems there are a few errors that may be interfering with Ahrefs crawlers.

I also checked the homepage with Ahref's SEO Toolbar extension and saw this status error, so I would take a look at your robot.txt files and see if there are any issues preventing the site from being crawled in there.

 

[saul]

I got this somewhat fixed, thank you! That gave me some direction as to why it was not showing up certain pages. I do however still have some 403 errors rather than your traditional 404's. Any insight on that would be great

 

[ElizabethRule]

403 errors indicates that the data is off limits to the client for some reason. The client doesn't have access rights to the content behind a 403. I would first figure out why the content is forbidden, maybe a user needs to enter a password to access the page. If that's the case you can just leave them as is. You can get Screaming Frog, Sitebulb or another crawling tool to crawl 403 pages if you configure it to use the password for those pages. This should eliminate 403 errors in your crawls.

• Crawling Password Protected Websites - Screaming Frog
• Authentication for crawling staging sites | Sitebulb

If its not a password situation, then you need to figure out the reason for the 403.