what is crawl budget and how do you optimize for it here we can see on google search console how often my website is crawled in the last few days i had about a thousand different crawl
requests from google in the last couple months i had about 17 000 crawl requests google assigns a specific amount of crawls it does based on how much your website produces content how often you share your content how often other sites link to your content how liked your content
is there’s a bunch of different reasons why google would crawl your website but you want a good crawl rate you don’t want to be wasting crawls on pages that aren’t important google will crawl a ton of junk on your website like 404s if you have a ton of 404s on your website like i do here it’s
better to either foretend these pages so they get permanently deleted and google doesn’t recrawl them and waste your crawl budget or redirect them to where they should go crawl optimizing
your crawl budget is probably one of the best things you can do for giant websites if you have a
website that’s getting a lot of traffic right now and you’re wondering why your pages aren’t
performing well a lot of the time it’s because you’re indexing junk that doesn’t need to be there and google isn’t able to really optimize its crawls for the pages that matter the most s what i would recommend is look at your crawls your crawl stats with this tool i’ll leave a link to and
look and see what pages you have that are either 4040 maybe there’s a 302 maybe there’s other 400 errors and get rid of the pages that aren’t supposed to really be there on your website
Leave a Reply