xen0n: (Default)
[personal profile] xen0n
Если уж он так факает мой сайт, пойду ка я на его фак.

Why is Googlebot downloading the same page on my site multiple times?

In general, Googlebot should only download one copy of each file from your site during a given crawl. Occasionally the crawler is stopped and restarted, and it may recrawl pages that it has recently retrieved. These recrawls should happen infrequently.

Получается, что нехило их там колбасит, что столько раз падает паучок.

October 2023

S M T W T F S
1234 567
891011121314
15161718192021
22232425262728
293031    

Most Popular Tags

Style Credit

Expand Cut Tags

No cut tags
Page generated Sep. 7th, 2025 07:17 pm
Powered by Dreamwidth Studios