Support > Security

GoogleBot crawl errors

(1/3) > >>

seadhna:
Hi there,
two Elxis sites are currently experiencing crawl errors - all Googlebots are banned in Defender. Is there any way to stop all Googlebots being banned like this?

seadhna:
I replaced an entire Defender_ban.php with a blank file last week, but already today, all Googlebots have been banned again, and receiving 403 Access Denied errors on all pages of the site.

xmanhattan:
Hello seadhna,

Are you using a robot.txt file in the root directory?

see attached.

datahell:
Defender will not ban them except there is a reason for that. Even google is used by hackers to scan sites for exploits. See Defender's security log to find out why it is blocking google robot.

michalis1984:
Maybe somewhere in your site there is a wronk link ... eg. by typo error at the plugin elxis link.. which drives to a page where is banned by defender. And so bots are banned by follow it. I experience this in the past.

Navigation

[0] Message Index

[#] Next page