Forum Beograd Jagodina Ćuprija Paraćin

Razne zanimljive teme => Internet / Računari => Temu započeo: autentik 30-10-2023, 11:46:44

Naslov: Block arhcive.org Fix - 2024
Poruka od: autentik 30-10-2023, 11:46:44
in    robot.txt    put this

Kod: [Izaberi]
User-agent: ia_archiver
Disallow: /

User-agent: archive.org_bot
Disallow: /

User-agent: ia_archiver-web.archive.org
Disallow: /

in    .htaccess    put this

Kod: [Izaberi]
RewriteCond %{HTTP_USER_AGENT} (archive.org_bot) [NC]
RewriteCond %{HTTP_USER_AGENT} archive.org_bot [NC]
RewriteRule .* - [R=403,L]


SetEnvIfNoCase User-Agent "^ia_archiver" bad_bot
SetEnvIfNoCase User-Agent “^archive.org_bot” bad_bot
SetEnvIfNoCase User-Agent “^ia_archiver-web.archive.org” bad_bot
Order Allow,Deny
Allow from all
Deny from env=bad_bot
#You can send an email request for us to review to info@archive.org with the URL (web address) in the text of your message.

<Limit GET POST HEAD>
Order Allow,Deny
Allow from all
Deny from env=bad_bot
</Limit>