В .htaccess добавляем:
# bots go hell!
<IfModule mod_rewrite.c>
RewriteEngine On
RewriteCond %{HTTP_USER_AGENT} (01h4x.com|360Spider|404checker|404enemy|80legs|Abonti|Aboundex|Aboundexbot|Acunetix|ADmantX|adscanner|AdsTxtCrawlerTP|AfD-Verbotsverfahren|AhrefsBot|AIBOT|AiHitBot|Aipbot|Alexibot|ALittle|Alligator|AllSubmitter|AlphaBot|Amazonbot|Anarchie|Anarchy|Anarchy99|Ankit|Anthill|anthropic-ai|Apexoo|archive.org_bot|arquivo-web-crawler|arquivo.pt|Aspiegel|ASPSeek|Asterias|Atomseobot|Attach|autoemailspider|awario.com|AwarioBot|AwarioRssBot|AwarioSmartBot|BackDoorBot|Backlink-Ceck|backlink-check|BacklinkCrawler|BackStreet|BackupLand|BackWeb|Badass|Bandit|Barkrowler|BatchFTP|Battleztar|Baiduspider|Bazinga|BBBike|BDCbot|BDFetch|BetaBot|Bigfoot|Bitacle|Biterika|Blackboard|BlackWidow|BLEXBot|Blow|BlowFish|Boardreader|Bolt|BotALot|Brandprotect|Brandwatch|Buck|Buddy|BuiltBotTough|BuiltWith|Bullseye|BunnySlippers|BuzzSumo|Bytespider|cah.io.community|Calculon|CATExplorador|CazoodleBot|CCBot|Cegbfeieh|CensysInspect|check1.exe|CheeseBot|CherryPicker|CheTeam|ChinaClaw|Chlooe|Citoid|Claritybot|clark-crawler|Cliqzbot|coccocbot|Cocolyzebot|CODE87|Cogentbot|cognitiveseo|cohere-ai|Collector|com.plumanalytics|Copier|CopyRightCheck|Copyscape|Cosmos|Craftbot|crawl.sogou.com|crawler.feedback|crawler4j|Crawling|CrazyWebCrawler|Crescent|CrunchBot|CSHttp|Curious|Custo|CyotekWebCopy|DatabaseDriverMysqli|DataCha0s|dataforseo.com|dataforseobot|DBLBot|demandbase-bot|Demon|Deusu|Devil|Digincore|DigitalPebble|DIIbot|Dirbuster|Disco|Discobot|Discoverybot|Dispatch|DittoSpyder|DnBCrawler-Analytics|DnyzBot|DomainAppender|DomainCrawler|DomainSigmaCrawler|domainsproject.org|DomainStatsBot|DomCopBot|Dotbot|Dragonfly|Drip|DSearch|EasyDL|Ebingbong|eCatch|ECCP/1.0|Ecxi|EirGrabber|Siphon|EroCrawler|evc-batch|Evil|Exabot|WebPictures|ExtLinksBot|Extractor|ExtractorPro|EyeNetIE|Ezooms|FacebookBot|facebookexternalhit|facebookscraper|FDM|FemtosearchBot|FHscan|fidget-spinner-bot|Fimap|FlashGet|Flunky|Foobot|Freeuploader|FrontPage|Fuzz|FyberSpider|Fyrebot|G-i-g-a-b-o-t|GalaxyBot|GeedoBot|GeedoProductSearch|GeedoShopProductFinder|Genieo|GermCrawler|Getintent|GetRight|GetWeb|Gigabot|Go-Ahead-Got-It|Go!Zilla|gopher|Gotit|GoZilla|Grabber|GrabNet|Grafula|GrapeFX|GrapeshotCrawler|GridBot|GT::WWW|Haansoft|HaosouSpider|Harvest|Havij|HEADMasterSEO|Heritrix|heritrix|Hloader|HMView|HonoluluBot|HTMLparser|HTTP::Lite|HTTrack|Humanlinks|HybridBot|Iblog|Id-search|IDBot|IDBTE4M|IlseBot|Sucker|imagesift.com|ImagesiftBot|IndeedBot|InfoNaviRobot|InfoTekies|InfraSec|instabid|Intelliseek|InterGET|InternetMeasurement|InternetSeer|internetVista|ips-agent|Iria|IRLbot|isitwp.com|Iskanie|IstellaBot|iubenda-radar|JamesBOT|Jbrofuzz|JennyBot|JetCar|Jetty|JikeSpider|Jooblebot|Joomla|Jorgee|JustView|Jyxobot|Kenjin|Translation-Search-Machine|keys-so-bot|Density|Kinza|Kozmosbot|Lanshanbot|Larbin|Leap|LeechFTP|LeechGet|LexiBot|Lftp|LibWeb|Libwhisker|LieBaoFast|Lightspeedsystems|Likse|Linkbot|linkdexbot|LinkextractorPro|linkfluence|LinkpadBot|LinkScan|LinksManager|LinkWalker|LinqiaMetadataDownloaderBot|LinqiaRSSBot|LinqiaScrapeBot|Lipperhey|Litemage_walker|Lmspider|LNSpiderguy|Ltx71|lwp-request|lwp-trivial|LWP::Simple|Mag-Net|Magnet|magpie-crawler|Majestic|Majestic12|MarkMonitor|MarkWatch|Masscan|MauiBot|Mb2345Browser|MeanPath|Meanpathbot|meanpathbot|Mediatoolkitbot|mediawords|MegaIndex.ru|Metauri|MFC_Tear_Sample|MicroMessenger|MIDown|MIIxpc|Minefield|MJ12bot|Mojeek|Mojolicious|MolokaiBot|Morfeus|Mozlila|Mr.4x3|MSFrontPage|MSIECrawler|Msrabot|MTRobot|muhstik-scan|Musobot|Nameprotect|Navroad|NearSite|Needle|Nessus|NetAnts|Netcraft|netEstate|NetLyzer|NetMechanic|NetSpider|Nettrack|Netvibes|NetZIP|NextGenSearchBot|Nibbler|NICErsPRO|Niki-bot|Nikto|NimbleCrawler|Nimbostratus|Ninja|Nmap|NPbot|Nuclei|Nutch|oBot|Octopus|omgili|OnCrawl|openai|openai.com|Openfind|OpenLinkProfiler|openstat.ru|OpenVAS|Openvas|OrangeBot|OrangeSpider|OutclicksBot|OutfoxBot|PageAnalyzer|PageGrabber|PageScorer|PageThing.com|Pandalytics|Panscient|Pavuk|pcBrowser|PECL::HTTP|PeoplePal|Petalbot|pfbaza|PHPCrawl|Pi-Monster|Picscout|Picsearch|PictureFinder|Piepmatz|Pimonster|Pixray|PleaseCrawl|plumanalytics|Pockey|POE-Component-Client-HTTP|probe-image-size|Probethenet|ProPowerBot|ProWebWalker|Proximic|Psbot|Pu_iN|Pump|PxBroker|PyCurl|QueryN|Quick-Crawler|Rainbot|RankActive|RankActiveLinkBot|RankFlex|RankingBot|RankingBot2|Rankivabot|RankurBot|Re-re|RealDownload|Reaper|RebelMouse|Recorder|RedesScrapy|ReGet|RepoMonkey|Ripper|ripz|RocketCrawler|Rogerbot|Roistat|RSSingBot|s1z.ru|SalesIntelligent|satoristudio.net|SBIder|scalaj-http|scan.lol|ScanAlert|Scanbot|ScoutJet|Scrapy|Screaming|ScreenerBot|ScrepyBot|Searchestate|SearchmetricsBot|Seekport|SeekportBot|SemanticJuice|Semrush|SemrushBot|SentiBot|SenutoBot|seobility|SeobilityBot|seocompany.store|SEOkicks|SEOkicks-Robot|SEOlyticsCrawler|Seomoz|SEOprofiler|seoscanners|SeoSiteCheckup|seostar|SEOstats|serpstatbot|sexsearcher|Shodan|Siphon|SISTRIX|Sitebeam|sitechecker.pro|SiteCheckerBotCrawler|SiteExplorer|Siteimprove|SiteLockSpider|siteripz|SiteSnagger|SiteSucker|Sitevigil|SlySearch|SmartDownload|SMTBot|Snake|Snapbot|Snoopy|SocialRankIOBot|Sociscraper|sogouspider|Sosospider|Sottopop|sp_auditbot|SpaceBison|Spammen|SpankBot|Spanner|Spbot|Spinn3r|SputnikBot|spyfu|Sqlmap|Sqlworm|Sqworm|statdom.ru|Steeler|Stripper|Sucker|Sucuri|SuperBot|SuperHTTP|Surfbot|SurveyBot|Suzuran|Swiftbot|sysscan|Szukacz|T0PHackTeam|T8Abot|tAkeOut|Teleport|TeleportPro|Telesoft|Telesphoreo|Telesphorep|TheNomad|thesis-research-bot|Thumbor|TightTwatBot|TikTokSpider|TinyTestBot|Titan|Toata|Toweyabot|Tracemyfile|Trendiction|trendiction.com|trendiction.de|Trendictionbot|True_Robot|Turingos|Turnitin|TurnitinBot|TwengaBot|Twice|Typhoeus|ubermetrics-technologies.com|UnisterBot|UptimeRobot|Upflow|URLy|V-BOT|Vacuum|Vagabondo|VCI|VelenPublicWebCrawler|VeriCiteCrawler|VidibleScraper|Virusdie|VoidEYE|Voil|Voltron|voyagerx.com|Wallpapers|Wallpapers/3.0|WallpapersHD|WASALive-Bot|WBSearchBot|Web-Crawler|Webalta|WebAuto|WebBandit|WebCollage|WebCopier|WEBDAV|WebDataStats|WebEnhancer|WebFetch|WebFuck|webgains-bot|WebGo|WebImageCollector|WebLeacher|WebmasterWorldForumBot|webmeup-crawler|WebPix|webpros.com|webprosbot|WebReaper|WebSauger|Webshag|WebsiteExtractor|WebsiteQuester|Webster|WebStripper|WebSucker|WebTrackrCrawler|WebWhacker|WebZIP|WeSEE|Whack|Whacker|Whatweb|Widow|WinHTTrack|WiseGuys|WISENutbot|Wonderbot|Woobot|Wotbox|Wprecon|WPScan|WWW-Collector-E|WWW-Mechanize|WWW::Mechanize|WWWOFFLE|Xaldon|Xenu|xpymep1.exe|YaK|YoudaoBot|Zade|Zauba|zauba.io|Zermelo|Zeus|zgrab|Zitebot|ZmEu|ZoomBot|ZoominfoBot|ZumBot|ZyBorg) [NC]
RewriteRule .* - [F,L]
</IfModule>
Комментарии ()