À propos Services
Produit
Crawl Analysis Bots IA Authenticité des bots Crawl like a bot Politique et couverture Setup et intégrations Tableau de bord exemple
Systèmes de Suivi
Googlebot AI Chatbot Bingbot Facebookbot Twitterbot Yahoo Slurp DuckDuckBot Baiduspider Yandexbot
Tarifs Contact
EN TR DE FR
Connexion S'inscrire

Annuaire des crawlers

Explorez les types de crawlers du catalogue NMOS.NET. Chaque type a sa page de suivi.

Commencer Gratuitement Ouvrir le guide d'installation

Bots IA

Famille: Allen Institute for AI

Ai2Bot-Dolma Caution AI2Bot Caution

Famille: Anthropic

Claude-SearchBot Safe anthropic-ai Caution Claude-User Safe Claude-Code Safe Claude-Web Safe ClaudeBot Caution

Famille: Big Sur AI

Big Sur AI Caution BigSurAI Caution

Famille: Cohere

Cohere-Training-Data-Crawler Caution cohere-ai Caution

DeepSeek

DeepSeekBot DeepSeek Danger

DigitalOcean

DigitalOceanGenAI-Crawler DigitalOcean Caution

DuckDuckGo

DuckAssistBot DuckDuckGo Safe

Famille: Mistral

MistralAI-User/1.0 Safe MistralAI-User Safe

Famille: OpenAI

ChatGPT-User/2.0 Safe ChatGPT Operator Safe OAI-SearchBot Safe ChatGPT-User Safe GPTBot Caution

Famille: Perplexity

Perplexity-User/1.0 Safe Perplexity-User Safe PerplexityBot Caution

QuillBot

QuillBot QuillBot Caution

Famille: xAI

GrokBot Caution Grok Caution

You.com

YouBot You.com Caution
MyCentralAIScraperBot Danger SBIntuitionsBot Caution img2dataset Danger Liner-Bot Caution PanguBot Caution AI Chatbot Caution

Services cloud

Alibaba

AliyunSecBot Alibaba Caution

Famille: Amazon

Amazonbot Caution amzn-user Caution

Bots Google

Famille: Google

Google-InspectionTool Safe Google-CloudVertexBot Caution Gemini-Deep-Research Caution Googlebot-Discovery Safe GoogleOther-Image Safe GoogleOther-Video Safe Googlebot-Image Safe Googlebot-Video Safe Storebot-Google Safe AdsBot-Google-Mobile Safe AdsBot-Google Safe Mediapartners-Google Safe Google-Extended Caution Googlebot-News Safe GoogleOther Safe Googlebot Safe

Autres agents

Famille: Internet Archive

ia_archiver-web.archive.org Safe archive.org_bot Safe ia_archiver Safe

Pingdom

Pingdom Pingdom Safe

UptimeRobot

UptimeRobot UptimeRobot Safe
ViennaTinyBot Caution

Outils SEO

Ahrefs

AhrefsBot Ahrefs Caution

Famille: Awario

AwarioSmartBot Caution AwarioRssBot Caution

Brandwatch

Brandwatch Brandwatch Caution

DataForSEO

DataForSeoBot DataForSEO Caution

Famille: Google

Google-PageSpeed-Insights Safe Chrome-Lighthouse Safe PageSpeed Safe

Majestic

MJ12bot Majestic Caution

MegaIndex

MegaIndex MegaIndex Caution

Meltwater

Meltwater Meltwater Caution

Moz

DotBot Moz Caution

Famille: Peer39

Peer39 Crawler/1.0 Caution Peer39 Crawler Caution

Famille: Screaming Frog

Screaming Frog SEO Spider Caution Screaming Frog Caution

Searchmetrics

SearchmetricsBot Searchmetrics Caution

Famille: Semrush

SemrushBot-OCOB Caution SemrushBot-SWA Caution SemrushBot Caution

TaranGroup

TaranGroup Intelligent Bot TaranGroup Caution
Sidetrade Indexer Bot Caution AudigentAdBot Caution SiteAuditBot Caution NeticlaBot Caution NeticleBot Caution Jetslide Caution Netvibes Caution

Scrapers

Amazon

Amazon Kendra Amazon Caution

ByteDance

Bytespider ByteDance Danger

Common Crawl

CCBot Common Crawl Caution

Diffbot

DiffBot Diffbot Caution

FactSet

Factset-SpyderBot FactSet Caution

Firecrawl

Firecrawl Firecrawl Danger

Famille: Turnitin

TurnitinBot Caution Turnitin Caution

Webmeup

BLEXBot Webmeup Caution
Poseidon Research Crawler Caution NetEstate Imprint Crawler Caution VelenPublicWebCrawler Danger Arquivo-web-crawler Caution ISSCyberRiskCrawler Caution iMediaEthics.org Caution FriendlyCrawler Caution Webzio-Extended Caution iAskSpider/2.0 Caution magpie-crawler Danger ImagesiftBot Caution Kangaroo Bot Caution QualifiedBot Caution EchoBot-Bot Caution ICC-Crawler Caution SeekportBot Caution news-please Caution Barkrowler Caution Crawlspace Danger EchoBoxBot Caution JenkersBot Danger LivelapBot Caution iAskSpider Caution MoodleBot Caution crawler4j Danger Hada News Caution omgilibot Caution Crawl4AI Danger Cotoyogi Caution SeekrBot Caution Timpibot Caution imgproxy Caution Bravest Danger MauiBot Danger NewsNow Caution NovaAct Caution yacybot Caution Scrapy Danger omgili Caution Seekr Caution Yacy Caution

Moteurs de recherche

Amazon

Amazon-SearchBot Amazon Safe

Famille: Apple

Applebot-Extended Caution Applebot Safe

Ask

Teoma Ask Safe

Baidu

Baiduspider Baidu Safe

Coc Coc

coccocbot-web Coc Coc Safe

Daum

Daumoa Daum Safe

DuckDuckGo

DuckDuckBot DuckDuckGo Safe

Famille: Huawei

AspiegelBot Safe PetalBot Caution

Famille: Microsoft

BingVideoPreview Safe MicrosoftPreview Safe BingPreview Safe adidxbot Safe Bingbot Safe MSNBot Safe

Famille: Mojeek

MojeekBot Safe Mojeek Safe

Famille: Naver

NaverBot Safe Yeti Safe

Famille: Seznam

SeznamHomepageCrawler Safe SeznamBot Safe

Sogou

Sogou Sogou Caution

Famille: Yahoo

Yahoo-FeedSeeker Safe Yahoo-MMCrawler Safe Yahoo! Slurp Safe Yahoo-Blogs Safe YahooSeeker Safe Slurp Safe Yahoo Safe

Famille: Yandex

YandexAdditionalBot Safe YandexAdditional Safe YandexBot Safe Yandex Safe

Bots sociaux

LinkedIn

LinkedInBot LinkedIn Safe

Famille: Meta

meta-externalfetcher Safe FacebookExternalHit Safe meta-externalagent Safe meta-externalads Safe FacebookCatalog Safe meta-webindexer Safe FacebookBot Safe WhatsApp Safe

Pinterest

PinterestBot Pinterest Safe

Quora

Quora-Bot Quora Caution

Slack

Slackbot Slack Safe

X

Twitterbot X Safe