Directory

Web Crawlers & Bots

30 bots that fetch OG images and link previews. How each one handles your Open Graph meta tags.

Why Different Platforms Show Different Previews

Each platform runs its own crawler. Facebook, LinkedIn, X, Slack, Discord, and WhatsApp do not share one Open Graph preview engine. They fetch your page with different user agents, cache for different lengths of time, and apply different image rules.

That is why one link can look right on LinkedIn, stale on Facebook, and blank in Slack. The HTML may be fine. The image may be fine. The crawler may be blocked by robots.txt, timing out on a slow image, using an old cache, or ignoring a tag another platform accepts.

I use this directory when a preview works in one place but not another. Start with the platform's bot page, then test the URL with the OG Preview tool.

Social Media

Facebook CrawlerMeta

Facebook's crawler that fetches link previews for shared URLs on Facebook, Messenger, and Instagram.

Twitter/X BotX Corp

X (formerly Twitter)'s crawler that generates Twitter Card previews for shared links.

LinkedIn BotLinkedIn

LinkedIn's crawler that generates article previews when links are shared in posts and messages.

TumblrAutomattic

Tumblr's crawler for generating link previews on Tumblr posts.

VK ShareVK

VK (VKontakte)'s crawler for link previews on Russia's largest social network.

Quora Link PreviewQuora

Quora's crawler for generating link previews in answers and posts.

Messaging

AI Crawler

SEO Tool

Other

Pocket ParserMozilla

Pocket's crawler that fetches article metadata for the read-later service.

W3C ValidatorW3C

The W3C's validation bot that checks HTML markup and standards compliance.

YandexMarketYandex

Yandex Market's crawler for product listing data on Russia's e-commerce platform.

SuperegobotSuperego

Superegobot crawler for web content analysis.

SynapseUnknown

A web crawler identified as Synapse in user-agent strings.

XbotUnknown

A web crawler identified as Xbot in user-agent strings.

Test Your OG Images

Check how your Open Graph images appear to bots and crawlers. Preview your link cards before sharing.

Already have an account?

18374d1699039c1c807cba98ffd77697864b95fb