Blog
AI visibility, in depth
Guides on measuring and improving how AI assistants and search engines present your brand, and on the API that collects the answers.
The articles fall into four groups. Fundamentals define the vocabulary of this market, GEO, AEO, citations, SERP features, for anyone who has just been handed the problem. Method pieces work through running a monitoring program: prompt-set design, cadence, sampling, volatility and what to put in a report. Tool and provider round-ups compare what is on the market, with every figure read from the vendor's own public pages and dated. Engineering pieces are for whoever builds the pipeline: idempotency, webhooks, batching, error handling and storage. Use the topics above to narrow the list.
All articles
AI answer screenshots: evidence of what an engine showed
How to keep a screenshot and an HTML copy of each AI answer, which engines return them, what they cost, and how to store them before they are deleted.
AI engine status monitoring: pause when an engine is down
Check AI engine status with GET /v1/engines, get engine.down and engine.up webhooks, read the status page, and pause and resume a monitoring pipeline.
Best Google News APIs compared on price and fields
Google News result APIs compared on which list they read, fields, targeting and price, next to Google News RSS and news index APIs.
How to see ChatGPT answers by US state
Run one prompt on ChatGPT from inside all 50 US states and DC in a single batch, then compare the brands, places and sources each state gets.
DataForSEO alternatives: 7 APIs for SERPs and AI answers
Seven DataForSEO alternatives compared on Google price per 1,000, live versus queued delivery, free tiers and AI assistant coverage, with who each fits.
DataForSEO vs SerpApi: price, engines, AI Overview and speed
DataForSEO and SerpApi side by side: pay as you go vs monthly plans, engines, AI Overview and AI Mode, queued vs synchronous delivery, and free tiers.
Mobile SERP tracking: desktop vs mobile Google results
How to track Google rankings on mobile and desktop with the device parameter, which engines accept it, and a Python example that compares both.
SerpApi alternatives: 7 SERP APIs compared on price
Seven SerpApi alternatives with verified prices per 1,000 Google searches, free tiers, AI Overview and AI assistant coverage, and who each one fits.
Best adverse media screening tools for 2027: data and prices
Adverse media screening tools compared for 2027 budgets: curated profiles vs live news, coverage, lists, API and published prices, checked 2026-10-26.
Best Google AI Mode scraper APIs for 2027: fields and prices
Google AI Mode scraper APIs compared for 2027 budgets: citations, shopping and local blocks, city targeting, follow-up turns and prices checked October 2026.
Best Microsoft Copilot scraper APIs for 2027: cited sources
Microsoft Copilot scraper APIs compared for 2027 budgets: prompts or shared chats, ordered sources, inline citations, geo, modes and October 2026 prices.
Best Grok scraper APIs for 2027: answers and X post sources
Grok scraper APIs compared for 2027 budgets: which still work, X post and web sources, the searches Grok ran, geo, and prices checked October 2026.
Best LLM scraper APIs for 2027: engines, fields, prices
Which scraper APIs collect ChatGPT, Gemini, Perplexity, Copilot, Grok, AI Mode and AI Overview answers, with one schema or many, webhooks, geo and cost.
Best local rank trackers for 2027: grids, map packs, AI
Local rank trackers compared for 2027 budgets: geo-grids, map pack and organic tracking, AI answers, APIs and entry prices, checked 2026-10-26.
Best news APIs for 2027: coverage, history, prices
News APIs compared on paid plans: NewsAPI.org, GNews, NewsData.io, Mediastack, NewsAPI.ai, Webz.io, Perigon and NewsCatcher on freshness, archive and price.
Best SEO APIs for 2027: SERP, keywords, backlinks, AI data
SEO APIs compared by data type: SERP, search volume, backlinks, site audit, rank tracking and AI visibility, with prices checked 2026-10-26.
Best MCP servers for web search in 2027
MCP servers for web search compared: Brave, Tavily, Exa, Perplexity, Firecrawl, Bright Data, SerpApi, Jina, Kagi and AnswerLine on tools, auth and price.
ChatGPT, Gemini and AI Mode name different leaders in half our tracked categories
We asked three AI engines 182 buyer-intent prompts across 10 software categories. In five categories the engines name a different leader; the October 2026 data.
AI answer tracking as an agency deliverable
How agencies turn "do we show up in ChatGPT?" into a recurring service: prompt sets, engines, cost budgets from real prices, and a monthly report.
AI answer volatility: how much answers change and how often to check
The same prompt can name you today and a competitor tomorrow. Measured run-to-run change on ChatGPT and AI Mode, how many runs a rate needs, and how to set a monitoring cadence and budget.
AI monitoring cost planning: estimate the bill up front
Size prompts, markets, engines, cadence and add-ons into a monthly dollar figure, with worked arithmetic before your first run.
An AI visibility report clients and executives will read
A monthly AI visibility report template: three metrics, what changed, an action list, and how to compute each number from stored API responses.
API errors and retries: a policy that never double-charges
Which errors to retry, which to fix, and which are final: 429s, 5xx, timeouts and batch item errors, with retry wrappers in Python and TypeScript.
Brand crisis monitoring: catch it in AI answers first
An early-warning setup for comms teams: watch Google News, ChatGPT and Gemini for new negative sources and changed verdicts about your brand.
Monitor what AI answers say about your competitors
Competitive intelligence from AI answers: which rivals get recommended, on which prompts and markets, whose pages feed it, and how to alert on changes.
MCP setup for Cursor and Claude Code: ask AI engines
Connect Cursor or Claude Code to the hosted MCP server so the editor can query ChatGPT, Gemini, Perplexity, Google and more as tools, with costs and key safety.
GEO metrics vs SEO metrics: what maps and what doesn't
Position, impressions and CTR don't survive inside AI answers. The metric translation, formulas for each GEO metric, and where each engine returns it.
Idempotency keys explained: safe retries for async tasks
How idempotencyKey prevents duplicate tasks and double charges: key design, 409 handling, crash-safe batch resubmission, and what keys do not dedupe.
Give a LangChain agent live AI answers as a tool
Turn ChatGPT, Gemini and Google News into LangChain tools so an agent checks live answers mid-reasoning. JavaScript and Python setup, plus guardrails.
Mentions vs citations: the two numbers in AI answers
Being named in an AI answer and being cited as its source are different events with different fixes. Definitions, per-engine fields, code and playbook.
Multilingual AI visibility: monitor answers by language
The same question in French, German or Japanese gets a different AI answer with different sources. How to monitor AI visibility per language and market.
Prompt set design: build a prompt set worth monitoring
How to source, cluster, phrase, size and version the prompts you track in AI answers, with code to mine candidates from Google's People Also Ask and related searches.
Reddit in AI citations: why threads get cited
Why Reddit threads show up as sources in AI answers, how to measure Reddit's citation share for your own prompts with the API, and how to respond.
Run your own AI citation study: a defensible methodology
Measure citation rates, trigger rates and source mixes in AI answers yourself: study design, sample sizes, intervals, code and a reporting checklist.
Sampling vs. census in AI-answer monitoring
How many runs per prompt are enough: intervals, sample sizes for detecting change, and when to collect everything instead of sampling AI answers.
Extending an SEO program to AI answers: the migration map
Keyword lists, rank tracking, competitor diffs and reporting all port to AI answer monitoring. What carries over, what changes shape, and what to drop.
Track SERP feature changes alongside rankings
AI Overviews, local packs, People Also Ask, ads and knowledge panels come and go per keyword. Snapshot and diff them to catch what rank tracking misses.
Does structured data help AI engines cite you?
What Google and OpenAI document about schema markup, crawlers and AI answers, and a controlled experiment to measure whether markup changes your citations.
Verify webhook signatures: HMAC-SHA256 in Python, Node, Go
Verify a webhook's HMAC-SHA256 signature on the raw body, check the timestamp, handle secret rotation. Tested code for Flask, FastAPI, Express and Go.
Webhook receiver design: retries, duplicates and ordering
Build a webhook receiver that loses nothing: verify, write to an inbox, ack fast, dedupe by task.id, handle retries and out-of-order results, reconcile.
AI-answer alerts without code: a Zapier setup
Post a Slack alert and log a sheet row when an AI answer stops (or starts) naming your brand or citing your domain, built in Zapier with no backend.
AI crawlers: GPTBot, PerplexityBot, ClaudeBot and more
Every major AI crawler's user agent and stated purpose from vendor docs, robots.txt recipes that separate search from training, and how to measure it.
AI grounding by engine: which index each assistant uses
What each AI engine documents about its search index and citations, what it doesn't, and a method to measure how its citations overlap with Google.
Best AI Overview tracking tools for 2027: SEO and GEO teams
Which tools report Google AI Overview and AI Mode visibility: platforms with dashboards, APIs that return the overview per request, and how to choose.
AI rank tracking: what rank means inside an AI answer
Six definitions of rank inside AI answers, how to aggregate when you are absent, and the statistics and sample sizes behind a trustworthy number.
AI search engines in 2026: the list and what each returns
Which AI search engines exist in 2026, from ChatGPT search to Google AI Mode and Claude, what each one shows a user, and which crawler governs eligibility.
Best AEO tools for 2027, organized by the job you need done
AEO tools grouped by job: tracking answers, deciding what to change, AI crawler access and first-party data, with verified prices and selection criteria.
Best AI visibility tools for 2027: GEO platforms compared
AI visibility tools compared plan by plan: Profound, Peec AI, Otterly.ai, Scrunch, AthenaHQ, Semrush and Ahrefs on engines, prompt limits and entry price.
Best ChatGPT scraper APIs for 2027: answers and citations
Compare ChatGPT scraper APIs, OpenAI's web search tool and building your own: engines, parsed fields, fan-out, shopping cards, geo and entry prices.
Best competitive intelligence tools for 2027, by the job
Crayon, Klue, Kompyte, Owler, Similarweb, Semrush, Ahrefs and SpyFu by job, with prices checked on vendor pages, and when to build on raw SERP and AI data.
Best Gemini scraper APIs for 2027: app answers vs the API
How to collect Gemini app answers with sources as JSON: scraper APIs compared with Gemini API grounding and DIY, with verified prices and a cost example.
Best Google scraper for 2027: DIY, scraper APIs, SERP APIs
Three ways to get Google results as data: build a scraper, rent a scraper API, or call a SERP API. Where each breaks, verified prices and how to choose.
Best Perplexity scraper APIs for 2027: answers and sources
Perplexity scraper APIs compared with the Sonar API and a DIY build: parsed sources, related queries, shopping blocks, geo, and verified entry prices.
Best search APIs for AI agents and RAG in 2027
Tavily, Exa, Brave, Perplexity, Serper, SerpApi and AnswerLine compared for LLM agents: what each returns, verified prices, MCP support and when to pick which.
Best SERP APIs for 2027: SEO platforms and data teams
Ten SERP APIs compared on surfaces, verified per-1,000 prices, free tiers, AI Overview support, geo targeting and async delivery.
Bing rank tracking and Copilot visibility: what to use
Track Bing web rankings with Webmaster Tools data or a Bing-capable tracker, and Copilot visibility with an answer API. What this API covers and doesn't.
Bing Search API alternatives after its 2025 retirement
Microsoft retired the Bing Search APIs on August 11, 2025. What it recommends instead, verified alternatives and prices, and a parameter migration map.
Best brand monitoring tools for 2027: prices, coverage, gaps
Brand24, Awario, Mention, Talkwalker, Brandwatch, Meltwater and Google Alerts compared on prices and sources, plus search results and AI answers.
Brave Search API vs a Google SERP API: index, terms and cost
Brave's independent index vs Google SERP data: what each returns, verified plans and rate limits, storage and AI-use terms, and parameters side by side.
ChatGPT ads: how they work and how to track them
A dated timeline of ads in ChatGPT from OpenAI's announcements: who sees them, where they appear, how they are chosen and bought, and how to track advertisers on your prompts.
ChatGPT visibility tracker: platforms, costs and a pipeline you can run
Choosing a ChatGPT visibility tracker: what the platforms report and cost, what to ask them, and a Python pipeline you can run instead.
Cheapest SERP API per 1,000 Google searches (2027)
Verified list prices for 12 SERP and scraper APIs, normalized to monthly cost at 10k, 100k and 1M Google searches, plus the fees that cheap prices hide.
Competitive analysis template with a source for every row
A competitive analysis template covering positioning, pricing, search, AI answers, news and ads, with a source per row, scoring and refresh cadence.
18 competitive intelligence examples from public data
Concrete competitor questions, each with the endpoint, an example query or prompt, the exact response field to read, and what the data cannot tell you.
Competitor SEO tracking: positions, ads and AI citations
Track competitors on a keyword set: data model, share of SERP across organic, ads and AI Overview citations, async batches, change detection and cost.
Content theft detection with exact-match search queries
Find sites that copied your articles: pick fingerprint sentences, run quoted Google queries that exclude your domain, score candidates, and file removals.
Enterprise rank tracking: millions of keywords, reliably
Rank tracking at millions of keywords: tiered schedules, shared collection, batching, throughput math, queue feeding, storage and data quality checks.
Exa vs Google search results: discovery or ranking truth
Exa's own index and neural search next to Google SERP data: what each returns, verified prices and rate limits, freshness controls, and a hybrid pattern.
Featured snippets and AI Overviews: how they relate
What Google documents about featured snippets and AI Overviews, the controls they share, and how to measure AI Overview citations with a SERP API.
Free news APIs in 2026: free tiers, limits and trade-offs
Free tiers of NewsAPI.org, GNews, NewsData.io, Mediastack, the Guardian, NYT and more, checked on vendor pages, and when a Google News API fits.
GEO checklist: 24 items, each with a check you can run
A generative engine optimization checklist where every item has a pass/fail test: crawler access, snippets, content, off-site presence and measurement.
How to get Google AI Mode answers as JSON
Send one prompt to Google's conversational answer surface and store what comes back: answer text, sources, citation pills, products, places and videos.
Google AI Overview API: get AI Overviews as JSON in 2026
Which APIs return Google AI Overview content, how each is requested, the JSON fields and what it costs, with verified vendor prices and working requests.
Google Alerts API: there isn't one. What to build instead
Google offers no Google Alerts API. The options for programmatic alerts, and a pipeline built on scheduled news and search tasks with signed webhooks.
Google Custom Search JSON API alternatives and migration
The Custom Search JSON API is closed to new customers and existing ones must move by January 1, 2027. Options, verified prices and parameter mapping code.
Google dorking for defenders: find what your site exposes
Defensive search operator queries to find exposed files, staging hosts and error pages on domains you own, run them on a schedule and remove what leaks.
Google News RSS feeds: what they give and where they stop
Google News RSS URL formats, what each item contains, the when: operator, the personal-use restriction, and when structured news results via API fit.
Build a Google rank tracker: positions, depth, storage
Decide which position you track, how deep to fetch, which market to target, store a daily series, and match URLs without false misses.
Is there a Google Search API? What exists in 2026
Google has no open API for its web results in 2026. What Google does offer, how SERP APIs and in-house scrapers compare, and which to pick for your use.
Google search operators that still work in 2026
Which Google search operators Google documents, which are undocumented, and how to run site:, quotes, filetype: and before:/after: queries at scale.
Google search parameters: gl, hl, uule, num and more
What each Google search URL parameter does, how it maps to this API's request fields, which combinations return 400, and what each request costs.
International keyword research: markets and languages
Keyword research across countries and languages: market matrices, native seeds, SERP overlap, hreflang checks, city-level checks and costs.
SERP keyword data vs search volume data
What a results page tells you about a keyword: People Also Ask, related searches, AI Overview, features and intent. Plus where volume data comes from.
llms.txt: what it is, who uses it, and whether it matters
The llms.txt proposal and format, what vendors have said about it as of September 2026, and a controlled experiment to measure its effect on AI citations.
Local rank tracking by city: grids, locations and costs
Track Google rankings per city, ZIP or neighborhood: build a grid from Google's geo targets, send location strings, read the local pack, size the cost.
Best media monitoring tools for PR teams in 2027
Meltwater, Cision, Muck Rack, Talkwalker and Google Alerts compared on earned media coverage, and when a news API is the better base for your own tool.
Microsoft Copilot API options
Microsoft Copilot API options compared: the Microsoft 365 Copilot APIs, Copilot Studio, Foundry web grounding and the retired Bing Search APIs, and what each one returns.
Track brand mentions in Copilot answers
Track how often Microsoft Copilot names and cites your brand: mention rate, citation rate and position from its answers as JSON, per country, sync or in async batches.
Track brand mentions in Gemini answers
Track how often Google Gemini names and cites your brand: mention rate, citation rate and chip rate from its answers as JSON, with curl, Python and TypeScript examples and costs.
Track brand mentions in Grok answers
Track how often Grok names and cites your brand, and which X posts and web pages it leans on: mention rate, citations, search queries and model, per country.
Online reputation monitoring for search, news and AI
Monitor what Google, its AI Overview, news and AI assistants show about your brand: query set, schedule, snapshot diffs, alert rules and human review.
OSINT tools for defenders: map your own attack surface
theHarvester, SpiderFoot, Maltego, Shodan, crt.sh, urlscan.io, HIBP and dnstwist for defenders, search results as a source, and the ethical limits.
People also search for: expand keywords and map entities
Related searches and the knowledge panel's People also search for list, how they differ from Google's back-click box, and how to expand keywords with them.
Perpetual KYC and adverse media: event-driven screening
How perpetual KYC uses adverse media as a trigger: what public guidance says, delta screening, risk-tier cadence, re-scoring rules and an audit trail.
Perplexity API vs Google Search data: which one to use
Perplexity's Agent, Sonar and Search APIs vs Google results APIs: what each returns, verified prices and limits, and why none is the perplexity.ai answer.
Programmatic AI visibility tracking: system design
System design for AI visibility tracking at thousands of prompts: prompt catalog, planner, run accounting, raw storage, observation tables and metrics.
Rank tracking software prices for 2027 vs building on an API
Entry plans of AccuRanker, SE Ranking, Semrush, Ahrefs, Nightwatch, Wincher and more, checked 2026-10-26, and when to build on an API instead.
Find your competitors' keywords from live SERP data
Expand seeds with related searches and People Also Ask, match organic domains to find rival keywords, read ads for paid terms, and build a gap matrix.
SERP API reliability: retries and idempotency
Engineer SERP collection that finishes: a completeness ledger, retry budgets, idempotent submission, billing on failure, data-quality checks and alerts.
SERP and AI answer data in BigQuery: schema and queries
Load SERP and AI answer results into BigQuery: a partitioned schema with nested results and JSON, free batch loads, streaming costs and example SQL.
Turn Google results into typed data, not HTML scraping
One Google Search call returns organic results, ads, People Also Ask, local pack, knowledge panel and AI Overview as typed JSON, targeted by country per request.
Tavily vs Google search results: when each one fits
Tavily's agent search next to Google SERP data: what each returns, verified credit costs and rate limits, prompt-ready output, and a decision table.
Third-party risk monitoring with news and search data
Build continuous vendor monitoring from Google News and search results: signal taxonomy, query templates, tiered cadence, triage rules and cost per vendor.
Typosquatting detection: find lookalike domains
Detect lookalike domains impersonating your brand in Google results and ads, generate permutation candidates, check certificate logs, triage and report.
Web scraping vs API: when to build and when to buy
A decision framework for scraping versus buying an API: total cost, maintenance, data shape, scale, and the terms-of-service and legal questions to raise.
What is a SERP? Anatomy of a Google results page in 2026
Every block on a Google results page, from AI Overview and ads to People Also Ask and the knowledge panel, and which ones a SERP API returns as fields.
What is answer engine optimization (AEO)? A definition
AEO is the work of making your content the answer an engine gives. How it relates to SEO and GEO, what it covers, and how to measure it per engine.
What is AI SEO? The two meanings, and what each requires
AI SEO means optimizing for AI search, or doing SEO with AI tools. What search engines say about each, the first-party data available, and how to measure.
Local AI answers: measure them by country, state and city
Which geo parameters each engine accepts, what ChatGPT answered for one prompt in six US markets, how a state sweep runs, what it costs, and how to tell geography from noise.
People Also Ask for keyword research and SEO
Extract Google's People Also Ask questions as typed data, expand and cluster them, then turn the clusters into pages: intent, answer owners, the AI Overview share and refresh cadence.
What is generative engine optimization (GEO)?
GEO is the practice of getting your brand named and cited inside AI-generated answers. Definition, origin, how it differs from SEO, and how to measure it.
White-label AI visibility: client-facing answer tracking
How agencies and SEO platforms ship AI visibility dashboards, reports and audits under their own brand, with multi-tenant design, code and cost math.
How to measure the traffic AI engines send you
AI referral traffic is partial and noisy. How to identify it in analytics, join landing pages to cited URLs, and test what it can't show.
AI share of voice: a measurement framework
Mention rate, citation share, recommendation share, answer rank and fan-out coverage, defined with formulas, per-engine fields and a Python pipeline.
Build vs buy for AI visibility tracking: what in-house collection costs
Build or buy the collection layer for AI visibility tracking: engineer time per engine, maintenance, infrastructure, bad-data cost, and the per-request math to compare it against.
Query fan-out: the searches ChatGPT runs before it answers
Query fan-out is the set of searches ChatGPT runs before it answers. How to reason about them when they are not returned, and what to measure instead.
ChatGPT shopping cards: track the products it recommends
Read ChatGPT's product cards as JSON: titles, prices, merchants, offers and ratings, and monitor them over time.
How to get Google News results as structured JSON
Request news results per country and language, read every field on an article record, and build brand alerts and coverage reports on top of them.
How AI engines choose which sources to cite
What engines document about search-grounded answers, a two-stage working model of citation, and how to measure each engine's citation behavior with an API.
Giving an AI agent live answer data with the MCP server
MCP server tutorial: connect an AI agent, call ChatGPT, Gemini, Perplexity and Google as tools, and cap its spend with budget guards.
How to measure brand mentions in ChatGPT answers
The measurement method for ChatGPT brand mentions: what each rate counts, how to compute it from the answer fields, and how many prompts it takes.
How to track Google AI Overviews for your keywords
Track AI Overviews for a keyword list, per market: request the overview with the Google results, submit batches, receive signed webhooks, and trend presence, citations and rank gaps.
Track brand mentions in Perplexity answers
Track how often Perplexity names and cites your brand: mention rate, citation position and citation groups from its answers as JSON, with Python, TypeScript and costs.
Scheduled AI-answer monitoring in n8n: a complete workflow
Build a daily AI-visibility check in n8n: schedule prompts, queue async tasks, receive results by webhook and write mention and citation rows to a table.
Rank-tracking pipeline for AI answers with async batches
Build a citation rank tracker in Python: batch submission that is safe to re-run, signed webhook collection, a reconciliation pass, and the rank rows.
Sync calls, async tasks or webhooks: which to use
When to wait for an answer, when to queue a task and poll, and when to let results come to you by webhook: retries and failure modes.
Brand mentions API: measure LLM mentions per engine
How to measure brand mentions in AI answers through an API: mention rate and citation share per engine and market, with Python code.