OSINT APIs#
Public-web and aggregator APIs the OSINT operator pulls from. Most need a free account and an API key; rate limits and ToS matter as much as the schema.
API |
Auth + tier |
Endpoint |
Returns |
|---|---|---|---|
Google Programmable Search |
API key + CSE ID; 100 queries/day free. |
Web results from a configured search engine. |
|
Bing Search (Azure) |
Azure subscription key; deprecation announced for 2025. |
Web, image, news, video search. |
|
Brave Search API |
Subscription token; paid tiers. |
Independent index web search. |
|
Kagi Search API |
Paid; |
High-signal web search with lens support. |
|
DuckDuckGo Instant Answer |
No auth; topical answers only, no full web results. |
Instant answers, abstracts, topics. |
|
SerpAPI / SearchAPI |
Paid; scraping proxy for many engines. |
Structured results from Google, Bing, Baidu, etc. |
|
Wayback Machine CDX |
No auth; rate-limited. |
Historical snapshot index for a URL. |
|
Common Crawl Index |
No auth; pay your own egress. |
Index of monthly web crawl WARC files. |
|
GitHub REST + GraphQL |
PAT; 5000 reqs/hour authenticated. |
Repos, issues, gists, commits, code search. |
|
Hunter.io |
API key; paid tiers. |
Email-pattern discovery for a domain. |
|
HaveIBeenPwned |
API key; paid for full results. |
Breach exposure check for an account. |
|
OpenCorporates |
API key; free + paid tiers. |
Company filings and beneficial owners. |
|
Wikipedia / Wikidata |
No auth; rate-limited. |
Article content, categories, Wikidata claims. |
|
Crt.sh |
No auth; rate-limited. |
Certificate Transparency log search for subdomains. |
|
urlscan.io |
API key for submission; public for search. |
Scan and search recorded URL behavior. |
References#
OSINT for the discipline overview.
OSINT Tools for the operator’s kit.
OSINT Sources for the data sources.
OSINT Techniques for the tradecraft.
OSINT Intel for the finished-product side.
API directory: ProgrammableWeb / RapidAPI