For the complete documentation index, see llms.txt. This page is also available as Markdown.

Domain

Use this page for passive domain investigation: registration data, RDAP/WHOIS, DNS records, passive DNS, certificate transparency, archives, email security records, typosquatting, redirects, and related infrastructure pivots. Active subdomain brute forcing, takeover testing, nuclei scanning, and exploit-driven recon belong in Red Offensive.

WHOIS vs. RDAP

WHOIS is the older registration lookup protocol. It is useful, but responses are inconsistent across registrars and hard to parse reliably.

RDAP (Registration Data Access Protocol) is the modern successor. The core RFC 7480 series was published in 2015, and ICANN's gTLD RDAP requirements have continued to expand since then. RDAP provides structured JSON responses, better internationalization support, authentication-aware access, RESTful APIs, and more consistent privacy handling.

Domain.html

Domain.html is a multi-lookup helper for pivoting through domain investigation sources.

  • Registration Data - WHOIS/RDAP-style ownership and registrar details.

  • Hosting Data - Hosting provider and related infrastructure.

  • Archive Data - Wayback Machine, Archive.today, and other historical snapshots.

  • Analytics Data - Similar sites, backlinks, and relationship pivots.

  • Threat Data - Use the Threat Data page for reputation and enrichment.

  • Shortened URL Metadata - Shortener preview and redirect investigation.

Local helper copy: Domain.html

Domain Toolboxes

  • ViewDNS - DNS, reverse IP, IP history, and related lookup utilities.

  • DNSDumpster - Passive DNS reconnaissance and visualization.

  • MXToolbox - MX, DNS, DMARC, and blacklist diagnostics.

  • DNSLytics - Domain/IP/provider relationships and historical data.

  • HostSpider - Domain information gathering CLI.

Passive DNS and Historical Records

Passive DNS systems collect observed DNS resolution history. Use them to find past hosting, related subdomains, and infrastructure relationships without directly touching a target.

More indicator-focused passive DNS sources are maintained on Threat Data.

Threat Data

Reverse WHOIS and Reverse IP

Passive Subdomain Discovery

These tools primarily use public datasets, certificate transparency, search engines, or other passive sources. They are useful for OSINT and scoping, but review each tool's options because some can also perform active queries.

  • Chaos - ProjectDiscovery subdomain dataset.

  • Pentest-Tools Subdomain Finder - Online subdomain discovery.

  • censys-subdomain-finder - Enumerates subdomains from Censys certificate data.

  • ctfr - Certificate Transparency subdomain discovery.

  • Sublist3r - OSINT subdomain enumeration. Some older sources it references, such as ThreatCrowd, are no longer active.

  • Subfinder - Fast passive subdomain discovery by ProjectDiscovery.

  • Assetfinder - Finds domains and subdomains related to a target.

Active DNS reconnaissance and brute forcing tools such as Amass active modes, puredns, dnsenum, fierce, dnsrecon, MassDNS, and dnsx are preserved in Red Offensive.

Reconnaissance and Scanning

Domain Reputation and Threat Intelligence

Domain reputation lookups are maintained on Threat Data to avoid repeating the same VirusTotal, URLhaus, PhishTank, Talos, OTX, Pulsedive, and Google Safe Browsing resources across multiple pages.

Threat Data

Email Security Records

Email authentication records help verify legitimate sending infrastructure and can expose authorized third-party services.

Typosquatting and Domain Permutations

  • dnstwist - Domain permutation engine for typosquatting and phishing detection.

  • URLCrazy - Domain typo and variation generator.

Favicon Hash and Technology Fingerprinting

Certificate Transparency

Archive and Historical Data

  • Wayback Machine - Historical website snapshots.

  • Archive.today - On-demand and historical page archives.

  • CachedView - Google cache, Wayback Machine, and Archive.today helper.

  • waybackurls - Fetch URLs from the Wayback Machine.

  • waymore - URL discovery from web archives and public datasets.

Google removed the old cache link feature from search results, so avoid relying on Google cache workflows for future investigations.

Website Change Tracking

URL Shortening and Redirections

Shortener preview tricks:

  • bit.ly - Add + to the end of the URL.

  • cutt.ly - Add @ to the end of the URL.

  • tiny.cc - Add = to the end of the URL.

  • tinyurl.com - Add preview. before the host.

Safe Browser Views

  • WannaBrowser - View source using different user-agent strings.

  • Browserling - Browser testing through hosted browsers.

  • URL2PNG - Website screenshots without visiting directly.

Miscellaneous Domain Utilities

  • DNPedia - Domain statistics, scripts, news, and tools.

  • Google Admin Toolbox Dig - Web-based DNS lookup.

  • Backlink Checker - Backlink monitoring.

  • DomLink - Finds organization names and email addresses from a domain.

  • Unfurl - Breaks down URLs into components.

  • r3con1z3r - Web-based footprinting and OSINT CLI.

  • theHarvester - Public-source email, host, and subdomain gathering.

  • gau - Fetches known URLs from OTX, Wayback Machine, and Common Crawl.

  • lbd - Load-balancing detector.

  • Metagoofil - Extracts metadata from public documents for a domain.

  • Cache Checker - Lists cached web files and cache behavior.

  • CloudFlair - Finds possible Cloudflare origin IPs from scan data.

  • cf-check - Checks Cloudflare protection.

  • AnalyticsRelationships - Finds related domains through shared Google Analytics IDs.

  • LOTS Project - Legitimate domains commonly abused for phishing, C2, exfiltration, and malware delivery.

Google Dorking for Domains

  • site:example.com - Indexed pages for a domain.

  • site:*.example.com - Indexed subdomains.

  • site:example.com filetype:pdf - Specific file types.

  • site:example.com inurl:admin - Admin-related paths.

  • site:example.com intitle:"index of" - Directory listings.

  • intext:"example.com" site:pastebin.com - Domain mentions in pastes.

  • related:example.com - Similar websites.

Google Dorking

Domain Monitoring

Subdomain takeover testing with nuclei, Subjack, and related tools is offensive validation and belongs with active recon and web application testing.

Reconnaissance and ScanningWeb App Hacking

Deprecated or Offline Tools

  • omnisint.io / Project Crobat - Rapid7 DNS dataset service discontinued.

  • ThreatCrowd - Offline/deprecated; data migrated to AlienVault OTX.

  • tls.bufferover.run - BufferOver services discontinued.

  • Riddler.io - Discontinued F-Secure network intelligence API.

  • CheckShortURL - Frequently offline/unreliable.

  • W3DT - Appears offline.

  • DomainIQ - Service unavailable.

  • SubOver - No longer maintained; use current takeover detection workflows in active recon.

  • Spyse - Rebranded/acquired and no longer the same free OSINT search engine.

  • DomainFuzz - Repository appears unavailable.

  • Bolster CheckPhish at bolster.ai/checkphish - Not specifically a typosquatting resource.

Investigation Mind Maps

Last updated