Structural Intelligence Engine

HTTPXRay is not a web scraper. It is a structural intelligence engine designed to expose how a website is built.

Powered by a high-performance HTTPX core and a multi-threaded crawler system, HTTPXRay maps every reachable link, asset, and dependency into a structured SQLite database.

It does not mirror content. It reveals architecture.

Think of it as an X-ray layer over the web — showing relationships, surfaces, and hidden structure in real time.

Version 1.2

Version 1.2 introduces a refined desktop interface and improved crawl control, allowing real-time visibility into spider activity and responsive stop handling without instability.

The system now behaves like a controlled instrument rather than a blind crawler.

• Dark interface optimized for data scanning
• Improved crawl interruption and control flow
• Stability improvements in threaded execution
• Cleaner visual feedback and navigation

Core Capabilities

• High-performance HTTPX crawling engine
• Multi-threaded spider workers
• Queue-driven recursive discovery
• SQLite-backed structural catalog
• Internal and external link analysis
• Real-time crawl visibility
• Export to CSV, JSON, TXT, and PDF
• Direct browser interaction with discovered links

What It Sees

HTTPXRay extracts structural relationships from standard HTML elements:

a[href]
link[href]
script[src]
img[src]
iframe[src]
video[src]
audio[src]
source[src]
form[action]

Every discovered node is indexed, categorized, and linked to its origin — forming a complete structural map of the target system.

Use Cases

• Website structure mapping
• Dependency and asset discovery
• Surface analysis and reconnaissance
• Broken link detection
• Content inventory and auditing
• OSINT and research workflows
• SEO structural analysis
• API and endpoint discovery

Execution

CLI: ./HTTPXRay

HTTPXRay runs as a desktop application and stores all results locally in SQLite, allowing post-analysis, export, and integration into external workflows.