Skip to content

cbintel Documentation

Intelligence gathering and knowledge synthesis toolkit.

Guides

Document Description
CRAWWL Analysis Web crawling architecture and pipeline
Next Steps Roadmap and planned features

Reference

Document Description
Architecture System design and component relationships
VPN Cluster API Geographic VPN bank management
WireGuard Tunnel Multi-worker exit node deployment
OpenVPN Tunnel OpenVPN configuration via ProtonVPN
Lazarus PipelineV2 Fast WARC-based archive retrieval
Service Renaming API domain consolidation plan

Components

Package Purpose
cbintel.ai AI client wrappers (Anthropic, Ollama, CBAI)
cbintel.net Network operations (HTTP, search, URL cleaning)
cbintel.io File/process I/O (HTML, markdown, storage)
cbintel.crawl AI-powered web crawling pipeline
cbintel.lazarus Historical web archives (CDX, gau)
cbintel.vectl Vector embeddings and similarity search
cbintel.screenshots Browser automation (Playwright)
cbintel.cluster VPN cluster management API
cbintel.geo Geographic VPN routing for jobs
cbintel.jobs Async job queue with workers

Services

Domain Port Description
intel.nominate.ai 9003 Intelligence API (crawl, lazarus, vectl, screenshots)
network.nominate.ai 32203 Network API (VPN cluster management)

Both services run under a single cbintel.service systemd unit.

Source Projects

Documentation consolidated from extern/ projects:

Project Description
Ferret Autonomous web interaction with visual learning
Lazarus Web archive processing and semantic search
Guzl Playwright browser CLI for screenshots/DOM
Vectl High-performance vector storage with clustering
Seedbed AI-driven knowledge synthesis platform
Leaks DNS & network leak detection tool
Llarp Distributed VPN load balancer (16 workers)