Projects

Contents

Projects#

End-to-end Python projects build to consolidate the preceding chapters. Each project pulls together a subset of Setup, Tooling, Language, Patterns, Structures, Algorithms, Libraries, Frameworks, and Networking into one running thing you can ship and re-run on a target.

The headline project is the OSINT article pipeline, scraping through publication using scrapy, newspaper, nltk, pandas, and django. Smaller projects sit alongside it as focused exercises in a single technique or stack.

News pipeline

Collecting, extracting, analyzing, and publishing open-source reporting. scrapy, newspaper, nltk, pandas, django.

News pipeline
Django site

The publishing layer for the corpus the news pipeline produces.

Django site
Model Context Protocol

A Python MCP server exposing operator tools, resources, and prompts to any MCP-aware LLM client.

Model Context Protocol
A Shodan alternative

Internet-wide port and banner search engine. The operator’s own scanner, indexer, and search API for authorized ranges.

A Shodan alternative

References#

  • Setup for the project bootstrap each project starts from.

  • Tooling for the dependency / venv toolchain underneath.

  • Libraries for the libraries each project leans on.

  • Frameworks for Django’s architecture and full surface.

  • Networking for the protocols the crawl works over.