ilia 3a89c1e6d2 Add comprehensive automation system
New Scripts:
- scripts/daily_fetch.sh: Automated daily data updates
  * Fetches congressional trades (last 7 days)
  * Enriches securities (name, sector, industry)
  * Updates price data for all securities
  * Calculates returns and metrics
  * Logs everything to logs/ directory

- scripts/setup_automation.sh: Interactive automation setup
  * Makes scripts executable
  * Creates log directories
  * Configures cron jobs (multiple schedule options)
  * Guides user through setup

Documentation:
- docs/10_automation.md: Complete automation guide
  * Explains disclosure timing (30-45 day legal lag)
  * Why daily updates are optimal (not hourly/real-time)
  * Cron job setup instructions
  * Systemd timer alternative
  * Email notifications (optional)
  * Monitoring and logging
  * Failure handling
  * Performance optimization

Key Insights:
 No real-time data possible (STOCK Act = 30-45 day lag)
 Daily updates are optimal
 Automated via cron jobs
 Handles API failures gracefully
 Logs everything for debugging
2025-12-15 14:55:05 -05:00
2025-12-15 14:55:05 -05:00
2025-12-14 20:45:34 -05:00
2025-12-15 11:33:21 -05:00

POTE Public Officials Trading Explorer

Research-only tool for tracking and analyzing public stock trades by government officials.

⚠️ Important: This project is for personal research and transparency analysis only. It is NOT for investment advice or live trading.

What is this?

POTE tracks stock trading activity of government officials (starting with U.S. Congress) using lawfully available public data sources. It computes research metrics, descriptive signals, and risk/ethics flags to help understand trading patterns.

Key constraints

  • Public data only: House Stock Watcher (free!), yfinance (free!), QuiverQuant/FMP (optional)
  • Research framing: All outputs are descriptive analytics, not trading recommendations
  • No inside information claims: We use public disclosures that may be delayed or incomplete

Current Status

PR1 Complete: Project scaffold, DB models, price loader
PR2 Complete: Congressional trade ingestion (House Stock Watcher)
PR3 Complete: Security enrichment + deployment infrastructure
PR4 Complete: Phase 2 analytics - returns, benchmarks, performance metrics
45+ passing tests, 88%+ coverage

Quick start

🚀 Already deployed? See QUICKSTART.md for full usage guide!

📦 Deploying? See PROXMOX_QUICKSTART.md for Proxmox LXC deployment (recommended).

Local Development

# Install
git clone <your-repo>
cd pote
make install
source venv/bin/activate

# Run migrations
make migrate

# Ingest sample data (offline, for testing)
python scripts/ingest_from_fixtures.py

# Enrich securities with company info
python scripts/enrich_securities.py

# With internet:
python scripts/fetch_congressional_trades.py
python scripts/fetch_sample_prices.py

# Run tests
make test

# Lint & format
make lint format

Production Deployment

# Proxmox LXC (Recommended - 5 minutes)
bash scripts/proxmox_setup.sh

# Docker
docker-compose up -d

Tech stack

  • Language: Python 3.10+
  • Database: PostgreSQL or SQLite (dev)
  • Data: House Stock Watcher (free!), yfinance (free!), QuiverQuant/FMP (optional)
  • Libraries: SQLAlchemy, Alembic, pandas, numpy, httpx, yfinance, scikit-learn
  • Testing: pytest (28 tests, 87%+ coverage)

Documentation

Getting Started:

Deployment:

Technical:

PR Summaries:

What's Working Now

  • SQLAlchemy models for officials, securities, trades, prices
  • Alembic migrations
  • Price loader with yfinance (idempotent, upsert)
  • Congressional trade ingestion from House Stock Watcher (FREE!)
  • Security enrichment (company names, sectors, industries)
  • ETL to populate officials & trades tables
  • Docker + deployment infrastructure
  • 37 passing tests with 87%+ coverage
  • Linting (ruff + mypy) all green
  • Works 100% offline with fixtures

What You Can Do Now

Analyze Performance

# Analyze specific official
python scripts/analyze_official.py "Nancy Pelosi" --window 90

# System-wide analysis
python scripts/calculate_all_returns.py

Add More Data

# Manual entry
python scripts/add_custom_trades.py

# CSV import
python scripts/scrape_alternative_sources.py import trades.csv

Next Steps (Phase 3)

  • Signals: "follow_research", "avoid_risk", "watch" with confidence scores
  • Clustering: group officials by trading behavior patterns
  • API: FastAPI backend for queries
  • Dashboard: React/Streamlit visualization

See docs/00_mvp.md for the full roadmap.


License: MIT (for research/educational use only)
Disclaimer: Not investment advice. Use public data only. No claims about inside information.

Description
No description provided
Readme 416 KiB
Languages
Python 91.2%
Shell 8.1%
Makefile 0.3%
Mako 0.2%
Dockerfile 0.2%