ilia
3a89c1e6d2
Add comprehensive automation system
New Scripts:
- scripts/daily_fetch.sh: Automated daily data updates
* Fetches congressional trades (last 7 days)
* Enriches securities (name, sector, industry)
* Updates price data for all securities
* Calculates returns and metrics
* Logs everything to logs/ directory
- scripts/setup_automation.sh: Interactive automation setup
* Makes scripts executable
* Creates log directories
* Configures cron jobs (multiple schedule options)
* Guides user through setup
Documentation:
- docs/10_automation.md: Complete automation guide
* Explains disclosure timing (30-45 day legal lag)
* Why daily updates are optimal (not hourly/real-time)
* Cron job setup instructions
* Systemd timer alternative
* Email notifications (optional)
* Monitoring and logging
* Failure handling
* Performance optimization
Key Insights:
❌ No real-time data possible (STOCK Act = 30-45 day lag)
✅ Daily updates are optimal
✅ Automated via cron jobs
✅ Handles API failures gracefully
✅ Logs everything for debugging
2025-12-15 14:55:05 -05:00
..
2025-12-14 20:45:34 -05:00
2025-12-14 20:45:34 -05:00
2025-12-14 20:45:34 -05:00
2025-12-14 20:45:34 -05:00
2025-12-14 20:45:34 -05:00
2025-12-14 20:45:34 -05:00
2025-12-14 20:45:34 -05:00
2025-12-14 20:45:34 -05:00
2025-12-14 20:45:34 -05:00
2025-12-15 10:39:18 -05:00
2025-12-15 14:55:05 -05:00
2025-12-14 20:45:34 -05:00
2025-12-14 20:45:34 -05:00
2025-12-14 20:45:34 -05:00
2025-12-15 10:39:18 -05:00
2025-12-15 11:33:21 -05:00