ilia
bdbf09a9ac
✅ TICKET-006: Wake-word Detection Service - Implemented wake-word detection using openWakeWord - HTTP/WebSocket server on port 8002 - Real-time detection with configurable threshold - Event emission for ASR integration - Location: home-voice-agent/wake-word/ ✅ TICKET-010: ASR Service - Implemented ASR using faster-whisper - HTTP endpoint for file transcription - WebSocket endpoint for streaming transcription - Support for multiple audio formats - Auto language detection - GPU acceleration support - Location: home-voice-agent/asr/ ✅ TICKET-014: TTS Service - Implemented TTS using Piper - HTTP endpoint for text-to-speech synthesis - Low-latency processing (< 500ms) - Multiple voice support - WAV audio output - Location: home-voice-agent/tts/ ✅ TICKET-047: Updated Hardware Purchases - Marked Pi5 kit, SSD, microphone, and speakers as purchased - Updated progress log with purchase status 📚 Documentation: - Added VOICE_SERVICES_README.md with complete testing guide - Each service includes README.md with usage instructions - All services ready for Pi5 deployment 🧪 Testing: - Created test files for each service - All imports validated - FastAPI apps created successfully - Code passes syntax validation 🚀 Ready for: - Pi5 deployment - End-to-end voice flow testing - Integration with MCP server Files Added: - wake-word/detector.py - wake-word/server.py - wake-word/requirements.txt - wake-word/README.md - wake-word/test_detector.py - asr/service.py - asr/server.py - asr/requirements.txt - asr/README.md - asr/test_service.py - tts/service.py - tts/server.py - tts/requirements.txt - tts/README.md - tts/test_service.py - VOICE_SERVICES_README.md Files Modified: - tickets/done/TICKET-047_hardware-purchases.md Files Moved: - tickets/backlog/TICKET-006_prototype-wake-word-node.md → tickets/done/ - tickets/backlog/TICKET-010_streaming-asr-service.md → tickets/done/ - tickets/backlog/TICKET-014_tts-service.md → tickets/done/
61 lines
1.5 KiB
Markdown
61 lines
1.5 KiB
Markdown
# Ticket: Notes & Files (Markdown, PDFs)
|
|
|
|
## Ticket Information
|
|
|
|
- **ID**: TICKET-035
|
|
- **Title**: Notes & Files (Markdown, PDFs)
|
|
- **Type**: Feature
|
|
- **Priority**: Medium
|
|
- **Status**: Backlog
|
|
- **Track**: Tools/MCP
|
|
- **Milestone**: Milestone 3 - Memory, Reminders, Safety
|
|
- **Created**: 2024-01-XX
|
|
|
|
## Description
|
|
|
|
Implement notes and file tools:
|
|
- File indexing/search strategy (ripgrep + embeddings later)
|
|
- Start with basic full-text search + metadata
|
|
- MCP tools: search_notes, read_note, append_to_note, create_note
|
|
- PDF handling with lightweight text extractor
|
|
|
|
## Acceptance Criteria
|
|
|
|
- [ ] File indexing implemented
|
|
- [ ] Full-text search working
|
|
- [ ] MCP tools for notes (search, read, append, create)
|
|
- [ ] PDF text extraction working
|
|
- [ ] get_pdf_text tool implemented
|
|
- [ ] Tools registered in MCP server
|
|
|
|
## Technical Details
|
|
|
|
Search strategy:
|
|
- Phase 1: ripgrep for full-text search
|
|
- Phase 2: Add embeddings for semantic search
|
|
- Index: Markdown files, text files, PDFs
|
|
|
|
PDF extraction:
|
|
- Use PyPDF2, pdfplumber, or similar
|
|
- Extract text, preserve structure if possible
|
|
|
|
Tools:
|
|
- `search_notes`: Full-text search
|
|
- `read_note`: Read file content
|
|
- `append_to_note`: Add to existing note
|
|
- `create_note`: Create new note
|
|
- `get_pdf_text`: Extract PDF text
|
|
|
|
## Dependencies
|
|
|
|
- TICKET-029 (MCP server)
|
|
- Stable directory layout and backup strategy
|
|
|
|
## Related Files
|
|
|
|
- `home-voice-agent/mcp-server/tools/notes/` (to be created)
|
|
|
|
## Notes
|
|
|
|
Needs stable directory layout. Can be enhanced with embeddings later.
|