- Enhanced `ARCHITECTURE.md` with details on LLM models for work (Llama 3.1 70B Q4) and family agents (Phi-3 Mini 3.8B Q4). - Introduced new documents: - `ASR_EVALUATION.md` for ASR engine evaluation and selection. - `HARDWARE.md` outlining hardware requirements and purchase plans. - `IMPLEMENTATION_GUIDE.md` for Milestone 2 implementation steps. - `LLM_CAPACITY.md` assessing VRAM and context window limits. - `LLM_MODEL_SURVEY.md` surveying open-weight LLM models. - `LLM_USAGE_AND_COSTS.md` detailing LLM usage and operational costs. - `MCP_ARCHITECTURE.md` describing the Model Context Protocol architecture. - `MCP_IMPLEMENTATION_SUMMARY.md` summarizing MCP implementation status. These updates provide comprehensive guidance for the next phases of development and ensure clarity in project documentation.
1.2 KiB
1.2 KiB
Ticket: Integrate MCP with LLM Host
Ticket Information
- ID: TICKET-030
- Title: Integrate MCP with Chosen LLM Host
- Type: Feature
- Priority: High
- Status: Done
- Track: Tools/MCP, LLM Infra
- Milestone: Milestone 2 - Voice Chat MVP
- Created: 2024-01-XX
Description
Integrate MCP server with LLM:
- Write adapter converting model tool-use outputs into MCP calls
- Convert MCP responses back to LLM format
- Handle tool discovery and registration
- Error handling and retries
Acceptance Criteria
- MCP-LLM adapter implemented (
mcp-adapter/adapter.py) - Tool-use outputs → MCP calls working
- MCP responses → LLM format working
- Tool discovery automatic (
discover_tools()) - Error handling robust
Technical Details
Adapter should:
- Parse LLM function calls
- Map to MCP tool calls
- Handle responses and errors
- Support streaming if needed
Dependencies
- TICKET-029 (MCP server)
- TICKET-021 or TICKET-022 (LLM server with function-calling)
Related Files
home-voice-agent/mcp-adapter/(to be created)
Notes
Needs LLM server with function-calling support. Critical for tool integration.