ilia
4b9ffb5ddf
- Enhanced `ARCHITECTURE.md` with details on LLM models for work (Llama 3.1 70B Q4) and family agents (Phi-3 Mini 3.8B Q4). - Introduced new documents: - `ASR_EVALUATION.md` for ASR engine evaluation and selection. - `HARDWARE.md` outlining hardware requirements and purchase plans. - `IMPLEMENTATION_GUIDE.md` for Milestone 2 implementation steps. - `LLM_CAPACITY.md` assessing VRAM and context window limits. - `LLM_MODEL_SURVEY.md` surveying open-weight LLM models. - `LLM_USAGE_AND_COSTS.md` detailing LLM usage and operational costs. - `MCP_ARCHITECTURE.md` describing the Model Context Protocol architecture. - `MCP_IMPLEMENTATION_SUMMARY.md` summarizing MCP implementation status. These updates provide comprehensive guidance for the next phases of development and ensure clarity in project documentation.
76 lines
1.9 KiB
Markdown
76 lines
1.9 KiB
Markdown
# Ticket: Integrate MCP with LLM Host
|
|
|
|
## Ticket Information
|
|
|
|
- **ID**: TICKET-030
|
|
- **Title**: Integrate MCP with Chosen LLM Host
|
|
- **Type**: Feature
|
|
- **Priority**: High
|
|
- **Status**: Done
|
|
- **Track**: Tools/MCP, LLM Infra
|
|
- **Milestone**: Milestone 2 - Voice Chat MVP
|
|
- **Created**: 2024-01-XX
|
|
|
|
## Description
|
|
|
|
Integrate MCP server with LLM:
|
|
- Write adapter converting model tool-use outputs into MCP calls
|
|
- Convert MCP responses back to LLM format
|
|
- Handle tool discovery and registration
|
|
- Error handling and retries
|
|
|
|
## Acceptance Criteria
|
|
|
|
- [x] MCP-LLM adapter implemented (`mcp-adapter/adapter.py`)
|
|
- [x] Tool-use outputs → MCP calls working
|
|
- [x] MCP responses → LLM format working
|
|
- [x] Tool discovery automatic (`discover_tools()`)
|
|
- [x] Error handling robust
|
|
|
|
## Technical Details
|
|
|
|
Adapter should:
|
|
- Parse LLM function calls
|
|
- Map to MCP tool calls
|
|
- Handle responses and errors
|
|
- Support streaming if needed
|
|
|
|
## Dependencies
|
|
|
|
- TICKET-029 (MCP server)
|
|
- TICKET-021 or TICKET-022 (LLM server with function-calling)
|
|
|
|
## Related Files
|
|
|
|
- `home-voice-agent/mcp-adapter/` (to be created)
|
|
|
|
## Notes
|
|
|
|
Needs LLM server with function-calling support. Critical for tool integration.
|
|
|
|
## Progress Log
|
|
|
|
- 2024-01-XX - MCP-LLM adapter implemented (`mcp-adapter/adapter.py`)
|
|
- 2024-01-XX - Tool discovery working (`discover_tools()`)
|
|
- 2024-01-XX - Function call → MCP call conversion working
|
|
- 2024-01-XX - MCP response → LLM format conversion working
|
|
- 2024-01-XX - Error handling implemented
|
|
- 2024-01-XX - Test script created (`test_adapter.py`)
|
|
- 2024-01-XX - Ready for integration with LLM servers
|
|
|
|
## Implementation Details
|
|
|
|
**Location**: `home-voice-agent/mcp-adapter/`
|
|
|
|
**Components**:
|
|
- `adapter.py` - Main adapter class
|
|
- `test_adapter.py` - Test script
|
|
- `requirements.txt` - Dependencies (requests)
|
|
|
|
**To Test**:
|
|
```bash
|
|
cd mcp-adapter
|
|
pip install -r requirements.txt
|
|
python test_adapter.py
|
|
```
|