atlas/tickets/done/TICKET-030_mcp-llm-integration.md
ilia 4b9ffb5ddf docs: Update architecture and add new documentation for LLM and MCP
- Enhanced `ARCHITECTURE.md` with details on LLM models for work (Llama 3.1 70B Q4) and family agents (Phi-3 Mini 3.8B Q4).
- Introduced new documents:
  - `ASR_EVALUATION.md` for ASR engine evaluation and selection.
  - `HARDWARE.md` outlining hardware requirements and purchase plans.
  - `IMPLEMENTATION_GUIDE.md` for Milestone 2 implementation steps.
  - `LLM_CAPACITY.md` assessing VRAM and context window limits.
  - `LLM_MODEL_SURVEY.md` surveying open-weight LLM models.
  - `LLM_USAGE_AND_COSTS.md` detailing LLM usage and operational costs.
  - `MCP_ARCHITECTURE.md` describing the Model Context Protocol architecture.
  - `MCP_IMPLEMENTATION_SUMMARY.md` summarizing MCP implementation status.

These updates provide comprehensive guidance for the next phases of development and ensure clarity in project documentation.
2026-01-05 23:44:16 -05:00

1.2 KiB

Ticket: Integrate MCP with LLM Host

Ticket Information

  • ID: TICKET-030
  • Title: Integrate MCP with Chosen LLM Host
  • Type: Feature
  • Priority: High
  • Status: Done
  • Track: Tools/MCP, LLM Infra
  • Milestone: Milestone 2 - Voice Chat MVP
  • Created: 2024-01-XX

Description

Integrate MCP server with LLM:

  • Write adapter converting model tool-use outputs into MCP calls
  • Convert MCP responses back to LLM format
  • Handle tool discovery and registration
  • Error handling and retries

Acceptance Criteria

  • MCP-LLM adapter implemented (mcp-adapter/adapter.py)
  • Tool-use outputs → MCP calls working
  • MCP responses → LLM format working
  • Tool discovery automatic (discover_tools())
  • Error handling robust

Technical Details

Adapter should:

  • Parse LLM function calls
  • Map to MCP tool calls
  • Handle responses and errors
  • Support streaming if needed

Dependencies

  • TICKET-029 (MCP server)
  • TICKET-021 or TICKET-022 (LLM server with function-calling)
  • home-voice-agent/mcp-adapter/ (to be created)

Notes

Needs LLM server with function-calling support. Critical for tool integration.