llm_council/scripts/diagnose_gpu_vm.sh
Irina Levit 3546c04348
Some checks failed
CI / backend-test (push) Successful in 4m9s
CI / frontend-test (push) Failing after 3m48s
CI / lint-python (push) Successful in 1m41s
CI / secret-scanning (push) Successful in 1m20s
CI / dependency-scan (push) Successful in 10m50s
CI / workflow-summary (push) Successful in 1m11s
feat: Major UI/UX improvements and production readiness
## Features Added

### Document Reference System
- Implemented numbered document references (@1, @2, etc.) with autocomplete dropdown
- Added fuzzy filename matching for @filename references
- Document filtering now prioritizes numeric refs > filename refs > all documents
- Autocomplete dropdown appears when typing @ with keyboard navigation (Up/Down, Enter/Tab, Escape)
- Document numbers displayed in UI for easy reference

### Conversation Management
- Added conversation rename functionality with inline editing
- Implemented conversation search (by title and content)
- Search box always visible, even when no conversations exist
- Export reports now replace @N references with actual filenames

### UI/UX Improvements
- Removed debug toggle button
- Improved text contrast in dark mode (better visibility)
- Made input textarea expand to full available width
- Fixed file text color for better readability
- Enhanced document display with numbered badges

### Configuration & Timeouts
- Made HTTP client timeouts configurable (connect, write, pool)
- Added .env.example with all configuration options
- Updated timeout documentation

### Developer Experience
- Added `make test-setup` target for automated test conversation creation
- Test setup script supports TEST_MESSAGE and TEST_DOCS env vars
- Improved Makefile with dev and test-setup targets

### Documentation
- Updated ARCHITECTURE.md with all new features
- Created comprehensive deployment documentation
- Added GPU VM setup guides
- Removed unnecessary markdown files (CLAUDE.md, CONTRIBUTING.md, header.jpg)
- Organized documentation in docs/ directory

### GPU VM / Ollama (Stability + GPU Offload)
- Updated GPU VM docs to reflect the working systemd environment for remote Ollama
- Standardized remote Ollama port to 11434 (and added /v1/models verification)
- Documented required env for GPU offload on this VM:
  - `OLLAMA_MODELS=/mnt/data/ollama`, `HOME=/mnt/data/ollama/home`
  - `OLLAMA_LLM_LIBRARY=cuda_v12` (not `cuda`)
  - `LD_LIBRARY_PATH=/usr/local/lib/ollama:/usr/local/lib/ollama/cuda_v12`

## Technical Changes

### Backend
- Enhanced `docs_context.py` with reference parsing (numeric and filename)
- Added `update_conversation_title` to storage.py
- New endpoints: PATCH /api/conversations/{id}/title, GET /api/conversations/search
- Improved report generation with filename substitution

### Frontend
- Removed debugMode state and related code
- Added autocomplete dropdown component
- Implemented search functionality in Sidebar
- Enhanced ChatInterface with autocomplete and improved textarea sizing
- Updated CSS for better contrast and responsive design

## Files Changed
- Backend: config.py, council.py, docs_context.py, main.py, storage.py
- Frontend: App.jsx, ChatInterface.jsx, Sidebar.jsx, and related CSS files
- Documentation: README.md, ARCHITECTURE.md, new docs/ directory
- Configuration: .env.example, Makefile
- Scripts: scripts/test_setup.py

## Breaking Changes
None - all changes are backward compatible

## Testing
- All existing tests pass
- New test-setup script validates conversation creation workflow
- Manual testing of autocomplete, search, and rename features
2025-12-28 18:15:02 -05:00

58 lines
1.8 KiB
Bash
Executable File

#!/bin/bash
# Quick diagnostic script for GPU VM connection
GPU_VM="10.0.30.63"
echo "=== GPU VM Connection Diagnostics ==="
echo ""
echo "1. Testing basic connectivity..."
if ping -c 1 -W 2 $GPU_VM > /dev/null 2>&1; then
echo " ✓ GPU VM is reachable"
else
echo " ✗ Cannot reach GPU VM - check network/firewall"
exit 1
fi
echo ""
echo "2. Testing port 11434 (Ollama default)..."
if timeout 3 curl -s http://$GPU_VM:11434/api/tags > /dev/null 2>&1; then
echo " ✓ Port 11434 is open and responding"
echo " Models available:"
curl -s http://$GPU_VM:11434/api/tags | python3 -m json.tool 2>/dev/null | grep -E '"name"|"model"' | head -5
else
echo " ✗ Port 11434 not responding"
echo " Error details:"
timeout 3 curl -v http://$GPU_VM:11434/api/tags 2>&1 | grep -E "Connection|timeout|refused" | head -3
fi
echo ""
echo "3. Testing port 8000 (alternative)..."
if timeout 3 curl -s http://$GPU_VM:8000/v1/models > /dev/null 2>&1; then
echo " ✓ Port 8000 is open and responding"
else
echo " ✗ Port 8000 not responding"
fi
echo ""
echo "4. Checking your .env configuration..."
if [ -f .env ]; then
echo " OPENAI_COMPAT_BASE_URL: $(grep OPENAI_COMPAT_BASE_URL .env | grep -v '^#' | cut -d'=' -f2)"
echo " USE_LOCAL_OLLAMA: $(grep USE_LOCAL_OLLAMA .env | grep -v '^#' | cut -d'=' -f2)"
else
echo " ✗ .env file not found"
fi
echo ""
echo "=== Recommendations ==="
echo ""
echo "If port 11434 is not working:"
echo " 1. SSH to GPU VM: ssh root@$GPU_VM"
echo " 2. Check if Ollama is running: systemctl status ollama"
echo " 3. Check what port Ollama is listening on: netstat -tlnp | grep ollama"
echo " 4. If only listening on 127.0.0.1, configure it to listen on 0.0.0.0"
echo ""
echo "If you need to use a different port, update .env:"
echo " OPENAI_COMPAT_BASE_URL=http://$GPU_VM:PORT"