Irina Levit
3546c04348
Some checks failed
CI / backend-test (push) Successful in 4m9s
CI / frontend-test (push) Failing after 3m48s
CI / lint-python (push) Successful in 1m41s
CI / secret-scanning (push) Successful in 1m20s
CI / dependency-scan (push) Successful in 10m50s
CI / workflow-summary (push) Successful in 1m11s
## Features Added
### Document Reference System
- Implemented numbered document references (@1, @2, etc.) with autocomplete dropdown
- Added fuzzy filename matching for @filename references
- Document filtering now prioritizes numeric refs > filename refs > all documents
- Autocomplete dropdown appears when typing @ with keyboard navigation (Up/Down, Enter/Tab, Escape)
- Document numbers displayed in UI for easy reference
### Conversation Management
- Added conversation rename functionality with inline editing
- Implemented conversation search (by title and content)
- Search box always visible, even when no conversations exist
- Export reports now replace @N references with actual filenames
### UI/UX Improvements
- Removed debug toggle button
- Improved text contrast in dark mode (better visibility)
- Made input textarea expand to full available width
- Fixed file text color for better readability
- Enhanced document display with numbered badges
### Configuration & Timeouts
- Made HTTP client timeouts configurable (connect, write, pool)
- Added .env.example with all configuration options
- Updated timeout documentation
### Developer Experience
- Added `make test-setup` target for automated test conversation creation
- Test setup script supports TEST_MESSAGE and TEST_DOCS env vars
- Improved Makefile with dev and test-setup targets
### Documentation
- Updated ARCHITECTURE.md with all new features
- Created comprehensive deployment documentation
- Added GPU VM setup guides
- Removed unnecessary markdown files (CLAUDE.md, CONTRIBUTING.md, header.jpg)
- Organized documentation in docs/ directory
### GPU VM / Ollama (Stability + GPU Offload)
- Updated GPU VM docs to reflect the working systemd environment for remote Ollama
- Standardized remote Ollama port to 11434 (and added /v1/models verification)
- Documented required env for GPU offload on this VM:
- `OLLAMA_MODELS=/mnt/data/ollama`, `HOME=/mnt/data/ollama/home`
- `OLLAMA_LLM_LIBRARY=cuda_v12` (not `cuda`)
- `LD_LIBRARY_PATH=/usr/local/lib/ollama:/usr/local/lib/ollama/cuda_v12`
## Technical Changes
### Backend
- Enhanced `docs_context.py` with reference parsing (numeric and filename)
- Added `update_conversation_title` to storage.py
- New endpoints: PATCH /api/conversations/{id}/title, GET /api/conversations/search
- Improved report generation with filename substitution
### Frontend
- Removed debugMode state and related code
- Added autocomplete dropdown component
- Implemented search functionality in Sidebar
- Enhanced ChatInterface with autocomplete and improved textarea sizing
- Updated CSS for better contrast and responsive design
## Files Changed
- Backend: config.py, council.py, docs_context.py, main.py, storage.py
- Frontend: App.jsx, ChatInterface.jsx, Sidebar.jsx, and related CSS files
- Documentation: README.md, ARCHITECTURE.md, new docs/ directory
- Configuration: .env.example, Makefile
- Scripts: scripts/test_setup.py
## Breaking Changes
None - all changes are backward compatible
## Testing
- All existing tests pass
- New test-setup script validates conversation creation workflow
- Manual testing of autocomplete, search, and rename features
60 lines
1.9 KiB
Bash
Executable File
60 lines
1.9 KiB
Bash
Executable File
#!/bin/bash
|
|
# Find and verify Ollama models on GPU VM
|
|
# Run this ON THE GPU VM
|
|
|
|
echo "=== Finding Ollama Models ==="
|
|
echo ""
|
|
|
|
echo "1. Check what Ollama API reports:"
|
|
echo " Running: curl http://localhost:11434/api/tags"
|
|
curl -s http://localhost:11434/api/tags | python3 -m json.tool 2>/dev/null || curl -s http://localhost:11434/api/tags
|
|
|
|
echo ""
|
|
echo ""
|
|
echo "2. Find Ollama data directory:"
|
|
echo " Checking common locations..."
|
|
|
|
# Check for OLLAMA_MODELS env var
|
|
if [ -n "$OLLAMA_MODELS" ]; then
|
|
echo " OLLAMA_MODELS env var: $OLLAMA_MODELS"
|
|
if [ -d "$OLLAMA_MODELS" ]; then
|
|
echo " ✓ Found! Size: $(du -sh "$OLLAMA_MODELS" 2>/dev/null | cut -f1)"
|
|
echo " Models:"
|
|
ls -lh "$OLLAMA_MODELS" | head -10
|
|
fi
|
|
fi
|
|
|
|
# Check common locations
|
|
for dir in ~/.ollama/models ~/.ollama /usr/share/ollama/models /usr/share/ollama /var/lib/ollama/models /var/lib/ollama; do
|
|
if [ -d "$dir" ]; then
|
|
echo " Found: $dir"
|
|
echo " Size: $(du -sh "$dir" 2>/dev/null | cut -f1)"
|
|
if [ -d "$dir/models" ]; then
|
|
echo " Models in subdirectory:"
|
|
ls -lh "$dir/models" 2>/dev/null | head -5
|
|
fi
|
|
find "$dir" -name "*.gguf" -o -name "*.bin" 2>/dev/null | head -5
|
|
fi
|
|
done
|
|
|
|
echo ""
|
|
echo "3. Check Ollama process environment:"
|
|
sudo cat /proc/$(pgrep -f ollama | head -1)/environ 2>/dev/null | tr '\0' '\n' | grep -i model || echo " No OLLAMA_MODELS in process env"
|
|
|
|
echo ""
|
|
echo "4. Check systemd service environment:"
|
|
systemctl show ollama | grep -i environment
|
|
|
|
echo ""
|
|
echo "=== If models are missing ==="
|
|
echo "They might be in a different location. Ollama stores models in:"
|
|
echo " - Default: ~/.ollama/models (or /usr/share/ollama/models)"
|
|
echo " - Or wherever OLLAMA_MODELS env var points"
|
|
echo ""
|
|
echo "To re-download models:"
|
|
echo " ollama pull qwen2:latest"
|
|
echo " ollama pull qwen2.5:14b"
|
|
echo " ollama pull llama3.1:8b"
|
|
echo " ollama pull qwen2.5:7b"
|
|
|