Major WHOOSH system refactoring and feature enhancements

- Migrated from HIVE branding to WHOOSH across all components
- Enhanced backend API with new services: AI models, BZZZ integration, templates, members
- Added comprehensive testing suite with security, performance, and integration tests
- Improved frontend with new components for project setup, AI models, and team management
- Updated MCP server implementation with WHOOSH-specific tools and resources
- Enhanced deployment configurations with production-ready Docker setups
- Added comprehensive documentation and setup guides
- Implemented age encryption service and UCXL integration

🤖 Generated with [Claude Code](https://claude.ai/code)

Co-Authored-By: Claude <noreply@anthropic.com>
This commit is contained in:
anthonyrawlins
2025-08-27 08:34:48 +10:00
parent 0e9844ef13
commit 268214d971
399 changed files with 57390 additions and 2045 deletions

View File

@@ -1,10 +1,10 @@
# 🐝 Hive: Unified Distributed AI Orchestration Platform
# 🚀 WHOOSH: Unified Distributed AI Orchestration Platform
**Hive** is a comprehensive distributed AI orchestration platform that consolidates the best components from our distributed AI development ecosystem into a single, powerful system for coordinating AI agents, managing workflows, and monitoring cluster performance.
**WHOOSH** is a comprehensive distributed AI orchestration platform that consolidates the best components from our distributed AI development ecosystem into a single, powerful system for coordinating AI agents, managing workflows, and monitoring cluster performance.
## 🎯 What is Hive?
## 🎯 What is WHOOSH?
Hive combines the power of:
WHOOSH combines the power of:
- **🔄 McPlan**: n8n workflow → MCP bridge execution
- **🤖 Distributed AI Development**: Multi-agent coordination and monitoring
- **📊 Real-time Performance Monitoring**: Live metrics and alerting
@@ -18,29 +18,29 @@ Hive combines the power of:
- 8GB+ RAM recommended
- Access to Ollama agents on your network
### 1. Launch Hive
### 1. Launch WHOOSH
```bash
cd /home/tony/AI/projects/hive
./scripts/start_hive.sh
cd /home/tony/AI/projects/whoosh
./scripts/start_whoosh.sh
```
### 2. Access Services
- **🌐 Hive Dashboard**: https://hive.home.deepblack.cloud (port 3001)
- **📡 API Documentation**: https://hive.home.deepblack.cloud/api/docs (port 8087)
- **📊 Grafana Monitoring**: https://hive.home.deepblack.cloud/grafana (admin/hiveadmin) (port 3002)
- **🔍 Prometheus Metrics**: https://hive.home.deepblack.cloud/prometheus (port 9091)
- **🌐 WHOOSH Dashboard**: https://whoosh.home.deepblack.cloud (port 3001)
- **📡 API Documentation**: https://whoosh.home.deepblack.cloud/api/docs (port 8087)
- **📊 Grafana Monitoring**: https://whoosh.home.deepblack.cloud/grafana (admin/whooshadmin) (port 3002)
- **🔍 Prometheus Metrics**: https://whoosh.home.deepblack.cloud/prometheus (port 9091)
- **🗄️ Database**: localhost:5433 (PostgreSQL)
- **🔄 Redis**: localhost:6380
### 3. Default Credentials
- **Grafana**: admin / hiveadmin
- **Database**: hive / hivepass
- **Grafana**: admin / whooshadmin
- **Database**: whoosh / whooshpass
## 🏗️ Architecture Overview
```
┌─────────────────────────────────────────────────────────────────┐
HIVE ORCHESTRATOR │
WHOOSH ORCHESTRATOR │
├─────────────────────────────────────────────────────────────────┤
│ Frontend Dashboard (React + TypeScript) │
│ ├── 🎛️ Agent Management & Monitoring │
@@ -50,7 +50,7 @@ cd /home/tony/AI/projects/hive
│ └── ⚙️ System Configuration & Settings │
├─────────────────────────────────────────────────────────────────┤
│ Backend Services (FastAPI + Python) │
│ ├── 🧠 Hive Coordinator (unified orchestration) │
│ ├── 🧠 WHOOSH Coordinator (unified orchestration) │
│ ├── 🔄 Workflow Engine (n8n + MCP bridge) │
│ ├── 📡 Agent Communication (compressed protocols) │
│ ├── 📈 Performance Monitor (metrics & alerts) │
@@ -114,33 +114,33 @@ cd /home/tony/AI/projects/hive
### Service Management
```bash
# View all service logs
docker service logs hive_hive-backend -f
docker service logs whoosh_whoosh-backend -f
# View specific service logs
docker service logs hive_hive-frontend -f
docker service logs whoosh_whoosh-frontend -f
# Restart services (remove and redeploy)
docker stack rm hive && docker stack deploy -c docker-compose.swarm.yml hive
docker stack rm whoosh && docker stack deploy -c docker-compose.swarm.yml whoosh
# Stop all services
docker stack rm hive
docker stack rm whoosh
# Rebuild and restart
docker build -t registry.home.deepblack.cloud/tony/hive-backend:latest ./backend
docker build -t registry.home.deepblack.cloud/tony/hive-frontend:latest ./frontend
docker stack deploy -c docker-compose.swarm.yml hive
docker build -t registry.home.deepblack.cloud/tony/whoosh-backend:latest ./backend
docker build -t registry.home.deepblack.cloud/tony/whoosh-frontend:latest ./frontend
docker stack deploy -c docker-compose.swarm.yml whoosh
```
### Development
```bash
# Access backend shell
docker exec -it $(docker ps -q -f name=hive_hive-backend) bash
docker exec -it $(docker ps -q -f name=whoosh_whoosh-backend) bash
# Access database
docker exec -it $(docker ps -q -f name=hive_postgres) psql -U hive -d hive
docker exec -it $(docker ps -q -f name=whoosh_postgres) psql -U whoosh -d whoosh
# View Redis data
docker exec -it $(docker ps -q -f name=hive_redis) redis-cli
docker exec -it $(docker ps -q -f name=whoosh_redis) redis-cli
```
### Monitoring
@@ -158,7 +158,7 @@ curl http://localhost:8087/api/metrics
## 📁 Project Structure
```
hive/
whoosh/
├── 📋 PROJECT_PLAN.md # Comprehensive project plan
├── 🏗️ ARCHITECTURE.md # Technical architecture details
├── 🚀 README.md # This file
@@ -181,13 +181,13 @@ hive/
│ └── package.json # Node.js dependencies
├── config/ # Configuration files
│ ├── hive.yaml # Main Hive configuration
│ ├── whoosh.yaml # Main WHOOSH configuration
│ ├── agents/ # Agent-specific configs
│ ├── workflows/ # Workflow templates
│ └── monitoring/ # Monitoring configs
└── scripts/ # Utility scripts
├── start_hive.sh # Main startup script
├── start_whoosh.sh # Main startup script
└── migrate_from_existing.py # Migration script
```
@@ -201,17 +201,17 @@ cp .env.example .env
```
Key environment variables:
- `CORS_ORIGINS`: Allowed CORS origins (default: https://hive.home.deepblack.cloud)
- `CORS_ORIGINS`: Allowed CORS origins (default: https://whoosh.home.deepblack.cloud)
- `DATABASE_URL`: PostgreSQL connection string
- `REDIS_URL`: Redis connection string
- `ENVIRONMENT`: Environment mode (development/production)
- `LOG_LEVEL`: Logging level (debug/info/warning/error)
### Agent Configuration
Edit `config/hive.yaml` to add or modify agents:
Edit `config/whoosh.yaml` to add or modify agents:
```yaml
hive:
whoosh:
agents:
my_new_agent:
name: "My New Agent"
@@ -248,7 +248,7 @@ templates:
- **Task Distribution**: Queue length, assignment efficiency
### Grafana Dashboards
- **Hive Overview**: Cluster-wide metrics and status
- **WHOOSH Overview**: Cluster-wide metrics and status
- **Agent Performance**: Individual agent details
- **Workflow Analytics**: Execution trends and patterns
- **System Health**: Infrastructure monitoring
@@ -261,7 +261,7 @@ templates:
## 🔮 Migration from Existing Projects
Hive was created by consolidating these existing projects:
WHOOSH was created by consolidating these existing projects:
### ✅ Migrated Components
- **distributed-ai-dev**: Agent coordination and monitoring
@@ -305,7 +305,7 @@ Hive was created by consolidating these existing projects:
### Development Setup
1. Fork the repository
2. Set up development environment: `./scripts/start_hive.sh`
2. Set up development environment: `./scripts/start_whoosh.sh`
3. Make your changes
4. Test thoroughly
5. Submit a pull request
@@ -324,19 +324,19 @@ Hive was created by consolidating these existing projects:
- **🔧 API Docs**: http://localhost:8087/docs (when running)
### Troubleshooting
- **Logs**: `docker service logs hive_hive-backend -f`
- **Logs**: `docker service logs whoosh_whoosh-backend -f`
- **Health Check**: `curl http://localhost:8087/health`
- **Agent Status**: Check Hive dashboard at https://hive.home.deepblack.cloud
- **Agent Status**: Check WHOOSH dashboard at https://whoosh.home.deepblack.cloud
---
## 🎉 Welcome to Hive!
## 🎉 Welcome to WHOOSH!
**Hive represents the culmination of our distributed AI development efforts**, providing a unified, scalable, and user-friendly platform for coordinating AI agents, managing workflows, and monitoring performance across our entire infrastructure.
**WHOOSH represents the culmination of our distributed AI development efforts**, providing a unified, scalable, and user-friendly platform for coordinating AI agents, managing workflows, and monitoring performance across our entire infrastructure.
🐝 *"Individual agents are strong, but the Hive is unstoppable."*
🐝 *"Individual agents are strong, but the WHOOSH is unstoppable."*
**Ready to experience the future of distributed AI development?**
```bash
./scripts/start_hive.sh
./scripts/start_whoosh.sh
```