Back to Projects
AI & Agents|February 2026
Mandy Control Tower: AI-Native Infrastructure
Mandy Control Tower: AI-Native Infrastructure
The Control Tower is the unified infrastructure management, monitoring, and autonomous orchestration hub for the Mandy ecosystem. It transforms a collection of Docker containers into a self-healing, agent-managed platform.
🌟 Key Capabilities
- Unified Ingress: A single "Front Door" for the Public API, Management Dashboard, and Analytics — with SSL/TLS termination and access control handled centrally.
- Smart Sequential Orchestration: Dependency-aware startup logic for the inference stack, preventing resource contention during initialization.
- Resident Engineer (Agentic SRE): An autonomous agent that monitors system pulse, analyzes logs, and performs corrective actions — using a cloud LLM for fast, lightweight SRE analysis.
- MCP Toolbox: A standards-based Model Context Protocol (MCP) host that dynamically discovers and executes tools for container management and system monitoring.
- Black Box Audit Trail: Every agent decision and system event is logged with full reasoning and snapshots for production auditability.
- Anomaly Detection: Baseline profiling of GPU and system resources enables early detection of service degradation before it becomes an outage.
🛠️ Architecture
The ecosystem is organized into three tiers:
- Infrastructure Tier: Reverse proxy, management API, dashboard UI, and observability (metrics + alerting).
- Application Tier: The RAG engine, task queue, and supporting data services.
- Model Tier: Local inference services and embedding/reranking pipelines.
Status: Internal Tool / Core Infrastructure
Tech Stack
PythonFastAPIStreamlitCaddyPrometheusGrafanaMCPDocker