Apply Composer changes: comprehensive API updates, migrations, middleware, and infrastructure improvements

- Add comprehensive database migrations (001-024) for schema evolution - Enhance API schema with expanded type definitions and resolvers - Add new middleware: audit logging, rate limiting, MFA enforcement, security, tenant auth - Implement new services: AI optimization, billing, blockchain, compliance, marketplace - Add adapter layer for cloud integrations (Cloudflare, Kubernetes, Proxmox, storage) - Update Crossplane provider with enhanced VM management capabilities - Add comprehensive test suite for API endpoints and services - Update frontend components with improved GraphQL subscriptions and real-time updates - Enhance security configurations and headers (CSP, CORS, etc.) - Update documentation and configuration files - Add new CI/CD workflows and validation scripts - Implement design system improvements and UI enhancements
2025-12-12 18:01:35 -08:00
parent e01131efaf
commit 9daf1fd378
968 changed files with 160890 additions and 1092 deletions
--- a/infrastructure/proxmox/README.md
+++ b/infrastructure/proxmox/README.md
@@ -0,0 +1,229 @@
+# Proxmox VE Management
+
+Comprehensive management tools and integrations for Proxmox VE virtualization infrastructure.
+
+## Overview
+
+This directory contains management components for Proxmox VE clusters deployed across Sankofa Phoenix edge sites. It complements the existing Crossplane provider (`crossplane-provider-proxmox/`) with additional tooling for operations, monitoring, and automation.
+
+## Components
+
+### API Client (`api/`)
+
+Proxmox API client utilities and helpers for:
+- Cluster operations
+- Storage management
+- Network configuration
+- Backup operations
+- Node management
+
+### Terraform (`terraform/`)
+
+Terraform modules for:
+- Proxmox cluster provisioning
+- Storage pool configuration
+- Network bridge setup
+- Resource pool management
+
+### Ansible (`ansible/`)
+
+Ansible roles and playbooks for:
+- Cluster deployment
+- Node configuration
+- Storage setup
+- Network configuration
+- Monitoring agent installation
+
+### Scripts (`scripts/`)
+
+Management scripts for:
+- Cluster health checks
+- Backup automation
+- Disaster recovery
+- Performance tuning
+- Maintenance operations
+
+## Integration with Crossplane Provider
+
+The Proxmox management components work alongside the Crossplane provider:
+
+- **Crossplane Provider**: Declarative VM management via Kubernetes
+- **Management Tools**: Operational tasks, monitoring, and automation
+- **API Client**: Direct Proxmox API access for advanced operations
+
+## Usage
+
+### Cluster Setup
+
+```bash
+# Setup a new Proxmox cluster
+./scripts/setup-cluster.sh \
+  --site us-east-1 \
+  --nodes pve1,pve2,pve3 \
+  --storage local-lvm \
+  --network vmbr0
+```
+
+### Storage Management
+
+```bash
+# Add storage pool
+./scripts/add-storage.sh \
+  --pool ceph-storage \
+  --type ceph \
+  --nodes pve1,pve2,pve3
+```
+
+### Network Configuration
+
+```bash
+# Configure network bridge
+./scripts/configure-network.sh \
+  --bridge vmbr1 \
+  --vlan 100 \
+  --nodes pve1,pve2,pve3
+```
+
+### Ansible Deployment
+
+```bash
+# Deploy Proxmox configuration
+cd ansible
+ansible-playbook -i inventory.yml site-deployment.yml \
+  -e site=us-east-1 \
+  -e nodes="pve1,pve2,pve3"
+```
+
+### Terraform
+
+```bash
+# Provision Proxmox infrastructure
+cd terraform
+terraform init
+terraform plan -var="site=us-east-1"
+terraform apply
+```
+
+## Configuration
+
+### Site Configuration
+
+Each Proxmox site requires configuration:
+
+```yaml
+site: us-east-1
+nodes:
+  - name: pve1
+    ip: 10.1.0.10
+    role: master
+  - name: pve2
+    ip: 10.1.0.11
+    role: worker
+  - name: pve3
+    ip: 10.1.0.12
+    role: worker
+storage:
+  pools:
+    - name: local-lvm
+      type: lvm
+    - name: ceph-storage
+      type: ceph
+networks:
+  bridges:
+    - name: vmbr0
+      type: bridge
+      vlan: untagged
+    - name: vmbr1
+      type: bridge
+      vlan: 100
+```
+
+### API Authentication
+
+Proxmox API authentication via tokens:
+
+```bash
+# Create API token
+export PROXMOX_API_URL=https://pve1.sankofa.nexus:8006
+export PROXMOX_API_TOKEN=root@pam!token-name=abc123def456
+```
+
+## Monitoring
+
+Proxmox monitoring integrates with the Prometheus stack:
+
+- **pve_exporter**: Prometheus metrics exporter
+- **Grafana Dashboards**: Pre-built dashboards for Proxmox
+- **Alerts**: Alert rules for cluster health
+
+See [Monitoring](../monitoring/README.md) for details.
+
+## Backup and Recovery
+
+### Automated Backups
+
+```bash
+# Configure backup schedule
+./scripts/configure-backups.sh \
+  --schedule "0 2 * * *" \
+  --retention 30 \
+  --storage backup-storage
+```
+
+### Disaster Recovery
+
+```bash
+# Restore from backup
+./scripts/restore-backup.sh \
+  --backup backup-20240101 \
+  --target pve1
+```
+
+## Multi-Site Management
+
+For managing multiple Proxmox sites:
+
+```bash
+# List all sites
+./scripts/list-sites.sh
+
+# Get site status
+./scripts/site-status.sh --site us-east-1
+
+# Sync configuration across sites
+./scripts/sync-config.sh --sites us-east-1,eu-west-1
+```
+
+## Security
+
+- API tokens with least privilege
+- TLS/SSL for all API communications
+- Network isolation via VLANs
+- Regular security updates
+- Audit logging
+
+## Troubleshooting
+
+### Common Issues
+
+**Cluster split-brain:**
+```bash
+./scripts/fix-split-brain.sh --site us-east-1
+```
+
+**Storage issues:**
+```bash
+./scripts/diagnose-storage.sh --pool local-lvm
+```
+
+**Network connectivity:**
+```bash
+./scripts/test-network.sh --node pve1
+```
+
+## Related Documentation
+
+- [Crossplane Provider](../../crossplane-provider-proxmox/README.md)
+- [System Architecture](../../docs/system_architecture.md)
+- [Deployment Scripts](../../scripts/README.md)
+