Projects
A collection of infrastructure projects, platform engineering solutions, and ML systems I've built to solve real-world problems at scale.
Filter by Technology & Domain
Click any label to filter projects
Atlas
A sophisticated LLM traffic and quota management gateway built with Redis, FastAPI, and Prometheus. Enables intelligent model routing, request limiting, and comprehensive observability for AI applications at scale.
Key Features:
- Real-time quota management and rate limiting
- Intelligent model routing based on load and cost
- Comprehensive metrics and monitoring
- High-performance async architecture
Atlas Dashboard
Hyperion Performance Monitor
Hyperion
High-performance ML inference platform with GPU acceleration and intelligent request batching. Achieves 10-50ms inference times with 10x+ throughput improvements through dynamic batching and Kubernetes-native autoscaling.
Key Performance Features:
- GPU acceleration: 10-50ms inference times (10x faster than CPU)
- Intelligent batching: 10x+ throughput with dynamic batch sizes
- Advanced Kubernetes scaling: HPA, VPA, and KEDA support
- Production monitoring: Prometheus metrics and real-time observability
MonitorX
Comprehensive ML/AI infrastructure observability platform with zero-code monitoring, intelligent alerting, and real-time drift detection. Provides complete visibility into production ML systems with enterprise-grade dashboards and automated model health monitoring.
Key Features:
- Real-time model performance monitoring and drift detection
- Intelligent multi-channel alerting with automated remediation
- Interactive dashboards with A/B testing and model comparison
- Cost optimization insights and resource utilization tracking
MonitorX Dashboard
AerialView
Interactive stock market analytics dashboard with real-time visualizations, candlestick charts, and technical indicators powered by Streamlit.
Technology Stack
Technologies and tools I use to build scalable, reliable systems