Tools

Home Lab Workshop Tools

A Self-Hosted AI & Data Engineering Paradise

Where enterprise-grade technology meets personal innovation

Welcome to My Digital Playground

In my quest to bridge the gap between learning and doing, I’ve built something special – a complete self-hosted infrastructure that rivals enterprise setups, all running on Oracle Cloud Infrastructure. This isn’t just a hobby project; it’s my laboratory for exploring the cutting edge of AI, machine learning, and data engineering.

The Vision Behind the Lab

Philosophy: “Excellence emerges when one masters the tools, timing, methodology, and the wisdom to tackle the impossible.”

This ancient wisdom from Thirukkural guides every architectural decision in my home lab. Each service, each integration, each optimization is carefully chosen to create a production-ready environment where I can experiment, learn, and innovate without limits.

Architecture at a Glance

My home lab represents a complete ecosystem spanning multiple domains with 18+ active services achieving 99.9% uptime.

🤖 COMPLETE SERVICE ECOSYSTEM

AI & MACHINE LEARNING CORE

🔧 Service	🌐 Domain	🎯 Purpose	📊 Status
🦙 Ollama	`ollama.logu.au`	Local LLM Hosting & Inference	✅ LIVE
⚡ Apache Spark	`spark.logu.au`	Distributed ML Processing	❌ DOWN
🌊 Apache Airflow	`airflow.logu.au`	ML Pipeline Orchestration	✅ LIVE
📈 Langfuse	`langfuse.logu.au`	LLM Observability & Tracing	✅ LIVE

Core Capabilities:

Local LLM hosting with Ollama for privacy-first AI experiments
Distributed processing via Apache Spark for large-scale ML workloads
Pipeline orchestration through Apache Airflow for automated workflows
Model observability using Langfuse for production-grade monitoring

📊 DATA ENGINEERING PLATFORM

🔧 Service	🌐 Domain	🎯 Purpose	📊 Status
🔄 Airbyte	`airbyte.logu.au`	Data Integration & ETL	✅ LIVE
🚀 Apache Kafka	`kafka.logu.au`	Real-time Data Streaming	✅ LIVE
💾 MinIO	`minio.logu.au`	Object Storage & Data Lake	✅ LIVE
🔍 Trino	`trino.logu.au`	Distributed Query Engine	❌ DOWN
📊 Metabase	`metabase.logu.au`	Business Intelligence & Analytics	✅ LIVE

Platform Features:

Real-time streaming with Apache Kafka for event-driven architectures
Data lake storage via MinIO for scalable object storage
Query federation through Trino for unified data access
Business intelligence powered by Metabase for actionable insights
ETL/ELT pipelines with Airbyte for seamless data integration

🛠️ INFRASTRUCTURE & OPERATIONS

🔧 Service	🌐 Domain	🎯 Purpose	📊 Status
🔒 Nginx Proxy Manager	`nginx.logu.au`	Reverse Proxy & SSL	✅ LIVE
🏦 HashiCorp Vault	`vault.logu.au`	Secrets Management	✅ LIVE
🐳 Portainer	`portainer.logu.au`	Container Orchestration	✅ LIVE
📈 Grafana	`grafana.logu.au`	Metrics Visualization	✅ LIVE
⚡ Prometheus	`prometheus.logu.au`	Metrics Collection	✅ LIVE
💚 Uptime Kuma	`uptimekuma.logu.au`	Service Health Monitoring	✅ LIVE
📍 Traccar	`traccar.logu.au`	GPS Tracking & Fleet Management	✅ LIVE

Infrastructure Highlights:

Security-first design with HashiCorp Vault for secrets management
Container orchestration via Portainer with automated deployments
Comprehensive monitoring using Grafana and Prometheus stack
SSL termination and reverse proxy through Nginx Proxy Manager
Real-time health monitoring with Uptime Kuma
GPS tracking capabilities via Traccar for location services

🎨 AUTOMATION & MEDIA

🔧 Service	🌐 Domain	🎯 Purpose	📊 Status
🔗 n8n	`n8n.logu.au`	Workflow Automation	✅ LIVE
🎵 Jellyfin	`music.logu.au`	Media Server & Streaming	✅ LIVE

Automation Features:

Automated workflows through n8n for seamless integrations
Media streaming with Jellyfin for entertainment services

🏆 FEATURED PROJECTS: KinAI ECOSYSTEM

Privacy-First AI Applications Suite

Demonstrating end-to-end ML engineering expertise with real-world impact

Portfolio Status: 5 Active Projects | Privacy-First Focus | Microservices Architecture

🏠 SMART HOME & AUTOMATION

🔍 KinAI-Vision – Real-time Activity Detection

🎯 Culturally-aware home automation with YOLOv8 & InsightFace
🏗️ Scalable microservices architecture for privacy-first experiences
🌍 Cultural context awareness for personalized automation

📍 KinAI-GeoPulse – Privacy-First Family Tracking

🔒 Local processing via Traccar Server & FastAPI
📊 Daily movement summaries with intelligent distance calculations
🌐 Real-time geofencing with privacy controls

🏥 HEALTHCARE & FINANCIAL MANAGEMENT

💊 KinAI-CareVault – Secure Health Platform

🧠 Powered by Gemma 3/MedGemma 3 for medical intelligence
📄 Intelligent document processing & family health tracking
🔐 Local workflows ensuring compliance & data sovereignty

🔐 SECURITY & SURVEILLANCE

👁️ KinAI-NexPatrol – AI-Powered Surveillance

🎯 AML-inspired risk scoring with YOLOv8 & InsightFace
🔒 Local processing for enhanced security & privacy
⚡ Precise threat detection algorithms for secure environments

🎓 EDUCATION & LEARNING

📚 KinAI-ScholarKit – Offline Educational AI

🧠 RAG pipeline with FAISS & NetworkX for personalized learning
🔒 Privacy-focused design with comprehensive PDF exports
📖 Curriculum-aligned educational content generation

🗣️ KinAI-Mentor – Voice-Driven AI Tutor

🎙️ Multi-modal interaction with Victorian Curriculum alignment
🔒 Complete privacy with local processing
♿ Inclusive design for diverse learning needs

📊 LAB METRICS & PERFORMANCE

Infrastructure Stats:

Active Services: 15+ Live Services
Uptime: 99.9% Availability
Projects: 18+ Active Projects
Certifications: 7+ Professional Certifications

Service Health Dashboard:

✅ 13 Services Live – Core operations running smoothly
❌ 2 Services Down – Apache Spark & Trino (maintenance mode)
🔄 Continuous Monitoring – Real-time health checks via Uptime Kuma

Why This Matters

This isn’t just about running services – it’s about creating an environment where:

✅ Privacy comes first – All AI processing happens locally
✅ Enterprise patterns are tested and validated
✅ Innovation flows freely – No cloud vendor lock-in
✅ Skills stay sharp – Hands-on experience with production tools
✅ Real-world impact – Solving actual problems for my family
✅ Professional growth – Bridging theory with practical expertise

Built for Learning, Designed for Excellence

Every component in my lab serves dual purposes:

Professional development – Staying current with enterprise technologies
Practical application – Solving real-world problems for my family

This approach ensures that theoretical knowledge translates into practical expertise that I bring to my role as a Machine Learning & GenAI Engineer in banking.

Want the Full Technical Deep Dive?

This is just a glimpse into my digital laboratory. For complete technical specifications, architectural decisions, service configurations, and project details:

📖 Read My Complete GitHub Profile

Discover: