Since April 2026 I combine SRE with building the company’s own AI platform: an LLM inference API served from our own GPU fleet.
- Run the LLM inference platform in production on Kubernetes (vLLM, LiteLLM): model sizing by VRAM and KV-cache, tuning with real metrics and evaluation of new models.
- Build the platform in Go and SvelteKit/Astro: RAG chat, Stripe billing, a referral system, feature flags and a TUI.
- Design the platform’s observability and alerting with VictoriaMetrics, Grafana and VictoriaLogs.
- Own the reliability of production PostgreSQL databases: backups, recovery and performance.
- In parallel, cloud infrastructure for clients on GCP and AWS.