LLMs as SRE Sidekicks: ChatOps, Runbooks, and Auto-Diagnosis for DevOps Teams FOSSASIA Summit 2026

FOSSASIA Summit 2026 Sunday, 8 March, 2026 9:00 AM (Asia/Bangkok) To Tuesday, 10 March, 2026 7:30 PM (Asia/Bangkok)

Info Featured Schedule Speakers Exhibition

LLMs as SRE Sidekicks: ChatOps, Runbooks, and Auto-Diagnosis for DevOps TeamsIn the relentless world of on-call rotations, SREs and DevOps teams drown in alert storms, scattered logs, and rigid runbooks that lag behind fast-evolving systems. This talk reveals how large language models (LLMs) become tireless SRE sidekicks, ingesting telemetry from tools like Prometheus, Loki, or OpenTelemetry to distill noisy alerts into precise, context-aware insights and remediation steps. Attendees will walk through hands-on integrations: wiring LLMs into ChatOps platforms (Slack, Discord, or Mattermost) for real-time triage; converting static Markdown runbooks into dynamic, queryable copilots that suggest fixes with confidence scores; and deploying agentic workflows for auto-diagnosis using RAG patterns over incident histories.Key Takeaways:<ul><li>Practical LLM Integrations: Code snippets for LangChain or LlamaIndex to parse alerts and generate SLO-aligned responses.</li><li>Guardrails for Safety: Techniques like prompt engineering, human-in-the-loop approvals, and output validation to prevent hallucinated fixes.</li><li>ChatOps Patterns: Building slash commands for "/triage P1 alert" or "/runbook pod-crash" that query your GitOps repo and observability stack.</li><li>Auto-Diagnosis Demos: Live examples reducing MTTR from hours to minutes via vector search over past incidents and auto-generated AARs.</li><li>Tooling Stack: Open-source picks like OpenLLM, Haystack, or vLLM for self-hosted inference, plus ArgoCD/GitOps for deployment safety.</li><li>Metrics That Matter: Real benchmarks on toil reduction (aim for 50%+), alert fatigue drop, and on-call satisfaction scores.</li></ul>Ideal For: SREs, DevOps engineers, and platform teams ready to leverage AI for proactive ops in Kubernetes, cloud-native, or hybrid environments. No PhD required, just bring your API keys and a love for less pager duty.