Event language
UI language
<p>In this engaging 25-minute talk, we delve into the world of large language models (LLMs) specifically designed for source code. We highlight the importance of open-source models for safeguarding privacy, and provide a comprehensive overview of the current state of the art in LLMs.</p><p>We then introduce SantaCoder, an open-source LLM for code generation, and demonstrate how it can be fine-tuned for the downstream task of bug fixing, resulting in the SantaFixer model. Trained on a dataset of single-line Common Vulnerabilities and Exposures (CVE) fixes, SantaFixer can generate bug fixes using code inlining.</p><p>But that's not all! We unveil an exciting new open-source tool called AutoFix, which combines static analysis with LLM capabilities to automatically detect and fix software vulnerabilities. We showcase the capabilities of AutoFix in action, highlighting its potential to improve overall code quality.</p><p>Best of all, SantaFixer and AutoFix are both released under the Apache license, making them accessible to the wider open-source community. Join us as we explore the cutting-edge world of open-source LLMs and their transformative impact on the future of software development.</p>
