Practical Gen AI: Building a Chatbot using Spring AI
YOW! Sydney 2024

Friday Dec 13
13:15 –
14:00
Red Room

Practical Gen AI: Building a Chatbot using Spring AI

In this code-driven talk using Kotlin, Spring Boot and htmx, Rod will show just how good the JVM is as a platform for building Gen AI applications.

He'll show how to use Spring AI to build a chatbot with personality, covering:

  • RAG (Retrieval Augmented Generation) using a VectorStore
  • Why and how to mix different LLMs, including open source LLMs running locally, in the same application
  • How the Spring AI ""advisor"" architecture can be used to create clean, reusable components
  • How to add a toxicity guard and other crosscutting functionality
  • How and why to exchange structured data with LLMs
  • Best practices for building Gen AI applications

He'll share his code on GitHub so attendees can continue their own exploration.