Boston Java Users ACM Chapter (formerly NEJUG) | Meetup (original) (raw)

Testing is hard, which is why developers tend to avoid it. Testing non-deterministic things is even harder, which is unfortunate, since we're all writing AI-infused applications, and AI models are notoriously non-deterministic. What happens when the applications start using advanced features, such as RAG, tools, and agents? How do you test these applications? There must be some tools, technologies, and practices out there that can help, while not costing your organization lots of money!

Join Eric as he visits a topic he’s been chasing for well over a year. The AI landscape changes at a breathtaking pace, so what new capabilities and strategies are available?

Hopefully by the end of the presentation you will be able to answer the question "If I change my model/prompt/application, did I get better or worse"?

Speaker:
Eric Deandrea is a Java Champion and Senior Principal Software Engineer at IBM on the Quarkus and LangChain4j engineering teams. With 27+ years of experience, he specializes in designing and building Java-based solutions. Eric contributes to OSS projects including Quarkus, LangChain4j, Spring, Testcontainers, WireMock, and Microcks, and leads the Docling-Java and Quarkus Langfuse projects. He regularly speaks at global conferences and user groups worldwide, and authored “Quarkus for Spring Developers.” Outside work, he enjoys boating in New Hampshire, ice hockey, and holds a black belt in Kempo Karate.