Speakers

Galina is an experienced and proficient Machine Learning Engineer and AI Consultant who works with impact start-ups, educational institutions, and NGOs. With more than 20 years working in the technology and education sectors, she is committed to lifelong learning and development. She is a Fellow of the Higher Education Academy in the UK, and a co-author of multiple papers in the areas of Learning Analytics and Natural Language Processing. Currently based in Tokyo, Galina is the Lead of the Japan Chapter of Omdena – one of the largest impact platforms in the world, where teams are collaborating to find solutions to global issues with the help of technology and AI.

Evaluating Large Language Models and Ensuring Quality Applications

Evaluating the output of Large Language Models (LLMs) is challenging due to the complex components involved and the multiple dimensions of quality. A thoughtful use of benchmarks, frameworks, metrics and human feedback is essential for ensuring reliable output and an optimal user experience.