Jude Lim

What Lies Beneath? Exploring the Impact of Underlying AI Model Updates in AI-Infused Systems

AI models are constantly evolving, with new versions released frequently. Human-AI interaction guidelines encourage notifying users about changes in model capabilities, ideally supported by thorough benchmarking. However, as AI systems integrate into domain-specific workflows, exhaustive benchmarking can become imprac…