Sheer Karny

Neural Transparency: Mechanistic Interpretability Interfaces for Anticipating Model Behaviors for Personalized AI

Millions of users now design personalized LLM-based chatbots through system prompts that shape their daily interactions, yet have limited ability to anticipate how these design choices will manifest as behaviors in deployment. This opacity is consequential: seemingly innocuous prompts can trigger excessive sycophancy,…