Hyemin Bang

Abstraction Alignment: Comparing Model-Learned and Human-Encoded Conceptual Relationships

While interpretability methods identify a model’s learned concepts, they overlook the relationships between concepts that make up its abstractions and inform its ability to generalize to new data. To assess whether models’ have learned human-aligned abstractions, we introduce abstraction alignment, a methodology to co…