eugene Wu

Steering Semantic Data Processing With DocWrangler

Unstructured text has long been difficult to analyze automatically at scale. Large language models (LLMs) now make it possible to perform “semantic data processing,” where common data operators like map, reduce, and filter are powered by LLMs instead of traditional code. However, building these pipelines is challengin…