Tag: Antonio Torralba
-
Understanding the visual knowledge of language models
Youโve likely heard that a picture is worth a thousand words, but can a large language model (LLM) get the picture if itโs never seen images before? As it turns out, language models that are trained purely on text have a solid understanding of the visual world. They can write image-rendering code to generate complex…
-
AI agents help explain other AI systems
Explaining the behavior of trained neural networks remains a compelling puzzle, especially as these models grow in size and sophistication. Like other scientific challenges throughout history, reverse-engineering how artificial intelligence systems work requires a substantial amount of experimentation: making hypotheses, intervening on behavior, and even dissecting large networks to examine individual neurons. To date, most…