Tag: MIT CSAIL
-
Understanding the visual knowledge of language models
Youโve likely heard that a picture is worth a thousand words, but can a large language model (LLM) get the picture if itโs never seen images before? As it turns out, language models that are trained purely on text have a solid understanding of the visual world. They can write image-rendering code to generate complex…
-
New algorithm discovers language just by watching videos
Mark Hamilton, an MIT PhD student in electrical engineering and computer science and affiliate of MIT’s Computer Science and Artificial Intelligence Laboratory (CSAIL), wants to use machines to understand how animals communicate. To do that, he set out first to create a system that can learn human language โfrom scratch.โ โFunny enough, the key moment…
-
Controlled diffusion model can change material properties in images
Researchers from the MIT Computer Science and Artificial Intelligence Laboratory (CSAIL) and Google Research may have just performed digital sorcery โ in the form of a diffusion model that can change the material properties of objects in images. Dubbed Alchemist, the system allows users to alter four attributes of both real and AI-generated pictures: roughness,…
-
Using ideas from game theory to improve the reliability of language models
Imagine you and a friend are playing a game where your goal is to communicate secret messages to each other using only cryptic sentences. Your friend’s job is to guess the secret message behind your sentences. Sometimes, you give clues directly, and other times, your friend has to guess the message by asking yes-or-no questions…
-
Creating bespoke programming languages for efficient visual AI systems
A single photograph offers glimpses into the creatorโs world โ their interests and feelings about a subject or space. But what about creators behind the technologies that help to make those images possible?ย MIT Department of Electrical Engineering and Computer Science Associate Professor Jonathan Ragan-Kelley is one such person, who has designed everything from tools…
-
Natural language boosts LLM performance in coding, planning, and robotics
Large language models (LLMs) are becoming increasingly useful for programming and robotics tasks, but for more complicated reasoning problems, the gap between these systems and humans looms large. Without the ability to learn new concepts like humans do, these systems fail to form good abstractions โ essentially, high-level representations of complex concepts that skip less-important…
-
Julie Shah named head of the Department of Aeronautics and Astronautics
Julie Shah โ04, SM โ06, PhD โ11, the H.N. Slater Professor in Aeronautics and Astronautics, has been named the new head of the Department of Aeronautics and Astronautics (AeroAstro), effective May 1. โJulie brings an exceptional record of visionary and interdisciplinary leadership to this role. She has made substantial technical contributions in the field of…
-
Mapping the brain pathways of visual memorability
For nearly a decade, a team of MIT Computer Science and Artificial Intelligence Laboratory (CSAIL) researchers have been seeking to uncover why certain images persist in a people’s minds, while many others fade. To do this, they set out to map the spatio-temporal brain dynamics involved in recognizing a visual image. And now for the…
-
A crossroads for computing at MIT
On Vassar Street, in the heart of MITโs campus, the MIT Stephen A. Schwarzman College of Computing recently opened the doors to its new headquarters in Building 45. The buildingโs central location and welcoming design will help form a new cluster of connectivity at MIT and enable the space to have a multifaceted role.ย โThe…
-
Researchers create โThe Consensus Gameโ to elevate AIโs text comprehension and generation skills
Imagine you and a friend are playing a game where your goal is to communicate secret messages to each other using only cryptic sentences. Your friend’s job is to guess the secret message behind your sentences. Sometimes, you give clues directly, and other times, your friend has to guess the message by asking yes-or-no questions…