Tag: Contrastive Learning
-
Understanding the visual knowledge of language models
Youโve likely heard that a picture is worth a thousand words, but can a large language model (LLM) get the picture if itโs never seen images before? As it turns out, language models that are trained purely on text have a solid understanding of the visual world. They can write image-rendering code to generate complex…
-
New algorithm discovers language just by watching videos
Mark Hamilton, an MIT PhD student in electrical engineering and computer science and affiliate of MIT’s Computer Science and Artificial Intelligence Laboratory (CSAIL), wants to use machines to understand how animals communicate. To do that, he set out first to create a system that can learn human language โfrom scratch.โ โFunny enough, the key moment…
-
Synthetic imagery sets new bar in AI training efficiency
Data is the new soil, and in this fertile new ground, MIT researchers are planting more than just pixels. By using synthetic images to train machine learning models, a team of scientists recently surpassed results obtained from traditional โreal-imageโ training methods.ย At the core of the approach is a system called StableRep, which doesn’t just…