Tag: Self-supervised learning
-
Understanding the visual knowledge of language models
Youโve likely heard that a picture is worth a thousand words, but can a large language model (LLM) get the picture if itโs never seen images before? As it turns out, language models that are trained purely on text have a solid understanding of the visual world. They can write image-rendering code to generate complex…
-
The brain may learn about the world the same way some computational models do
To make our way through the world, our brain must develop an intuitive understanding of the physical world around us, which we then use to interpret sensory information coming into the brain. How does the brain develop that intuitive understanding? Many scientists believe that it may use a process similar to whatโs known as โself-supervised…