This is part 1 of a two-part post on LLMs and “world models.” Part 2 is here . AI Brittleness in the Before Times In the long-ago times, before large-scale generative AI came on the scene, machine-learning systems had some problems: often they didn’t learn the general concepts we were trying to teach them, but rather solved problems using “shortcuts” or “surface heuristics.” To give one stark example , some researchers tried to train a deep neural network to classify skin lesions in photos like the one below as “benign” or “malignant.” While this network performed well on the kinds of photos it was trained on, the researchers noticed a problem: “[T]he algorithm appeared more likely to interpret images with rulers as malignant. Why? In our dataset, images with […]
Original web page at aiguide.substack.com
