Wall Street Journal (December 23)
“New data released Tuesday showed that the unemployment rate has risen from 4% when President Trump took office to 4.6% in November. A sizable drift like that isn’t a good political omen, but it also isn’t rare.”
Fortune (July 19)
“Over just a few months, ChatGPT went from correctly answering a simple math problem 98% of the time to just 2%.” This doesn’t necessarily show later versions are inferior as they might perform better on other tasks. The study which uncovered this does prove the existence of “wild fluctuations—called drift—in the technology’s ability to perform certain tasks.” Drift may arise from the rather “unpredictable effects of changes in one part of the model on others.”
Tags: 2%, 98%, Changes, ChatGPT, Drift, Fluctuations, Inferior, Model, Problem, Simple math, Study, Tasks, Technology, Unpredictable
