Lenny Rachitsky argues that AI models sitting idle overnight and weekends represent wasted potential. He describes experiments with a system called Goose that lets models work autonomously for hours, building multiple experiment variations overnight so teams wake up to completed attempts instead of minutes of processing.
Chapters
All these LLMs are sitting idle overnight and on weekends while humans aren't there. Like, there's no need for that. They should be working all the time. They should be trying to build in anticipation of what we want. I think that we're going to see much more autonomy. We're working on a couple of experiments with Goose where we're really trying to push it to work. Not just for two or three or five minutes at a time. We're trying to push it to hours. They should be able to build in ways that were never possible before. We had limited resources, limited bandwidth, and a lot of coordination overhead. So we would have to choose the best path to try in an experiment. I don't think we need that anymore. We need instead to be able to describe multiple different experiments in a great amount of detail. Maybe we go to sleep and then in the morning all those experiments are built and we can sort of throw away five or six of them.