Silicon Valley is now reckoning with a technique in AI development that could upend the leaderboard. Distillation is the idea that a small team with virtually no resources can make an advanced AI model by extracting knowledge from a larger one.
Source: Youtube
