The cost of cutting-edge: Scaling compute and limiting access
In a year marked by extraordinary advancements in artificial intelligence, largely driven by the evolution of large language models (LLMs), one factor stands out as a universal accelerator: the exponential growth in computational power. Over the last few years, researchers have continuously pushed the boundaries of what a ‘large’ language