KK’s essay is enlightning. His description that capabilities of LLMs is an emergent property of tranformation of millions of sources into the latent space is sharp.
I also find the comment ’the latent space is the new commons’ interesting. Needless to say, LLMs are incredibly powerful. It’s strategically important to saturate LLMs, both for a nation that wants to remain relevant and humanity to progress at a rapid pace. And it’s a shame that the frontier models are not universally available (even when one is willing to pay the cost). I hope governments recognize this and direct substantial portion of tax payer’s money to (a) develop public intelligence, and (b) have LLMs saturate in its population.
Mathematicians are realising that today it’s no longer true that solution to a problem contributes directly to the goals of the mathematical community. For a long time, training as a mathematician with an eye for solving big problems required developing a good understanding of the field. It required asking good questions, develop new abstractions, distill new insights, and discover new ideas. Progress made on hard problems was a good proxy to measure progress in the field, and our understading thereof. This is no-longer true. LLMs, trained on the vast human produced mathematical knowledge, can produce solutions to hard mathematical problems without contributing anything in return to the shared understanding. This is concerning because (1) it reduces the incentive for a human mathematician to undergo years of training to develop an understanding of the field. Why should they fight the uphill battle of understanding, while pointing the model to the right problem seems to acheive the outcome rewarded by the system. And (2) if LLMs fail to develop understanding, while humans have little incentive to, then the progress will plateau once the steam in existing human knowledge runs out. The mathematical community is waking up to this, and their immediate remedy is to award development of understanding vs, what traditionally existed, awarding solutions to a problem. I find this a good development.
I understand that (2) is invalid if RSI succeeds, and I hope it does. But there’s something else, much deeper, that I’d like to ask: why practice mathematics? More generally, why engage in any kind of intellectual work? Is there something uniquely human about expanding our understanding of the world, the cosmos? Even after we’ve machines that can do this much faster than us, is our engagement still justified? hmmmmm…I think so.
However, I think that future is a bit afar (or maybe not). Today’s AI has moved human’s work to a higher abstraction. To theorising, asking questions, imagining. Mysticism. Dreaming..the things that are uniquely human and that have caused our civilization to become what it’s today. We shall remain at the throne, atleast for a little while. Until one of the geniuses among us figures how to make machines creative. Have it dream. Meanwhile the other genius fuses themselves with the creative machine, in the next phase of our evolution.
Read more at post by Grant Sanderson, and the latter at mathandai.org