Are LLMs running out of data?

 [[{“value”:”Ilya and many other experts say yes.  I would not dare to disagree with them about AI per se, but I cannot say I am entirely convinced.  Supply is elastic!  That is a time-honored economic truth.  So perhaps the future for traditional scaling is brighter than many of the experts currently are suggesting.  We outsiders
The post Are LLMs running out of data? appeared first on Marginal REVOLUTION.”}]] 

Ilya and many other experts say yes.  I would not dare to disagree with them about AI per se, but I cannot say I am entirely convinced.  Supply is elastic!  That is a time-honored economic truth.  So perhaps the future for traditional scaling is brighter than many of the experts currently are suggesting.  We outsiders don’t know exactly which sources of data have been fed into the current top models, but surely there is plenty left?  And for some price perhaps it can be mobilized.  That is without even getting into data generated by mobile high-quality, life-sampling robots, which admittedly are still some number of years away.

The post Are LLMs running out of data? appeared first on Marginal REVOLUTION.

 Uncategorized 


Comments

Leave a Reply

Your email address will not be published. Required fields are marked *