Karpathy at Anthropic changes the signal for where serious AI automation research is heading. I work with small business owners on practical AI for business every week, and this foundational work upstream shapes what becomes usable six months from now. Do you think this accelerates or widens the gap between enterprise AI and small business AI?
In my honest opinion, this sort of widens the gap for sure. It will always be hard to do foundational-level models pre-training due to the computational requirements.
Now, if labs keep on sharing their pretrained models, small businesses can still do alignment + SFT on these, getting up to speed, and that is what will bring value to small businesses, not pretraining.
Karpathy at Anthropic changes the signal for where serious AI automation research is heading. I work with small business owners on practical AI for business every week, and this foundational work upstream shapes what becomes usable six months from now. Do you think this accelerates or widens the gap between enterprise AI and small business AI?
In my honest opinion, this sort of widens the gap for sure. It will always be hard to do foundational-level models pre-training due to the computational requirements.
Now, if labs keep on sharing their pretrained models, small businesses can still do alignment + SFT on these, getting up to speed, and that is what will bring value to small businesses, not pretraining.