Christopher Nguyen ⽗(@pentagoniac) 's Twitter Profileg
Christopher Nguyen ⽗

@pentagoniac

CEO @aitomatic—Builder, Leader, Professor—ex Panasonic/Google/HKUST/Refugee—https://t.co/cYhm4TOhNk. Industrial Brain Engineering—https://t.co/LlcBWzawTD

ID:11648452

linkhttps://bit.ly/m/ctn calendar_today30-12-2007 03:22:50

15,1K Tweets

4,7K Followers

772 Following

Christopher Nguyen ⽗(@pentagoniac) 's Twitter Profile Photo

AIのウィンブルドン現象 日本の勝ち筋は「産業データ」 本社コメンテーター 中山淳史 - 日本経済新聞

AI Wimbledon phenomenon: Japan’s winning strategy is [to specialize in] “industrial data”.

nikkei.com/article/DGXZQO…

account_circle
Yuchen Jin(@Yuchenj_UW) 's Twitter Profile Photo

martin_casado A theory paper supports this modeling: arxiv.org/abs/2111.02080, “ICL can be viewed as LLMs implicitly performing Bayesian inference”.

account_circle
Christopher Nguyen ⽗(@pentagoniac) 's Twitter Profile Photo

This work is excellent. Note the use of the term “Bayesian inference” and not “Bayesian learning”.

In particular, note that ICL links the prompt with the pretraining distribution via latent concepts. In other words, the distribution is already there, and the prompt merely…

account_circle
Christopher Nguyen ⽗(@pentagoniac) 's Twitter Profile Photo

As a bonus, there should be no confusion that I do not find this behavior “useful”, which is very different a property from that of “novelty/learning”.

x.com/pentagoniac/st…

account_circle
Christopher Nguyen ⽗(@pentagoniac) 's Twitter Profile Photo

Authorities the world over hate social media platforms, regardless of regime.

And it’s not really about the harm to “our children” or to society.

It’s really about how these platforms enable the organization of powerful forces—grassroots or otherwise—that can challenge their…

account_circle
Christopher Nguyen ⽗(@pentagoniac) 's Twitter Profile Photo

👇because any unconstrained running process eventually finds its constraints.

In steady state, everything is the result of an optimization problem. In transient state, everything is traversing through the gradients of an optimization problem.

account_circle
Yann LeCun(@ylecun) 's Twitter Profile Photo

Excellent thread about weird lobbying efforts that paint open source AI foundation models as anti-competitive (somehow!).
Laura Edelson is a Prof at Northeastern and the former Chief Technologist of the Antitrust Division of the Department of Justice.
She knows what she's…

account_circle