TO: [email protected]
SUBJECT: Happy 83rd!

Today would have been the 83rd birthday of Ray Tomlinson, who sent the first email more than 50 years ago while working at BBN Technologies.

This month in 1980: a Japanese computer scientist published a paper proposing the “Neocognitron,” the neural net that directly inspired CNNs.

Kunihiko Fukushima’s paper: bit.ly/3dPbF0z

Marijuana was the world's first online transaction, between MIT & Stanford students on ARPANET: bit.ly/2lKLSNk

MIT CSAIL Director Daniela Rus TED Talks: How AI will step off the screen and into the real world.

bit.ly/3U8Herv

#otd in 1965 Gordon Moore published his article on cramming more components onto integrated circuits: bit.ly/3xxwdGm

Llama 3 has been my focus since joining the Llama team last summer. Together, we've been tackling challenges across pre-training and human data, pre-training scaling, long context, post-training, and evaluations. It's been a rigorous yet thrilling journey:

🔹Our largest models

Our computer vision textbook is released!

Foundations of Computer Vision
with Antonio Torralba and Bill Freeman
mitpress.mit.edu/9780262048972/…

It’s been in the works for >10 years. Covers everything from linear filters and camera optics to diffusion models and radiance fields.

1/4

JetMoE technical report is out!

The key to train LLaMA2-level LLM with only $0.1M cost:

· 2-phase training strategy
· MoA + MoE

Great work supported by MyShell:
· Fully open-sourced
· No proprietary data / code needed