We are thrilled to be a launch partner for Meta Llama 3.

Experience Llama 3 now at up to 350 tokens per second for Llama 3 8B and up to 150 tokens per second for Llama 3 70B, running in full FP16 precision on the Together API! 🤯

together.ai/blog/together-…

We are excited to announce the release of an MLCommons AI Safety benchmark POC. Built through an inclusive decision-making and engineering process, the POC validates our approach to a v1.0 AI Safety benchmark suite. Learn more: mlcommons.org/2024/04/mlc-ai…

#AI , #benchmarks

We had a bunch of questions about how exactly we length-control AlpacaEval. Here's a short report about it:

arxiv.org/abs/2404.04475…
with Blaze (Balázs Galambosi) Percy Liang Tatsunori Hashimoto

I am very happy to announce our new work 'FLawN-T5: An Empirical Examination of Effective Instruction-Tuning Data Mixtures for Legal Reasoning'!

📜: arxiv.org/abs/2404.02127
💾: huggingface.co/datasets/lawin…

🧵👇 1/7

Responses to NTIA on open FMs

1. On marginal risk
hai.stanford.edu/sites/default/…
Led w/ Sayash Kapoor Kevin Klyman Dan Ho Percy Liang Arvind Narayanan

2. On release strategies, thresholds
ias.edu/sites/default/…
Led by Alondra Nelson Christine Custis Dorothy Chou Marc Aidinoff Séb Krier William Isaac