Keith Curtis(@keithccurtis) 's Twitter Profileg
Keith Curtis

@keithccurtis

Made a book & movie on why we should already have cars that drive us around, and a space elevator. Also, how to fix Big Tech and beat Covid before it ends us.

ID:34715974

linkhttps://keithcu.com/ calendar_today23-04-2009 20:15:29

16,8K Tweets

824 Followers

893 Following

anton(@abacaj) 's Twitter Profile Photo

Some guides
- rentry.org/llm-training
- anyscale.com/blog/fine-tuni…
- asmirnov.xyz/doppelganger
- magazine.sebastianraschka.com/p/practical-ti…

account_circle
Teortaxes▶️(@teortaxesTex) 's Twitter Profile Photo

The ultimate moat is not compute or data but taste
If you are a bad DJ it barely matters what music and equipment you can get your paws on

Mistral team and Teknium (e/λ) are the best DJ Data Mixers I know of

The ultimate moat is not compute or data but taste If you are a bad DJ it barely matters what music and equipment you can get your paws on Mistral team and @Teknium1 are the best DJ Data Mixers I know of
account_circle
Bill Yuchen Lin 🤖️(@billyuchenlin) 's Twitter Profile Photo

Wondering how well a tiny reward model can do?
💡Introducing 𝐏𝐚𝐢𝐫𝐑𝐌 (0.4B)!
🚀It can boost LLM performance by best-of-n sampling (i.e., efficiently re-ranking a diverse set of outputs).
⚖️Also, it's a fast evaluator for comparing different LLMs, so we can better monitor…

Wondering how well a tiny reward model can do? 💡Introducing 𝐏𝐚𝐢𝐫𝐑𝐌 (0.4B)! 🚀It can boost LLM performance by best-of-n sampling (i.e., efficiently re-ranking a diverse set of outputs). ⚖️Also, it's a fast evaluator for comparing different LLMs, so we can better monitor…
account_circle
Robert Burke(@robertburke84) 's Twitter Profile Photo

People don’t realise how extreme Ireland’s hate speech bill is. Up to 12 months in prison for refusing to give password to your devices if suspected of committing hate speech. 12 months for refusing to allow the State read messages between you and your spouse. It’s authoritarian.

account_circle
foundring 🇺🇸(@foundring1) 's Twitter Profile Photo

The pressure to vaccinate my daughter was immense. They acted like vultures and treated me like scum. I held strong. Now she's banned from public/private schools statewide (California) and her doctor was excommunicated for granting her an exemption. Best decision I've ever made💪

The pressure to vaccinate my daughter was immense. They acted like vultures and treated me like scum. I held strong. Now she's banned from public/private schools statewide (California) and her doctor was excommunicated for granting her an exemption. Best decision I've ever made💪
account_circle
Teknium (e/λ)(@Teknium1) 's Twitter Profile Photo

Currently on my list for what to build better datasets around to improve on Hermes 2.5 (in no particular order):
---
Function calling
Dpo dataset
Logic puzzles
Roleplaying
Multiturn Chats
System prompt usefulness
Dataforge expert knowledge & tasks
Internal monologuing
Paradoxes…

account_circle
Beff Jezos — e/acc ⏩(@BasedBeffJezos) 's Twitter Profile Photo

Thiel and Hoffman on funding OpenAI:
'We wanted to have something like a Linux version of AI that was not controlled by any one person or corporation,'

Instead of the Linux of AI we got the Windows equivalent

account_circle
Alex Meshkin, GED(@alexmeshkin) 's Twitter Profile Photo

Cardiovascular disease and impaired immune systems are the permanent damage from a mild acute flu like disease that circulates 3-4x per year and likely to be caught by the average person annually.

account_circle
Daniel Faggella(@danfaggella) 's Twitter Profile Photo

‘Sure there will be AGI, but we humans will be necessary as always.’

No, brother.

In the time we take a breath AGI solves the game of Go and reads every physics text ever written.

Once we boatload it with data, models, and physical robots - we’re a hindrance, not an aide.

account_circle
Bojan Tunguz(@tunguz) 's Twitter Profile Photo

We are rapidly approaching the point where most skills will be commoditized. We are completely unprepared for this reality.

account_circle
jack morris(@jxmnop) 's Twitter Profile Photo

the biden executive order put restrictions on models that:
• contain at least 10^9 parameters
• use more than 10^26 floating-point operations

my future company will get around these restrictions by simply training a 9,999,999 billion param model comprised of 8192-bit floats

account_circle