Pascale Fung(@pascalefung) 's Twitter Profileg
Pascale Fung

@pascalefung

Chair Professor of ECE, Director of the Centre for AI Research (CAiRE), Hong Kong University of Science & Technology. Fellow of AAAI, ACL, IEEE, ISCA.

ID:175319263

linkhttp://pascale.home.ece.ust.hk/ calendar_today06-08-2010 08:02:31

89 Tweets

1,5K Followers

45 Following

Pascale Fung(@pascalefung) 's Twitter Profile Photo

LLMs have learned human values. Ever wonder how value distributions differ between LLMs? Do ChatGPT and Llama have the same values in English, French, etc.? Are Asian values closer to each other than with Western values? Look for the 'value maps'. arxiv.org/abs/2404.07900

account_circle
Pascale Fung(@pascalefung) 's Twitter Profile Photo

Do humans need language for and ? It really depends. We “reasons and plan” a lot of physical and artistic activities without thinking in language (eg dance, swimming, painting, playing an instrument…) but language helps us learn to do them faster.

account_circle
Pascale Fung(@pascalefung) 's Twitter Profile Photo

Do humans need language for and ? It really depends. We “reasons and plan” a lot of physical and artistic activities without thinking in language (eg dance, swimming, painting, playing an instrument…) but language helps us teach/learn how to do them.

account_circle
Pascale Fung(@pascalefung) 's Twitter Profile Photo

Professional cinematographers are looking at new videos from Sora and breathing a sign of relief - there is only so much you can do prompting when you are untrained. Same story with image generators. The beauty and the creativity still need to come from humans prompting.

account_circle
Pascale Fung(@pascalefung) 's Twitter Profile Photo

Google, as well as Meta and OpenAI, among others, have large teams of people dedicated to ethics and responsible AI. There is currently no tractable solution to avoid all errors (can any human claim to be ethically perfect?) but the research community will keep trying.

account_circle
Pascale Fung(@pascalefung) 's Twitter Profile Photo

The problem with these images is due to “alignment tax” - when a model has been trained to align with multiple objectives it becomes hard to balance between them. For example here is an apparent conflict between “diversity” and “faithfulness”. It is a hard optimisation problem.

account_circle
Pascale Fung(@pascalefung) 's Twitter Profile Photo

Got attacked by a man for not citing enough women authors in my keynote on hallucination at showing that alignment tax is not just a problem for GenAI but humans as well. Photo by Francesca Rossi

Got attacked by a man for not citing enough women authors in my keynote on hallucination at #aaai2024 #Realaaai showing that alignment tax is not just a problem for GenAI but humans as well. Photo by @FrancescaRossi_
account_circle
Pascale Fung(@pascalefung) 's Twitter Profile Photo

Can LLM reason? Here are benchmarking results on ChatGPT from Feb 2023. Paper here arxiv.org/pdf/2302.04023… panel

Can LLM reason? Here are benchmarking results on ChatGPT from Feb 2023. Paper here arxiv.org/pdf/2302.04023… #aaai2024 panel
account_circle
Pascale Fung(@pascalefung) 's Twitter Profile Photo

Need a semantic benchmark for Sora and the like. A beautiful and dynamic video of stuff counter to the laws of physics (like that of the shattering glass) is no use. It’s just beautiful hallucination. They must be doing RLHF on Sora now?

account_circle
Pascale Fung(@pascalefung) 's Twitter Profile Photo

Has anyone noticed that has problems with in some of the videos it generated? For example in this one. Also it seems to be trained from video game data???

youtu.be/kHwFMFu9PhA?si…

account_circle
Pascale Fung(@pascalefung) 's Twitter Profile Photo

One of the only podcasts that I have subscribed to. If you want to understand China, give it a listen!

sinica.substack.com

account_circle
Pascale Fung(@pascalefung) 's Twitter Profile Photo

There are many greater achievements than our papers in 2023. Google and Meta are the top 2. (OpenAI doesn’t publish much.) US is number 1 with China at number 2.

account_circle
Pascale Fung(@pascalefung) 's Twitter Profile Photo

A number of us from are among the AI top 100 contributors of 2023 by an automatic metric by Bench Council. HKUST and Tsinghua are the top 2 from China. (This is a metric based on publications and citations, not social media or media influence.)
benchcouncil.org/evaluation/ai/…

account_circle
Pascale Fung(@pascalefung) 's Twitter Profile Photo

should be practiced by every research group big or small. We absolutely need to hold people accountable for the accessibility of their datasets and code and ensure reproducibility before we give out any paper award, if not every publication.

account_circle