Can we harness the emergent capabilities of VLMs to solve robotic manipulation tasks in zero-shot and few-shot manners?

We introduce MOKA, which employs pre-trained VLMs to predict affordances and generate motions through mark-based visual prompting.

moka-manipulation.github.io

Characters can now point hands or any part of held objects at a target, while respecting object grip affordances and body limits.
#GodotEngine #gamedev

new friend Yiğit Toprak came by the studio and I played w a hardware interface he’s been working on that lets you place and manipulate graphics with your hand, learned a lot, he pushed me to think more broadly about the affordances I can explore in my work, v interesting person

Beginning ...'You're team won't learn if you only play games.'

End...'hey how did you get your team to work together so well?'

Freedom to make mistakes, hours of play, in context of the game, using constraints and affordances. A few simple principles of play we lived by.

This is an incredibly simple task constraint (the no 'turtling' rule) that develops more skilful ball handlers in any SSG. This prevents offensive players from turning their back to the defense when pressured, reducing the ability to act on affordances to drive, pass and shoot.

experimenting with normal/hard 'difficulties' for svg-animations.how—liking it so far!

normal difficulty comes with grid lines, syntax-aware guidelines, and autocomplete, while hard mode has no affordances whatsoever

#HTML Popover API lands in Baseline: 'One of the features I am most hyped about has just landed across all modern browsers. Popover provides awesome primitives and developer affordances for building layered interfaces.'  web.dev web.dev/blog/popover-a…

Virtual reality will never be the same as physical reality (and that we'll soon stop trying.) We will simply live life across multiple realities, each with their own physics, bodies, and affordances. Let's start getting used to that.

Our Discord: discord.gg/9u8HrZNp6w

gabe true and real. here you can observe a human using a bitcoin atm to its full affordances

small detail—no scrollbars when autoscrolling

- rendering scrollbar was too noisy
- still retains all scrolling affordances

working on a blogpost on how we used Yjs to construct a p2p CRDT multiplayer platformer space, with collision resolution and projectile (WIP! by Non).

Topology protocol aims to provide such affordances and more plus BFT guarantees and better sync speed

It is with joy, gratitude, and a touch of anxiety that I introduce my book titled Doing Difference Differently: Chinese International Students’ Literacy Practices and Affordances, which will be published by University Press of Colorado Consortium this summer. upcolorado.com/utah-state-uni…

But, at the very least, we have a slight hint of a pony's heritage based on their tribe. Though, with the addition of a thousand years, it's very easy for any pony in modern Equestria to represent pretty much any ethnic background. The lore makes affordances for this.

ARTnews examines 14 works by Mary Cassatt’s the diverse facets of her career, as well as the affordances and constraints of being a female artist in a male-dominated 19th-century art world. artnews.com/list/art-news/…

Come check out our spot manipulation demo at #3DV2024 !🤖

This is enabled by open-vocabulary 3D scene understanding OpenMask3D (openmask3d.github.io) NeurIPS Conference and functional affordances from SceneFun3D (scenefun3d.github.io) #CVPR2024 #CVPR2024 and many more!

Positive experience w/ movement

In a non sport environment or a persistent pain case the key is self efficacy

Gamification - Person finds solutions to movement problems via the coach designing an environment w/ affordances requiring no cueing beyond the task constraints.

What’s affordance ?

* James Gibson wrote about the idea of affordance in 1979. He described affordances as action possibilities in the environment. In 1988 Don Norman modified the idea of affor- dances in his book . He referred to the idea of perceived affordances

#UI #UX

Interested in links between fine motor skills and object affordances? 🧸👶

Going to #CDS2024 Cog Dev Society next week?

Check out my poster! “Infants’ manipulation complexity is influenced by object affordances”

When? Session 3 (Saturday March, 23rd) 1:15pm

the UI melts and shapeshifts before your eyes and around your fingers in real-time, anticipating your intentions before you can even formulate them, inventing novel affordances on the fly, never before seen in any application