Nicolas Barradeau

@nicoptere.bsky.social

freelance senior creative coder working at the intersection of nonsense and fuck-all 2D / 3D / dataviz / ML / AI https://www.barradeau.com ⚠️ AVAILABLE FOR WORK (soon-ish)⚠️

#ARDY running in-browser with ONNX & #WebGPU, no text embedding, only trying to continue a sequence but it keeps producing "acid rave skibidi" moves... must have missed an important feature/setting, anyway I give up. still a great tool to produce motion sequences offline!

Google just open sourced a new parametric human head mesh! Looks like it covers a good range of identity, expressions and head pose components. I've mostly been leaning on ICT and FLAME, but these definitely have their limitations, so a newer option is really grat. github.com/google/GNM/t...

Bild

finally getting somewhere with focus stacking! top is the input microscope footage during a focus change, bottom is the output stacked focus being rebuilt, the last frame retains the sharp details collected during the focus sweep. not perfect but better than nothing :)

tried to improve the videos quality by using an iPhone to capture the scene and it was a disaster, the calibration freaked out because of the static LEGOs in the foreground & the auto focus consistently missed the subject :/ back to the awful microscope quality + CV preprocess

BildBildBildBild

the recent Fable demos I see feel like cheating & I think of Game of Thrones when Balon Greyjoy asks Theon: "did you pay the iron price for it, or the gold? Did you pull it from the neck of a corpse you made or did you buy it to match your fine clothes?" so, Fable users, Iron or Gold?

given the super brittle setup, the micro scans results are not so bad! I used a turntable (360° around the object, in 2D) and never adjusted the focus. the scarab came out well, it lacks views from above. the marbles were killed by refraction and the calibration / lighting need a lot of love

I made an online demo of the WebGL Flex Avatars! it took some work to pack everything so that it can run online but I managed to fit the gaussian model, 10 expressions & the mesh proxy in 16Mo :) I also added Gaussian relighting and shadow casting, audio playback and a webcam to drive the avatar 🔗 👇️

I managed to get FlexAvatar to run fully in browser with ONNX WebGPU ! 🎉 since inference is now rea-ltime, it's running fairly fast (20-40fps) so I added an audio analysis tool to make the various expressions reactive to sound 📢

now working in glorious WebGL !! added the morph target and wasted a lot of time trying to *ahem* _improve_ the avatar generation ; I noticed the tooth & back were poorly reconstructed so my idea was to synthesize and use multiple views to inject them at fitting time, not my finest idea

managed to drive the Flex Avatar GS models with my webcam, also computed custom avatars (created with FLUX KLEIN) and added a feature to compute a 3D avatar from the webcam and it makes me happy :)