✅ End to end generation of expressive performance *audio* from score *images*! An important step towards seamless interaction with computer music systems and a fun collaboration between Dasaem’s group at Sogang University and my group at CMU

@dasaemjeong.bsky.social · last yr.

🎶Now a neural network can read scanned score image and generate performance audio in end-to-end😎 I'm super excited to introduce our work on Unified Cross-modal translation between Score Image, Symbolic Music, and Audio. Why does it matter and how to make it? Check the thread🧵

At #CHI2025 in Yokohama this week 🌸. My first CHI, excited to finally get to attend! Happy to chat with anyone about human AI interaction for music or programming

Remarkably thorough and crisp as usual. Probably the single best resource for understanding the latents behind generative modeling that power modern gen AI Sander shh 🤫 you’re giving away all of the good research ideas!!

Sander Dieleman@sedielem.bsky.social · 2y ago

New blog post: let's talk about latents! sander.ai/2025/04/15/l...

I have acquired a Disklavier and Piano Genie has been resurrected :) @pcastr.bsky.social Disklavier jam session over the internet soon?

Thrilled to share that my *incoming* PhD student Yewon Kim’s work on multimodal inspiration in music AI has been recognized with a Best Paper Award at #CHI2025 🎉 Yewon really knocked it out of the park here. Can't wait to see what she does for her PhD! arxiv.org/abs/2412.18940

Amuse: Human-AI Collaborative Songwriting with Multimodal Inspirations

Songwriting is often driven by multimodal inspirations, such as imagery, narratives, or existing music, yet songwriters remain unsupported by current music AI systems in incorporating these multimodal...

arxiv.org

Inaugurating new acct to share work from my PhD student! Wayne et al have been running a live eval platform Copilot Arena - a VSCode extension serving code completions from AI systems to real developers. See 🧵 for findings and preprint Excited to be evaluating human-AI *workflows* holistically!

Wayne@waynechi.bsky.social · 2y ago

What do developers 𝘳𝘦𝘢𝘭𝘭𝘺 think of AI coding assistants? In October, we launched Copilot Arena to collect user preferences on real dev workflows. After months of live service, we’re here to share our findings in our recent preprint. Here's what we have learned /🧵