Moritz Schaefer

@moritzbaio.bsky.social

My Bio? AI Bio! Currently in the Bock lab@CeMM talking to single cells with LLMs. Here: paper reviews in 3 lines Mastodon (inactive): @moritzschaefer@qoto.org Twitter: @muronglizi

Just presented our new multimodal histopathology method "SpotWhisperer" at ICML, one of the largest AI conference. SpotWhisperer enables spatially resolved annotation of histopathology images using natural language. We achieved this by "transferring" annotations from transcriptomic data. More soon!

Bild
Christoph Bock Lab @ CeMM & MedUni Vienna@bocklab.bsky.social · last yr.

🔬 Toward histopathology 2.0: spatial transcriptomes inferred from routine diagnostic H&E images + a chat interface for cell-resolution histopathology through English language. (1/6)

I'm hiring: 1. Research associate (wet-lab w/ phd) to generate mpra perturbation data 2. ML postdoc to build multimodal generative AI for DNA (eg diffusion and LLMs) 3. Bioinformatician (any level) to process and harmonize functional genomics data to train foundation models DM me if interested!

"Contextual AI models for single-cell protein biology" 🧪🧬🖥️ - Protein embeddings are powerful. - But: they are usually cell-type agnostic - This paper: Embedding cell-type-aware protein representations via GNNs on scRNA-seq-pruned protein interaction graphs www.nature.com/articles/s41...

Contextual AI models for single-cell protein biology - Nature Methods

PINNACLE is a context-specific geometric deep learning model for generating protein representations. Leveraging single-cell transcriptomics combined with networks of protein–protein interactions, cell...

nature.com

'The primitive endoderm (PrE) supports lineage plasticity to enable regulative development' 🧬️🧪 - PrE is extra-embryonic tissue (at day 4) but can still recreate a full blastocyst (i.e. also embryo) - JAK/STAT supports this plasticity - www.cell.com/cell/abstrac...

The primitive endoderm supports lineage plasticity to enable regulative development

Although generally considered a simple support tissue, extra-embryonic primitive endoderm has the capacity to regenerate a complete blastocyst and continue post-implantation development.

cell.com

"Why is exercise good for you?" - Humans, as hunter-gatherers, evolved to 'always move' - Exercise alters gene expression throughout the body - With exercise, muscles contribute to anti-inflammation through IL-6 production www.nature.com/articles/d41... 🧬🖥️🧪

Why is exercise good for you? Scientists are finding answers in our cells

Decades of evidence shows that exercise leads to healthier, longer lives. Researchers are just starting to work out what it does to cells to reap this reward. Decades of evidence shows that exercise l...

nature.com

I go 90% with the stated opinion about OpenAI etc. Yet, it's a real pity that some arguments needed to be overdrawn. I use GPT-4 daily and find it extremely useful. Also, highly unlikely that LLMs will worsen due to data pollution. One more example of how polarisation wins the attention market..

Post nicht verfügbar.

- A common problem in ML is to generalize to cases unseen during training - Here, GPT- and protein embeddings enable perturbation effect prediction for unseen genes - My take: Great direction and I anticipate more 'embedding arithmetics' (e.g. 'gene1-gene2' for overexpression and KO)

Enhancing generative perturbation models with LLM-informed gene...

Genetic perturbations are key to understanding how genes regulate cell behavior, yet the ability to predict responses to these perturbations remains a significant challenge. While numerous...

openreview.net

The original 'oversquashing' paper is very accessibly written: - In GNNs, when data needs to pass many nodes, the data gets exponentially 'diluted' - Adding a simply fully-connected edge layer, improved upon QM9 by 42% - This foundational and simple concept is only from 3 years ago

On the Bottleneck of Graph Neural Networks and its Practical Implications

Since the proposal of the graph neural network (GNN) by Gori et al. (2005) and Scarselli et al. (2008), one of the major problems in training GNNs was their struggle to propagate information...

arxiv.org

"Cell subtype-specific effects of genetic variation in the Alzheimer’s disease brain" - scRNA-seq 🧬 allows high-throughput variant effect description 🖥️ - Here: brain tissue from 424 individuals, revealing unprecedented number of eQTLs - Analysis mostly promoter-driven. More Hi-C data needed?

Cell subtype-specific effects of genetic variation in the Alzheimer’s disease brain - Nature Genetics

Single-nucleus RNA sequencing from the dorsolateral prefrontal cortex of 424 aging individuals, and mapping the effect of genetic variation on gene expression, identified a large number of cis-express...

nature.com

cos_sim(a, b) = dot(a_norm, b_norm) But is it always better for comparing embeddings? - No: cos_sim may yield arbitrary results - Cause: Model expression flexibility - Remedy: Train with cosine similarity, or normalize dataset *before* embedding learning

Is Cosine-Similarity of Embeddings Really About Similarity?

Cosine-similarity is the cosine of the angle between two vectors, or equivalently the dot product between their normalizations. A popular application is to quantify semantic similarity between...

arxiv.org

Apple's insights to training multimodal (image) LLMs: - LLaVA-like approach (fine-tune LLM on tokenized images) - Image encoder model is key. More information (image feature dimensions and tokens) = better - Augment text-only or image-interleaved documents to prevent deteriorating LLM performance

MM1: Methods, Analysis & Insights from Multimodal LLM Pre-training

In this work, we discuss building performant Multimodal Large Language Models (MLLMs). In particular, we study the importance of various architecture components and data choices. Through careful...

arxiv.org