Ksenia Se

@kseniase.bsky.social

Writing TuringPost.com, learning and educating about machine learning and AI. Working on a book about Citizen Diplomacy. Living in the woods. Also - being mom to four boys and one baby girl 🤘🏻

The most important features of LFMs (Liquid Foundation Models) from Liquid AI? Memory-efficiency, inference speed, without compromising model quality. LFMs have been benchmarked on real hardware, proving that they can beat Transformers. Liquid AI have also just released Hyena Edge👇

Bild

Top 7 research papers of the week: ▪️ Test-Time Reinforcement Learning ▪️ LLMs are Greedy Agents ▪️ Paper2Code ▪️ Efficient Pretraining Length Scaling ▪️ The Sparse Frontier ▪️ Roll the dice & look before you leap ▪️ Discovering and Analyzing Values in Real-World Language Model Interactions 🧵

BildBildBild

9 notable AI models of the week: ▪️ Hyena Edge ▪️ Tina: Tiny Reasoning Models via LoRA ▪️ Kimi-Audio ▪️ Aimo-2 winning solution ▪️ Eagle 2.5 ▪️ Trillion-7B ▪️ Surya OCR ▪️ ThinkPRM ▪️ Skywork R1V2 🧵

BildBildBild

The freshest AI/ML research of the week My top 10: ▪️ AI for Software Engineering ▪️ Inference-Time Scaling for Reward Modeling ▪️ Inference-Time Scaling for Complex Tasks ▪️ Open-Reasoner-Zero ▪️ SynWorld ▪️ Agent S2 ▪️ KnowSelf ▪️ ZClip ▪️ MegaScale-Infer ▪️ Scaling Laws in Scientific Discovery 🧵

BildBildBildBild

9 types of AI inference 5 types based on how the model reasons: ▪️ Probabilistic ▪️ Rule-based ▪️ Logical ▪️ Abductive ▪️ Fuzzy 4 inference types based on its execution contexts: ▪️ Batch ▪️ Real-time ▪️ Edge ▪️ Cloud Save the list and check this out for useful resources: huggingface.co/posts/Ksenia...

Bild

A free short AGI safety course from @GoogleDeepMind It covers important topics, such as: - Path to advanced AI capabilities - Sources of misalignment risk - Technical approaches: safe design patterns, oversight, robust training, etc. - AI governance - Testing and evaluating AI failures Watch 👇

Google DeepMind AGI Safety Course - YouTube

A short course from Google DeepMind on AGI safety, covering alignment problems we can expect as AI capabilities advance, and our current approach to these pr...

youtube.com

9 Multimodal Chain-of-Thought methods ▪️ KAM-CoT ▪️ Multimodal Visualization-of-Thought (MVoT) ▪️ Compositional CoT ▪️ URSA ▪️ MM-Verify ▪️ Duty-Distinct CoT ▪️ Multimodal-CoT ▪️ Graph-of-Thought ▪️ Hypergraph-of-Thought Save the list, and check this out for more info: huggingface.co/posts/Ksenia...

Bild

Humans as tools? Is it real? Yes, sometimes human is just another callable function in an AI agent's toolbox. ▪️ Human in the loop (HITL) is a design pattern, where humans are built into the decision loop to: - validate outputs - steer actions - override the machine when necessary 🧵

Bild

What is Slim Attention? It's a new attention mechanism that allows models to be 2x faster and cut memory use by 32 times! ▪️ What's the secret? It uses the same math as Multi-Head Attention (MHA) but applies one clever trick🧵

Bild

Because of DeepSeek, Qwen models are a little overlooked but they are worth your attention. It's very interesting how new Qwen2.5-Omni truly expands multimodality to a full pack — text, images, audio, and video. Its main focus is speech generation, and it uses a treasure trove of power features 👇

Bild

Do LLMs "know" more facts deep inside their systems than they actually "say"? Researchers from Technion and Google Research defined what this "knowing" means and also explored it and found that: LLMs often know more than they say but getting them to "say" it can be surprisingly hard Key findings🧵

Bild

The freshest AI/ML research of the week: Our top 2 ▪️ Xattention ▪️ Inside-Out: Hidden Factual Knowledge in LLMs ▪️ Rwkv-7 "Goose" ▪️ ϕ-Decoding ▪️ Frac-connections ▪️ DAPO ▪️ Reinforcement learning for reasoning in small LLMs ▪️ MetaLadder ▪️ Why do multi-agent LLM systems fail? 🧵

BildBildBild

What is Qwen-Agent framework? It's a full‑fledged agentic ecosystem that lets Qwen models autonomously plan, call functions, and execute complex, multi‑step tasks right out of the box. Here are examples of Qwen-Agent's applications:

Bild

As I see, image generation is evolving with high speed, but we need tech advancements which improve quality without complexity. In a new study, @drfeifei.bsky.social along with other researchers introduced FlowMo, which rethinks how tokenizers are built. Here's what makes it different:

BildBild

MCP by @anthropic.com vs OpenAI Agents Platform Two giants, OpenAI and AnthropicAI, are accelerating and taking very different paths to agentic AI ▪️Anthropic is focused on standardization with MCP. This open approach creates a universal standard for connecting AI models to external tools. ...

Bild

A new RL algorithm! DAPO (Decoupled Clip and Dynamic Sampling Policy Optimization) from ByteDance is a fully open-source RL system, that improves training in long CoT. It achieves 50 points on AIME 2024, surpassing DeepSeek-R1-Zero, using only half the training steps. What are its key features?

Bild

What is Model Context Protocol (MCP), and how do you get started with it? MCP from @anthropicai.bsky.social is an open standard designed to bridge AI assistants with the data and tools​, and to plug in many different sources of context. MCP is seen as the missing puzzle piece for AI agents 👇

Bild

How does Multi-Head Latent Attention (MLA) reduce memory use? MLA is like zipping and unzipping stored data to save memory. It compresses the key-value (KV) cache into a much smaller form using low-rank key-value joint compression. Here's how MLA works:

Bild