arize-phoenix

@arize-phoenix.bsky.social

Open-Source AI Observability and Evaluation app.phoenix.arize.com

Customizable visualizations of your agent traces are here. Track cache hits, online eval degradations, tool call errors, all in real-time so you can quickly identify problems in production. What does your agent operations center look like?

phoenix is now is an oauth2 authorization server! `px auth login` opens your browser, you get a short-lived user-scoped token. no long-lived api keys. and admins can audit / revoke every cli and mcp grant from one screen. remote mcp server ships in beta too - more on this soon.

Our favorite tools are the ones that have maximum customizability. Last week we added customizable charts, command K, and recent searches. this week we've added custom column ordering. Built to help you have the tables and dashboards you need to monitor agents day in and day out.

Experiment Baselining and Charts When trying to determine if a new model is up to the task, you need to factor in many dimensions. performance - measured by evals latency - is the model fast enough to give you the right UX tokens - how chatty is the model to achieve the result

Agent traces and trajectories are growing increasingly longer and more complex. We've seen some traces 1000s of spans deep. That's why we've added trace search. Search across a trace and the UI will now show you the call stack to the spans you are looking for across workflows and sub-agent calls.

PXI now supports sub-agent streaming so you can inspect the execution of the sub-agents you kick off. We've started moving much the skills and tools available in the main agent into the sub-agents to empower interesting delegation patterns.

PXI (Phoenix Intelligence) now runs in your terminal! You can now use PXI without leaving your terminal. It's the same agent that powers the in-browser experience, now available as an interactive chat in your shell. npm install -g @arizeai/phoenix-cli@latest > pxi

Meet PXI (pronounced "pixie") 🎉 the AI engineering agent we built into Phoenix. Hand it the investigation instead of scrolling through traces by hand, and it works through your telemetry the way a coding agent works through code. The full story of how we built it 👉 arize.com/blog/meet-pxi/

Meet PXI: the AI engineering agent inside Phoenix

PXI is the open-source AI engineering agent built into Phoenix. Hand it a failing trace, an evaluator, or a prompt, and it investigates your telemetry for you.

arize.com

📊 Phoenix 17.7.0 makes your token usage legible. New token detail charts break prompt + completion tokens into their parts, over time: • Prompt → input, cache read, cache write, audio • Completion → output, reasoning, audio