neighbor ryan

@rbw.sh

Technical Staff @openathena.ai Jersey City Transit / Urbanism: @hudcostreets.org, streetspacnj.org, @bikejc.org, @embankment.org

Exciting news: we have completed our hero run, pre-training Marin 535B-A23B, a mixture of experts model affectionally known as Mochi. Mochi is Marin’s largest model to date, and we estimate that it is the largest live-streamed pre-training run ever

BildBild

We’re excited to share more about our progress post-training our models. Our latest milestone is the release of Marin 67B-A2B “Snowball” v0.1, a mixture of experts model trained on 10 trillion tokens. In this blog post, Ben Feuer explains what we learned from the process:

Post-Training in the Open

We’re excited to share more about our progress post-training our mixture of experts models. Our latest milestone is the release of Marin 67B-A2B “Snowball” v0.1, a mixture of experts model trained...

openathena.ai

A year ago, Marin had one FTE. Recently, the ten-person team launched a 535 billion parameter MoE model. In the Marin 535B-A23B launch note, David Hall @dlwh.bsky.social notes it's going "almost boringly well." Thank you to our colleagues, partners, and advisors for making this possible. bit.ly/535b

Marin 535B-A23B launch note

A look back at Marin's first year at Open Athena and forward at the 535B-A23B hero run, the largest model the team has ever trained.

openathena.ai

@runsascoded.com updated his visualization, showing the efficiency of different modes of transit between NYC-NJ. Lincoln tunnel bus lane is the winner - and it only operates for 3 hrs a day! Investment in private vehicle infrastructure, is not a good use of state or city resources. hbt.hccs.dev

Bild

PATH ridership data, Sept '24: path.hudcostreets.org • Avg weekday: 206,542 rides • Avg weekend: 101,194 rides Sept '24 vs. Sept '19 (pre-COVID): • Weekdays: 69.2% • Weekends: 99.5% Weekend ridership is at pre-COVID levels, despite degraded service. Weekdays continue to set post-COVID highs.

Avg PATH rider per day; Sept '24:
Weekday: 206,543
Weekend: 101,194

Big drop in March 2020, due to COVID, almost to zero. Steady recovery since then.Avg PATH rider per day (vs. 2019), Sept 2024:
Weekends: 99.5%
Weekday: 69.2%

Weekend ridership has recovered to pre-COVID levels though service remains degraded.