Tessera
Folgen

Ilya (Marshal)

@marshal.dev

Software Engineer 🐍 The AT Protocol SDK for Python: https://atproto.blue/ 🍿 Custom Feed in Python: https://github.com/MarshalX/bluesky-feed-generator 🏎️ Fast IPLD library for Python: https://github.com/MarshalX/python-libipld https://marshal.dev

430 Posts4875 Follower158 Folgt
Ilya (Marshal)@marshal.dev · 8mo ago

Bluesky custom feeds in Python are now ~x2 faster! ~25-35% faster DAG-CBOR decoding, and ~17% faster CID decoding! I do have more ideas on what to try to speed it up even further! For example, applying BOLT on top of the existing PGO. Huge kudos to @vmx.cx for making this happen!

Release v3.3.0 · MarshalX/python-libipld

🟢 The maintainer is looking for a job! CV: https://marshal.dev What's Changed ❗ Almost x2 speed for CAR decoding (Bluesky firehose), ~25-35% faster DAG-CBOR decoding, and ~17% faster CID decoding! ...

github.com

Ilya (Marshal)@marshal.dev · 10mo ago

The atproto SDK for Python now supports Python 3.14! Please report any instability of firehose async client. There are too many dependency bumps for this release.

Ilya (Marshal)@marshal.dev · last yr.

🚀 Python atproto SDK v0.0.60 is here! Key additions: - Message reactions in DMs - Improved AtUri core class - ⁠Content-Type overriding - Digits in NSID - Email 2FA support - Enhanced HTTPX config and various fixes! Check it out! 🐍✨ #Python #atproto

Release v0.0.60 · MarshalX/atproto

What's Changed Add message reaction to the example of Direct Messages by @MarshalX in #595 Add UnknownUnionModel type by @MarshalX in #586 Add include_pins argument to get_author_feed method of Cl...

github.com

Jer@jeremie.com · 2y ago

Fun little winter break side project to help me explore more of atproto - I made a fun Bluesky - IRC bridge! github.com/quartzjer/AT... Built in python using @marshal.dev's awesome atproto module, definitely spent too much time fiddling with how to display rich/media posts in an IRC-friendly way 😅

Ilya (Marshal)@marshal.dev · 2y ago

The fix was merged! But it does not resolve the main problem. So to be continued here github.com/bluesky-soci...

Relay: consumers do not receive root block in case of too big seq commit · Issue #780 · bluesky-social/indigo

From bluesky-social/atproto#2893

github.com

Ilya (Marshal)@marshal.dev · 2y ago

Firehose consumers do not receive root block in case of too big seq commit. I dug into this because I got reports from Python SDK users that commit.blocks received from the firehose message frame could be missed. I am waiting for the review by #atproto team github.com/bluesky-soci... 🙃

Ilya (Marshal)@marshal.dev · 2y ago

Today's Python SDK incident with segfault comes from Firehose raises the priority of the proper bugfix 🫠 github.com/MarshalX/atp... tl;dr no recursion limit; malformed payloads in the network could lead to segfaults of python-libipld (rust binding)

Segmentation fault (core dumped) in CAR reading from Firehose · Issue #437 · MarshalX/atproto

i was consuming data from the firehouse, specifically at cursor: 3720770000, every time i get a consistent Core Dumped I managed to find the crash is coming from: .venv/lib/python3.12/site-packages...

github.com

Ilya (Marshal)@marshal.dev · 2y ago

Firehose consumers do not receive root block in case of too big seq commit. I dug into this because I got reports from Python SDK users that commit.blocks received from the firehose message frame could be missed. I am waiting for the review by #atproto team github.com/bluesky-soci... 🙃

Firehose consumers do not receive root block in case of too big seq commit · Issue #2893 · bluesky-social/atproto

Describe the bug Firehose consumers do not receive root block in case of too big seq commit. To Reproduce I wrote a corresponding unit test in the linked PR that reproduces the issue Actual behavio...

github.com

Ilya (Marshal)@marshal.dev · 2y ago

If the official instances are presented, I think it would be good for the Python SDK to adopt Jetstream as well. We do not struggle with CPU thanks to native bindings, but network bandwidth is crucial

Jaz@jaz.sh · 2y ago

The current public Jetstream instance has been running with `zstd` compression support for ~14 hours now, checking in on performance. The instance supports ~12 consumers right now with varying filters, but that fluctuates throughout the day. All consumers are currently caught up with live.

Grafana screenshot of the Jetstream dash showing consumer throughput, CPU utilization, RAM utilization, disk and network util. CPU is sitting under 200ms/sec of util, RAM is floating around 100MiB, disk is around 14GiB, and net is using 12.5mbps down and 5.5mbps up.
Bluesky@bsky.app · 2y ago

Now available: DMs! Start a private conversation with a friend directly on Bluesky within the Chat tab. 💬 Update to the latest version of the app (1.83) or refresh on desktop to start chatting!

Screenshot of the DM interface in the Bluesky app. One message says “heyyy,” formatted in a blue bubble. The response is the monkey covering eyes emoji in a gray bubble.
Ilya (Marshal)@marshal.dev · 2y ago

Python IPLD lib. Thanks to PGO and new Bound API in pyo3 v0.21 I achieved huge performance boost ones again! The pyo3 team did an awesome work! Many thanks to all contributors! Also, I implemented own CAR reader github.com/MarshalX/pyt... #atdev #python #pyo3

Release v1.2.3 · MarshalX/python-libipld

What's Changed Thanks to PGO and new Bound API in pyo3 v0.21 I achieved huge performance boost ones again! The pyo3 team did an awesome work! Many thanks to all contributors! Also, I implemented ow...

github.com

Ilya (Marshal)@marshal.dev · 2y ago

🦋 My Open Source project received the initial AT Protocol Grant! (1/6) Bluesky PBC extended the grant to me and my project AT Protocol Python SDK. This project began last spring intending to offer a well-documented, fully-featured, and modern SDK for working with atproto and BlueSky in Python.