Tessera
Folgen

Zarr

@zarr.dev

Chunked, Compressed, & Cloud-native N-dimensional arrays See https://zarr.dev/ for more information.

16 Posts492 Follower16 Folgt
ESIP - Earth Science Information Partners@esipfed.bsky.social · last yr.

♻️ 7/8 - Webinar: Reusable Deep Learning with EOPF Zarr Samples - ESA Copernicus Earth Observation Processor Framework Learn how to reuse a deep learning model originally trained with data from the openEO API of the Copernicus Dataspace Ecosystem (CDSE). #datascience #deeplearning

Welcome! You are invited to join a webinar: Reusable Deep Learning with EOPF Zarr Samples. After registering, you will receive a confirmation email about joining the webinar.

The aim of this webinar is to demonstrate how to reuse a deep learning model originally trained with data from the openEO API of the Copernicus Dataspace Ecosystem (CDSE) with the data and tools provi...

us02web.zoom.us

Zarr@zarr.dev · last yr.

ICYMI: Check out this alternative storage approach for variation data using #Zarr. Rather than grouping all data for a given variant together, its groups all data for a given field, and store as chunked, compressed N-D arrays (tensors). 🤩 doi.org/10.1093/giga...

Analysis-ready VCF at Biobank scale using Zarr

AbstractBackground. Variant Call Format (VCF) is the standard file format for interchanging genetic variation data and associated quality control metrics.

doi.org

Kit Macleod@kitmacleod.bsky.social · last yr.

"The commitment from major entities like Copernicus, USGS, and Google Earth Engine signals a paradigm shift in how we will store, access, and analyze geospatial data in the cloud... #Zarr is poised to become a cornerstone of the cloud-native geospatial ecosystem, unlocking new frontiers..."

Earthmover@earthmover.io · last yr.

4/ The Earthmover team is proud to play a leading role in the Zarr project as this community grows. Read about our takeaways from CNG here: earthmover.io/blog/zarr-ta...

Earthmover@earthmover.io · last yr.

1/ Our team just got back from an inspiring week at the @cloudnativegeo.org conference in Snowbird, Utah, and one thing is clear: 𝐙𝐚𝐫𝐫 𝐚𝐝𝐨𝐩𝐭𝐢𝐨𝐧 𝐢𝐬 𝐬𝐮𝐫𝐠𝐢𝐧𝐠 𝐚𝐜𝐫𝐨𝐬𝐬 𝐠𝐞𝐨𝐬𝐩𝐚𝐭𝐢𝐚𝐥.

Bild
Zarr@zarr.dev · last yr.

🧠 Interested in extending #Zarr? Let us know what you think about ZEP10 "Generic extensions". Current plan is for voting on the proposal mid-June. 📅 github.com/zarr-develop...

ZEP10: Generic extensions (v3.2 spec changes) by joshmoore · Pull Request #344 · zarr-developers/zarr-specs

This is the implementation of ZEP10 which introduces a generic extensions object.         ☝🏽 👉🏽 Rendered ZEP10 page: https://zeps--67.org.readthedocs.build/en/67/draft/ZEP0010.html 🗓️ Proposed...

github.com

Joe Hamman@jhamman.bsky.social · last yr.

Just back from #CNG2025, I wrote up some thoughts on the traction the @zarr.dev format is gaining in the broader geospatial industry (specifically Earth Observation). I also summarize what features and tools the user and developer communities are asking for to fully leverage Zarr. 👇👇👇

Earthmover@earthmover.io · last yr.

1/ Our team just got back from an inspiring week at the @cloudnativegeo.org conference in Snowbird, Utah, and one thing is clear: 𝐙𝐚𝐫𝐫 𝐚𝐝𝐨𝐩𝐭𝐢𝐨𝐧 𝐢𝐬 𝐬𝐮𝐫𝐠𝐢𝐧𝐠 𝐚𝐜𝐫𝐨𝐬𝐬 𝐠𝐞𝐨𝐬𝐩𝐚𝐭𝐢𝐚𝐥.

Ryan Abernathey@rabernat.bsky.social · last yr.

This one was a lot of fun to work on! Why @xarray.bsky.social and @zarr.dev are faster than DuckDB and Parquet for gridded data...from first principles.

Earthmover@earthmover.io · last yr.

⭐ We just released the first post in our Fundamentals series. This one is called 𝐓𝐞𝐧𝐬𝐨𝐫𝐬 𝐯𝐬. 𝐓𝐚𝐛𝐥𝐞𝐬 - 𝐖𝐡𝐲 𝐭𝐚𝐛𝐮𝐥𝐚𝐫 𝐭𝐨𝐨𝐥𝐬 𝐭𝐫𝐢𝐩 𝐨𝐯𝐞𝐫 𝐠𝐫𝐢𝐝𝐝𝐞𝐝 𝐝𝐚𝐭𝐚. earthmover.io/blog/tensors...

Joe Hamman@jhamman.bsky.social · last yr.

🚨 New blog post 🚨 In it, we show off our recent work deploying #icechunk on top of #NASA's existing archives of Earth observation data. The results: 100x speed up when extracting time series from existing datasets stored as netCDF.

Earthmover@earthmover.io · last yr.

1/ 🚀 Solving #NASA ’s cloud data dilemma: Icechunk unlocks 100x faster access to archival data formats We're thrilled to publish results from our pilot project with NASA and @developmentseed.org to enable high-performance cloud-native access for NASA’s 100s of petabytes of Earth observation data.

Josh Moore@joshmoore.bsky.social · last yr.

ICYMI: A MATLAB implementation of @zarr.dev has dropped from @mathworks.bsky.social 🚀 github.com/mathworks/MA...

GitHub - mathworks/MATLAB-support-for-Zarr-files: This contribution provides an interface in MATLAB to read and write Zarr files. Zarr is a file format for scientific data (like HDF5 and netCDF) which...

This contribution provides an interface in MATLAB to read and write Zarr files. Zarr is a file format for scientific data (like HDF5 and netCDF) which is optimized for cloud storage and parallel co...

github.com

Chris Holmes@opencholmes.bsky.social · last yr.

You, yes you, can help the Cloud Native Geospatial Movement! Have you benefitted from Cloud-Optimized GeoTIFF’s? SpatioTemporal Asset Catalogs? Zarr, COPC or GeoParquet? And the ecosystem around them? Learn how to give back in my post: cholmes.medium.com/you-yes-you-...

You, yes you, can help the Cloud Native Geospatial Movement!

Have you benefitted from COG’s, STAC, Zarr, COPC or GeoParquet? Join us in Utah for the first CNG Conference and help just by attending.

cholmes.medium.com

Aafke Gros@aafkegros.bsky.social · 2y ago

Microscopy Nodes loads data from a @zarr.dev bucket, making it easy to use open data archives that host Zarr data! This is a mitotic cell from Walther et al. 2018, that's hosted publicly on the Image Data Resource 😱

Zarr@zarr.dev · 2y ago

🎉 Zarr-Python 3 is here! 🎉 - Full support for Zarr v3 spec - Chunk-sharding for more efficient data storage - Major performance boosts with async I/O & parallel compression 💻 pip install --upgrade zarr 💻 conda install --channel conda-forge zarr Blog post: https://buff.ly/3C3OwYw

Zarr@zarr.dev · 2y ago

Hi, Zarr community! 👋 🚨 Big news: Zarr-Python 3.0 is dropping next week! 🚨 If your project depends on Zarr-Python, make sure to check out the migration guide to get ready for the update. Guide: https://buff.ly/3W0cLxd More updates soon! 🧑🏻‍💻

buff.ly