Easily configure shared memory size for CLI jobs with `--docker-shm-size`. Training PyTorch models on a GPU and need more memory? Ever run into "Error: No space left on device"? You can now customize Docker shared memory size with `--docker-shm-size`. docs.coiled.io/user_guide/c...
@coiled.io
Run Python on the cloud easily + cheaply. Based on Dask for parallel computing.
🔨 Job setup option for Coiled Batch Use `--host-setup-script` to configure your VM before your batch job starts. Easily: ✅ Install dependencies ✅ Mount cloud storage ✅ Handle authentication or any other setup your jobs need. Learn more: docs.coiled.io/user_guide/b...
Coiled 2024 in Review docs.coiled.io/blog/2024-eo... It’s the time when companies issue year-end summaries, acclaiming success (or not), and forecasting incredible growth for the next year (or not). I thought I’d do something similar for Coiled. It’s been a significant year for us ...
Coiled 2024 in Review
Coiled's 2024 in review. Where we started, what we did, and where we're going.
docs.coiled.io
Calculating quantiles, a common application in #geospatial workloads, used to be slow due to GIL contention in NumPy. The new implementation in @dask.org + @xarray.bsky.social is up to a hundred times faster and scales independently of the number of threads 🥳 . docs.coiled.io/blog/array-q...
We're big fans of rich for a nice terminal experience, but we've found sometimes folks log things even rich can't handle. As of the latest coiled=1.67.0 release, coiled logs automatically falls back to non-rich printing in these situations. Release notes: docs.coiled.io/user_guide/c...
Learn more about @dask.org + @xarray.bsky.social for large-scale geo workloads at PyData Global. We'll cover what works (and what breaks) + updates on building a benchmarking suite for 100s of TBs of geospatial data. 🗓️ Thursday, Dec. 5th ⏰ 4pm UTC global2024.pydata.org/cfp/talk/G9D...
Dask ❤️ Xarray: Geoscience at Massive Scale PyData Global 2024
Doing geoscience is hard. It’s even harder if you have to figure out how to handle large amounts of data! Xarray is an open-source Python library designed to simplify the handling of labeled multi-di...
global2024.pydata.org