An abstraction layer for reading and writing astronomical data to datastores.
Project description
lsst-daf-butler
LSST Data Access framework described in arXiv:2206.14941. Please cite the SPIE paper when using this software.
This is a Python 3 only package (we assume Python 3.11 or higher).
- SPIE paper from 2024: Converting Rubin Observatory's data butler to a client/server architecture (Tech note)
- SPIE Paper from 2022: The Vera C. Rubin Observatory Data Butler and Pipeline Execution System (arXiv) [Primary reference]
- ADASS paper from 2019: Abstracting the Storage and Retrieval of Image Data at the LSST.
- Early design note: DMTN-056
PyPI: lsst-daf-butler
This software is dual licensed under the GNU General Public License (version 3 of the License, or (at your option) any later version, and also under a 3-clause BSD license). Recipients may choose which of these licenses to use; please see the files gpl-3.0.txt and/or bsd_license.txt, respectively.
Arrow Memory Leaks
From version 18 of arrow we have seen significant memory leaks when accessing parquet files using the default memory allocator.
If you see such leaks the workaround is to set the ARROW_DEFAULT_MEMORY_POOL environment variable to jemalloc following the advice from apache/arrow#45882.
For EUPS users this variable is automatically set.
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file lsst_daf_butler-30.2026.2000.tar.gz.
File metadata
- Download URL: lsst_daf_butler-30.2026.2000.tar.gz
- Upload date:
- Size: 1.3 MB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.1.0 CPython/3.13.12
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
30481552952ecf3cb37ee7252a972591246049557888158385459db715f65981
|
|
| MD5 |
799ffc28ff05e8798b27eb01549cdee8
|
|
| BLAKE2b-256 |
46f74f81f52766bd07bd6cdae4b4dd2b977677973216b2ad4f9526c2e8f51c98
|
File details
Details for the file lsst_daf_butler-30.2026.2000-py3-none-any.whl.
File metadata
- Download URL: lsst_daf_butler-30.2026.2000-py3-none-any.whl
- Upload date:
- Size: 1.4 MB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.1.0 CPython/3.13.12
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
63b441a2bbdef45175219398eba8f5d7fc2c10b4c036ab3019d533baa3957bea
|
|
| MD5 |
de35e32dbfbd8129c664c1cf40734d54
|
|
| BLAKE2b-256 |
5d770986e2f8cb0797b8083d8ae2f876088a144662df7551788ae99ccdf76167
|
