GitHub - Blosc/python-blosc2: A high-performance library for compressed ndarrays, with a flexible computational engine (original) (raw)
Python-Blosc2
A fast & compressed ndarray library with a flexible compute engine
| Author: | The Blosc development team |
|---|---|
| Contact: | blosc@blosc.org |
| Github: | https://github.com/Blosc/python-blosc2 |
| Actions: |  |
| PyPi: | |
| NumFOCUS: | |
| Code of Conduct: |
What is Python-Blosc2?
Python-Blosc2 is a high-performance compressed ndarray library with a flexible compute engine, using C-Blosc2as its compression backend. It allows complex calculations on compressed data, whether stored in memory, on disk, or over the network (e.g., viaCaterva2). It uses theC-Blosc2 simple and open format for storing compressed data.
More info: https://www.blosc.org/python-blosc2/getting_started/overview.html
Installing
Binary packages are available for major OSes (Win, Mac, Linux) and platforms. Install from PyPi using pip:
pip install blosc2 --upgrade
Conda users can install from conda-forge:
conda install -c conda-forge python-blosc2
Documentation
The documentation is available here:
https://blosc.org/python-blosc2/python-blosc2.html
You can find examples at:
https://github.com/Blosc/python-blosc2/tree/main/examples
A tutorial from PyData Global 2024 is available at:
https://github.com/Blosc/Python-Blosc2-3.0-tutorial
It contains Jupyter notebooks explaining the main features of Python-Blosc2.
License
This software is licensed under a 3-Clause BSD license. A copy of the python-blosc2 license can be found inLICENSE.txt.
Discussion forum
Discussion about this package is welcome at:
https://github.com/Blosc/python-blosc2/discussions
Social feeds
Stay informed about the latest developments by following us inMastodon,Bluesky orLinkedIn.
Thanks
Blosc2 is supported by the NumFOCUS foundation, theLEAPS-INNOV projectand ironArray SLU, among many other donors. This allowed the following people have contributed in an important way to the core development of the Blosc2 library:
- Francesc Alted
- Marta Iborra
- Aleix Alcacer
- Oscar Guiñón
- Juan David Ibáñez
- Ivan Vilata i Balaguer
- Oumaima Ech.Chdig
- Ricardo Sales Piquer
In addition, other people have participated to the project in different aspects:
- Jan Sellner, contributed the mmap support for NDArray/SChunk objects.
- Dimitri Papadopoulos, contributed a large bunch of improvements to the in many aspects of the project. His attention to detail is remarkable.
- And many others that have contributed with bug reports, suggestions and improvements.
Citing Blosc
You can cite our work on the various libraries under the Blosc umbrella as follows:
@ONLINE{blosc, author = {{Blosc Development Team}}, title = "{A fast, compressed and persistent data store library}", year = {2009-2025}, note = {https://blosc.org} }
Donate
If you find Blosc useful and want to support its development, please consider making a donation via the NumFOCUSorganization, which is a non-profit that supports many open-source projects. Thank you!
Compress Better, Compute Bigger