“This is the first release in our open-source week: runtime dynamic compression and…”
Tim Dettmers @Tim_DettmersX
Archived text
This is the first release in our open-source week: runtime dynamic compression and the private beta for bitsandbytes2.
bnb2 offers a new level of compression that brings large models to smaller devices.
The bnb2 private beta has started. We offer a limited number of people access to an early version of bnb2.
Sign up below.
Quoting @Tim_Dettmers: Releasing our runtime dynamic compression framework that achieves 1.5-2.0 bit compression at high quality. This is integrated into the bitsandbytes2 library, which starts as a private beta today.
Paper: https://timdettmers.com/papers/runtime-dynamic-compression.pdf Private beta signup: https://forms.gle/Pwtp8CVRULdoEnY79