This repository was archived by the owner on Oct 31, 2023. It is now read-only.
This repository was archived by the owner on Oct 31, 2023. It is now read-only.
Can I quantize the tensors to other data type rather than 8bit tensor? #33
There's some quantization example here
It showed that there is
bnb.functional.quantize_fp4(x)But I didn't find it in documentations.