easydel.layers.quantization._nf4_quantizer

Contents

easydel.layers.quantization._nf4_quantizer#

easydel.layers.quantization._nf4_quantizer.dequantize_nf4(packed_values: Array, absmax: Array, block_size: int)[source]#

easydel.layers.quantization._nf4_quantizer.quantize_and_pack_nf4(blocks: Array, block_size: int = 64)[source]#

easydel.layers.quantization._nf4_quantizer.single_dequantize_nf4(packed_values, absmax, block_size)[source]#: Optimized dequantization combining unpacking and scaling in fewer operations.

easydel.layers.quantization._nf4_quantizer.single_quantize_and_pack_nf4(blocks, block_size=64)[source]#: Combined quantization and packing for better performance. Handles normalization, quantization, and packing in a single operation.