[GenAI] Use BitsAndBytes for 4bit quantization.#7406
Open
LittleLittleCloud wants to merge 8 commits intodotnet:mainfrom
Open
[GenAI] Use BitsAndBytes for 4bit quantization.#7406LittleLittleCloud wants to merge 8 commits intodotnet:mainfrom
LittleLittleCloud wants to merge 8 commits intodotnet:mainfrom
Commits
Commits on Mar 2, 2025
- committed
- committed
- committed
- authored
