Quantization vs Sampling Temperature and LLM Safety
How weight quantization and sampling temperature jointly affect LLM safety alignment — a factorial analysis of the interaction.
How weight quantization and sampling temperature jointly affect LLM safety alignment — a factorial analysis of the interaction.