INT4 LoRA wonderful-tuning vs QLoRA: A user inquired about the variations concerning INT4 LoRA fantastic-tuning and QLoRA in terms of precision and speed. A different member explained that QLoRA with HQQ consists of frozen quantized weights, will not use tinnygemm, and utilizes dequantizing together with torch.matmul GPT-4o connectivity prob