Fix AttributeError in 4-bit quantization when CUDA library is not loaded

[demoncoder-crypto]

Addresses #1467

[Titus-von-Koeller]

Hey @demoncoder-crypto thanks for the contribution! However, we're planning to handle this differently with a fallback mechanism, see this PR: #1615

[demoncoder-crypto]

Hi @Titus-von-Koeller, I just wanted to know if there are any issues that I can contribute too, any pointers are appreciated.

[Titus-von-Koeller]

@demoncoder-crypto Cool that you're interested to contribute! It's a bit tough to figure out sth to do at the moment because we have so much going on, but most things that I'm aware of require a lot of background knowledge..

For example this PR has become stale somehow and would be important to make progress again and is somewhat self contained.

[demoncoder-crypto]

@Titus-von-Koeller Thanks for replying it really means a lot. I just want to contribute as I am learning about this right now, I think I do have some decent knowledge on this subject if something requires learning I will definitely put in the work to learn it. I also do understand you are also quite busy so I really do appreciate the time you have given me thanks.