GGUF Quantized Versions for lower VRAM usage

[Azeeima]

Are you planning to release a GGUF version of this model?

[marwanlhabti5-coder]

I'm really looking forward this, i hope community make some gguf as well