Skip to content

Migrate from autoGPTQ to GPTQModel #108

@tharapalanivel

Description

@tharapalanivel

Is your feature request related to a problem? Please describe.

autoGPTQ repo is migrating to GPTQModel.

Describe the solution you'd like

update the dependencies and make sure compatibility.

Describe alternatives you've considered

might be ok to stay on obsoleted dependency (auto_gptq) until upstream/downstream stack reports issues. but new repo also has more model supports, which could reduce redundant works for us.

Additional context

need to make sure compatibility for granite family.

Metadata

Metadata

Labels

No labels
No labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions