Skip to content

Conversation

@BrandonGroth
Copy link
Collaborator

@BrandonGroth BrandonGroth commented Jul 2, 2025

Description of the change

This change removes the warning for gptqmodel, as well as adds additional safeguards for the optional dependency.
Also, this fixes a minor bug with the available_package check in modules/linear.py, as it was checking for the auto_gptq external kernels instead of gptqmodel's version.

Related issues or PRs

Closes #99

How to verify the PR

On main:

python3
>>> import fms_mo
GPTQModel is not properly installed. QLinearExv1WI4AF16 and QLinearExv2WI4AF16 wrappers will not be available.
>>> 

This PR:

python3
>>> import fms_mo
>>> 

Was the PR tested

  • I have added >=1 unit test(s) for every new method I have added (if that coverage is difficult, please briefly explain the reason)
  • I have ensured all unit tests pass

Checklist for passing CI/CD:

  • All commits are signed showing "Signed-off-by: Name <email@domain.com>" with git commit -signoff or equivalent
  • PR title and commit messages adhere to Conventional Commits
  • Contribution is formatted with tox -e fix
  • Contribution passes linting with tox -e lint
  • Contribution passes spellcheck with tox -e spellcheck
  • Contribution passes all unit tests with tox -e unit

Note: CI/CD performs unit tests on multiple versions of Python from a fresh install. There may be differences with your local environment and the test environment.

Signed-off-by: Brandon Groth <brandon.m.groth@gmail.com>
Signed-off-by: Brandon Groth <brandon.m.groth@gmail.com>
Signed-off-by: Brandon Groth <brandon.m.groth@gmail.com>
@chichun-charlie-liu chichun-charlie-liu merged commit a9eafcd into foundation-model-stack:main Jul 2, 2025
15 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

"GPTQ not installed" warning suppression

2 participants