Skip to content

Migrate/enhance quantization jupyter notebooks #111

@chichun-charlie-liu

Description

@chichun-charlie-liu

Is your feature request related to a problem? Please describe.

There were 5 quantization-related Jupyter Notebooks in the old sq1e repo which are also served on IBM Research JupyterLab. Only one of them have been migrated to the fms-mo so far. Since these notebooks will be quite helpful for new users. we should refresh and incorporate the notebooks into fms-mo.

Describe the solution you'd like

  • we will enable notebooks 01 (intro), 02 (EDSR), 03 (QAT), 06 (HAP). (01 is done, re-use fms-mo/tutorial version)

Yogesh(Yogesh.Jadhav1@ibm.com) will:

  • upgrade the use of sq1e to fms-mo in these notebooks.
  • simplify the CLI-style "args" to "json" style.
  • commit newly revised notebooks back to fms-mo tutorial folder, so we only need to maintain one set of notebooks.

@kcirred @chichun-charlie-liu will:

  • review EDSR notebook and debug for incorrect accuracy numbers
  • try to reduce runtime of QAT notebook with more CPU-friendly settings.

Describe alternatives you've considered

Since fms-mo is almost a drop-in replacement for old sq1e repo, migration the notebooks would simply mean changing the imports. However, there are also some syntax simplifications/changes in fms-mo compared to sq1e, a careful review and test of the notebooks will be needed.

Additional context

These notebooks are assuming "CPU-only" environment. QAT notebook will need to be further adjusted

Metadata

Metadata

Labels

documentationImprovements or additions to documentation

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions