Improved CI/CD pipeline, added dependencies, and other miscellaneous improvements

[baogorek]

Now leaving Python 3.11 as it lies in the .github folder, but still adding the 3.12 matrix test.

• fixes policyengine-us-data triggers distuitls error with Python 3.12 when dev dependencies are not installed, and CI/CD does not catch it #210
• Fixes a documentation issues that cause problems on Windows due to an encoding issue
• Minor documentation enhancements
• Expanded make clean
• CI/CD includes a "smoke test" without dev dependencies and multiple python versions
• CI/CD testing now includes Windows.
• Improved handling of the environment variables that serve as authentication tokens.
  • Github's is not optional and not having it will not affect the local dev experiences
  • Not having the hugging face token will result in a ValueError

[anth-volk]

question: What is the purpose of this test? Alternatively, why does this import fail, and when?

And could you add the answer as a comment above it, as well?

[baogorek]

The reasoning for this less common test is that the package is currently unusable when installed normally via PyPi or pip install -e . with Python 3.12 (paired with Ubuntu 24.02) but the PR pipeline doesn't catch it. That's because the dev dependencies include setuptools, which is needed for imports such as:

from policyengine_core.data import Dataset

and even

import policyengine_us_data

The latter is one of the explicit tests, so it bothered me that the PR pipeline wouldn't fail, even when the version was changed to 3.12 in the pipeline.

What do you think? If you're good with the test, I'll add some comments.

[anth-volk]

Thanks for your work on this @baogorek. I've left some commentary; curious to hear your thoughts.

Separately, the test failure you're seeing may be solved by #208, which is awaiting review

[nikhilwoodruff]

Looks good after slight adjustments (and attempt of matrix to reduce duplication)

• Remove requirement for GITHUB_TOKEN