second kernel #1823
second kernel #1823
Conversation
|
The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update. |
| """Dispatcher shimming the editable layout. | ||
|
|
||
| When this repository is used via ``pip install -e .`` the real Python | ||
| package lives under ``bitsandbytes/bitsandbytes``. Importing from the | ||
| workspace root (e.g. running scripts from ``.../ai/kernels``) would | ||
| otherwise resolve to this outer directory, yielding a namespace module | ||
| with no attributes. Import the inner package eagerly and mirror its | ||
| symbols so ``import bitsandbytes`` always behaves the same as the | ||
| installed wheel. | ||
| """ |
There was a problem hiding this comment.
I don't think we need this; CI for tests currently breaks with this and I wouldn't normally expect anyone to run a script from the project root.
I've been thinking separately of switching to a src layout from the flat layout we have now, which would probably take care of things like this too, but probably out of scope here. I think we could just move test_bnb_mac.py into examples.
There was a problem hiding this comment.
Yes, of coursed, this is just a draft to get the discussion started on what we’ll need. I managed to get it working using a shim to pass the underlying MTL buffer to the kernel, but ran into another issue: I have to commit the work and wait manually, since I can’t synchronize with the PyTorch stream afterward. I’m also working on another PR to integrate libtorch and see if it gives us better performance.
2 participants
No description provided.