Skip to content

Comments

Support for Qwen added #10

Open
applexi wants to merge 5 commits intoInfini-AI-Lab:v0.1.0from
applexi:feature-Qwen
Open

Support for Qwen added #10
applexi wants to merge 5 commits intoInfini-AI-Lab:v0.1.0from
applexi:feature-Qwen

Conversation

@applexi
Copy link

@applexi applexi commented Jan 18, 2025

  • added qwen.py and qwen_layer.py
  • added qwen support in auto_model.py and templates.py
  • problem: qwen with offload=true produces garbled content or errors

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants