cpu only endpoints#751

dmchoiboi wants to merge 5 commits intomainscaleapi/llm-engine:mainfrom

feature/cpu-only-endpointsscaleapi/llm-engine:feature/cpu-only-endpointsCopy head branch name to clipboard