Feat/neuronvllm model

[msenkfor]

Description

Related Issues

Documentation PR

https://awsdocs-neuron.readthedocs-hosted.com/en/latest/libraries/nxd-inference/vllm/index.html

Type of Change

Adding running model with Neuron

Bug fix
New feature

Testing

How have you tested the change? Verify that the changes do not break functionality or introduce warnings in consuming repositories: agents-docs, agents-tools, agents-cli

• [x ] I ran hatch run prepare

Checklist

• [x ] I have read the CONTRIBUTING document
• [x ] I have added any necessary tests that prove my fix is effective or my feature works
• I have updated the documentation accordingly
• I have added an appropriate example to the documentation to outline the feature, or no new docs are needed
• [ x] My changes generate no new warnings
• [ x] Any dependent changes have been merged and published

---

By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.

[yonib05]

Hey @msenkfor ,

Thank you so much for this PR and your contribution! We really appreciate the work you've put into this, and a neuron model provider looks like a fantastic addition to strands.
While we'd love to include every great neuron model provider, we've reached a point where we need to be selective about adding new ones directly into the Strands repos to keep it maintainable and focused.

That said, we absolutely want to support your integration! We'd recommend one of these approaches:

• Option 1: Publish your neuron model provider implementation as a standalone package on PyPI. This way, customers can easily install it and use it with our SDK. Here are some great examples of how this works: Clova Studio and hubspot
• Option 2: Include it as a submodule in an official neuron SDK (unclear if one exists), which would give users direct access through an existing package similar to AgentCore Memory

Either way, we'd be happy to feature you on our documentation page as a supported model provider, giving you visibility to our community. You can find more details here.

Would either of these approaches work for your use case? We're excited to see neuron with our ecosystem!

[msenkfor]

Hi @yonib05, thanks so much for your review. Looking at those options, I think we will go with option 1. Anything else we need to keep in mind for option 1? Otherwise, those links you sent were very helpful.