Kelly mentioned that a good repo to emulate would be: caikit: https://github.com/caikit/caikit
And... As far as testing, our biggest barrier was the fact that we have external dependencies on k8s and redis.. And trying to emulate that for proper unit tests..