InstructorClient currently only works with LiteLLMClient. Running scripts/run_local_adapter.py (which uses TransformersLLMClient) fails as it's not properly wrapped.
Will local HuggingFace models continue to be supported, and any plans to add TransformersLLMClient compatibility?
InstructorClient currently only works with LiteLLMClient. Running
scripts/run_local_adapter.py(which uses TransformersLLMClient) fails as it's not properly wrapped.Will local HuggingFace models continue to be supported, and any plans to add TransformersLLMClient compatibility?