Skip to content

[HuggingFace] use default Hugging Face Inference DLC for non TGI models when using ModelBuilder #4284

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Closed
philschmid opened this issue Nov 30, 2023 · 1 comment · Fixed by #4368
Closed

[HuggingFace] use default Hugging Face Inference DLC for non TGI models when using ModelBuilder #4284

philschmid opened this issue Nov 30, 2023 · 1 comment · Fixed by #4368
Labels
component: model builder

Comments

@philschmid
Copy link
Contributor

I was playing a bit with it and noticed something that it defaults to TGI even if we don't have a LLM, .e.g. bert-base-uncased.
When there is a non LLM/TGI supported model provided we should fallback to the regular Hugging Face Inference DLC.

image
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
component: model builder
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

feat: Introduce HF Transformers to ModelBuilder samruds/sagemaker-python-sdk
2 participants
@mohanasudhan @philschmid