Skip to content

[Feature - Hugging Face] Add new DLCs(transformers 4.26.0) to Image config #3669

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
5 of 6 tasks
JingyaHuang opened this issue Feb 20, 2023 · 4 comments · Fixed by #3741
Closed
5 of 6 tasks

[Feature - Hugging Face] Add new DLCs(transformers 4.26.0) to Image config #3669

JingyaHuang opened this issue Feb 20, 2023 · 4 comments · Fixed by #3741
Labels
type: config missing Use when there is a request for update in config

Comments

@JingyaHuang
Copy link
Contributor

JingyaHuang commented Feb 20, 2023

Add Release Image to Image config for the Hugging Face DLCs

huggingface_pytorch

Training

  • PyTorch 1.13 - Transformers 4.26.0 - GPU

Inference

  • PyTorch 1.13 - Transformers 4.26.0 - CPU
  • PyTorch 1.13 - Transformers 4.26.0 - GPU

huggingface_tensorflow

Training

  • TensorFlow 2.11.0 - Transformers 4.26.0 - GPU

Inference

  • TensorFlow 2.11.0 - Transformers 4.26.0 - CPU
  • TensorFlow 2.11.0 - Transformers 4.26.0 - GPU

cc @tejaschumbalkar @arjkesh

@rojamet
Copy link

rojamet commented Mar 31, 2023

@JingyaHuang your PR appears to not include a training image for transformers 4.26 with tensorflow, is it an oversight, or is the 4.26 tensorflow training version coming later?

@JingyaHuang
Copy link
Contributor Author

Hi @rojamet, the training image will come later. You can track the progress of HF-TF training DLC for transformers 4.26 here: aws/deep-learning-containers#2693 .

@rojamet
Copy link

rojamet commented Mar 31, 2023

@JingyaHuang Thank you very much for that quick answer! I'll be following that.

@knikure knikure added the type: config missing Use when there is a request for update in config label Apr 26, 2023
@JingyaHuang
Copy link
Contributor Author

Hi @knikure, can you reopen the issue, as the TF training DLC is merged in the DLC repo but not yet released nor added to sagemaker SDK. Thanks.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
type: config missing Use when there is a request for update in config
Projects
None yet
3 participants