@@ -467,6 +467,8 @@ def train( # noqa: C901
467
467
a directory in the Docker container.
468
468
* 'Pipe' - Amazon SageMaker streams data directly from S3 to the container via a
469
469
Unix-named pipe.
470
+ * 'FastFile' - Amazon SageMaker streams data from S3 on demand instead of
471
+ downloading the entire dataset before training begins.
470
472
input_config (list): A list of Channel objects. Each channel is a named input source.
471
473
Please refer to the format details described:
472
474
https://botocore.readthedocs.io/en/latest/reference/services/sagemaker.html#SageMaker.Client.create_training_job
@@ -609,6 +611,8 @@ def _get_train_request( # noqa: C901
609
611
a directory in the Docker container.
610
612
* 'Pipe' - Amazon SageMaker streams data directly from S3 to the container via a
611
613
Unix-named pipe.
614
+ * 'FastFile' - Amazon SageMaker streams data from S3 on demand instead of
615
+ downloading the entire dataset before training begins.
612
616
input_config (list): A list of Channel objects. Each channel is a named input source.
613
617
Please refer to the format details described:
614
618
https://botocore.readthedocs.io/en/latest/reference/services/sagemaker.html#SageMaker.Client.create_training_job
@@ -1897,6 +1901,8 @@ def tune( # noqa: C901
1897
1901
a directory in the Docker container.
1898
1902
* 'Pipe' - Amazon SageMaker streams data directly from S3 to the container via a
1899
1903
Unix-named pipe.
1904
+ * 'FastFile' - Amazon SageMaker streams data from S3 on demand instead of
1905
+ downloading the entire dataset before training begins.
1900
1906
metric_definitions (list[dict]): A list of dictionaries that defines the metric(s)
1901
1907
used to evaluate the training jobs. Each dictionary contains two keys: 'Name' for
1902
1908
the name of the metric, and 'Regex' for the regular expression used to extract the
@@ -2180,6 +2186,8 @@ def _map_training_config(
2180
2186
a directory in the Docker container.
2181
2187
* 'Pipe' - Amazon SageMaker streams data directly from S3 to the container via a
2182
2188
Unix-named pipe.
2189
+ * 'FastFile' - Amazon SageMaker streams data from S3 on demand instead of
2190
+ downloading the entire dataset before training begins.
2183
2191
role (str): An AWS IAM role (either name or full ARN). The Amazon SageMaker training
2184
2192
jobs and APIs that create Amazon SageMaker endpoints use this role to access
2185
2193
training data and model artifacts. You must grant sufficient permissions to
0 commit comments