Skip to content

Change: Mention "FastFile" support for s3_input_mode in docstrings #4311

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 1 commit into from
Dec 7, 2023
Merged

Change: Mention "FastFile" support for s3_input_mode in docstrings #4311

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion src/sagemaker/dataset_definition/inputs.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -198,7 +198,7 @@ def __init__(
the path to a local directory. If not provided, skips data download
by SageMaker platform.
s3_data_type (str, default="S3Prefix"): Valid options are "ManifestFile" or "S3Prefix".
s3_input_mode (str, default="File"): Valid options are "Pipe" or "File".
s3_input_mode (str, default="File"): Valid options are "Pipe", "File" or "FastFile".
s3_data_distribution_type (str, default="FullyReplicated"):
Valid options are "FullyReplicated" or "ShardedByS3Key".
s3_compression_type (str, default=None): Valid options are "None" or "Gzip".
Expand Down
6 changes: 4 additions & 2 deletions src/sagemaker/model_monitor/model_monitoring.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -3933,7 +3933,8 @@ def __init__(
Args:
endpoint_name (str): The name of the endpoint.
destination (str): The destination of the input.
s3_input_mode (str): The S3 input mode. Can be one of: "File", "Pipe. Default: "File".
s3_input_mode (str): The S3 input mode. Can be one of: "File", "Pipe" or "FastFile".
Default: "File".
s3_data_distribution_type (str): The S3 Data Distribution Type. Can be one of:
"FullyReplicated", "ShardedByS3Key"
start_time_offset (str): Monitoring start time offset, e.g. "-PT1H"
Expand Down Expand Up @@ -4043,7 +4044,8 @@ def __init__(
data_captured_destination_s3_uri (str): Location to the batch transform captured data
file which needs to be analysed.
destination (str): The destination of the input.
s3_input_mode (str): The S3 input mode. Can be one of: "File", "Pipe. (default: File)
s3_input_mode (str): The S3 input mode. Can be one of: "File", "Pipe" or
"FastFile". (default: File)
s3_data_distribution_type (str): The S3 Data Distribution Type. Can be one of:
"FullyReplicated", "ShardedByS3Key" (default: FullyReplicated)
start_time_offset (str): Monitoring start time offset, e.g. "-PT1H" (default: None)
Expand Down
2 changes: 1 addition & 1 deletion src/sagemaker/processing.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -1242,7 +1242,7 @@ def __init__(
input_name (str or PipelineVariable): The name for the input. If a name
is not provided, one will be generated (eg. "input-1").
s3_data_type (str or PipelineVariable): Valid options are "ManifestFile" or "S3Prefix".
s3_input_mode (str or PipelineVariable): Valid options are "Pipe" or "File".
s3_input_mode (str or PipelineVariable): Valid options are "Pipe", "File" or "FastFile".
s3_data_distribution_type (str or PipelineVariable): Valid options are "FullyReplicated"
or "ShardedByS3Key".
s3_compression_type (str or PipelineVariable): Valid options are "None" or "Gzip".
Expand Down