-
Notifications
You must be signed in to change notification settings - Fork 1.2k
Make the metric_names list optional in TrainingJobAnalytics object. #274
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM. just a couple small suggestions.
if metric_names: | ||
self._metric_names = metric_names | ||
else: | ||
self._metric_names = self._metric_names_for_training_job() |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
could be done in one line:
self._metric_names = metric_names or self._metric_names_for_training_job()
tuning_job_arn = training_description.get('TuningJobArn', None) | ||
if not tuning_job_arn: | ||
raise ValueError( | ||
"No metrics available. Training Job Analytics only available through Hyperparameter Tuning Jobs" |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
single quotes
Codecov Report
@@ Coverage Diff @@
## master #274 +/- ##
=========================================
+ Coverage 92.43% 92.5% +0.07%
=========================================
Files 49 49
Lines 3279 3297 +18
=========================================
+ Hits 3031 3050 +19
+ Misses 248 247 -1
Continue to review full report at Codecov.
|
Issue #273
Description of changes: When TrainingJobAnalytics object, the metric_names list is now optional. If not specified, it will use all configured metrics. To discover them, it looks for a hyperparameter tuning job associated with the training job, and finds the metric definitions there.
Merge Checklist
Put an
x
in the boxes that apply. You can also fill these out after creating the PR. If you're unsure about any of them, don't hesitate to ask. We're here to help! This is simply a reminder of what we are going to look for before merging your pull request.By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.