Skip to content

Commit c070070

Browse files
authored
Merge pull request #7 from Bslabe123/metrics-client
Added Abstract Type for Metrics Client
2 parents eb3ce16 + b1f8d26 commit c070070

File tree

3 files changed

+31
-0
lines changed

3 files changed

+31
-0
lines changed

Diff for: inference_perf/client/metrics/README.md

+14
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,14 @@
1+
# Model Server Metrics Query Clients
2+
3+
This repository provides clients to query performance metrics from various monitoring platforms. Each model server exposes a list of relevant performance metrics, and these clients are designed to retrieve and process that data effectively.
4+
5+
## Supported Monitoring Platforms
6+
7+
**Available now**:
8+
- None
9+
10+
**Todo**:
11+
- Google Cloud Monitoring
12+
- AWS CloudWatch
13+
- Azure Monitor
14+
- Self Deployed Prometheus

Diff for: inference_perf/client/metrics/__init__.py

+13
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,13 @@
1+
# Copyright 2025
2+
#
3+
# Licensed under the Apache License, Version 2.0 (the "License");
4+
# you may not use this file except in compliance with the License.
5+
# You may obtain a copy of the License at
6+
#
7+
# http://www.apache.org/licenses/LICENSE-2.0
8+
#
9+
# Unless required by applicable law or agreed to in writing, software
10+
# distributed under the License is distributed on an "AS IS" BASIS,
11+
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
12+
# See the License for the specific language governing permissions and
13+
# limitations under the License.

Diff for: inference_perf/client/metrics/client.py

+4
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,4 @@
1+
from abc import ABC
2+
3+
class Metrics_Client(ABC):
4+
pass

0 commit comments

Comments
 (0)