We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
1 parent fc3f414 commit 5480639Copy full SHA for 5480639
config/manifests/inferencepool.yaml
@@ -50,6 +50,8 @@ spec:
50
- "vllm-llama2-7b"
51
- -v
52
- "4"
53
+ - --zap-encoder
54
+ - "json"
55
- -grpcPort
56
- "9002"
57
- -grpcHealthPort
0 commit comments