Skip to content

Commit 800b1d4

Browse files
rramkumar1robscott
andcommitted
Update pkg/body-based-routing/README.md
Co-authored-by: Rob Scott <[email protected]>
1 parent f150d1c commit 800b1d4

File tree

1 file changed

+6
-1
lines changed

1 file changed

+6
-1
lines changed

pkg/body-based-routing/README.md

Lines changed: 6 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -6,4 +6,9 @@ model name.
66
As per OpenAI spec, it is standard for the model name to be included in the
77
body of the HTTP request. However, most implementations do not support routing
88
based on the request body. This extension helps bridge the gap for clients that
9-
are unable to write the model name into the headers themselves.
9+
This extension works by parsing the request body. If it finds a `model` parameter in the
10+
request body, it will copy the value of that parameter into a request header.
11+
12+
This extension is intended to be paired with an `ext_proc` capable Gateway. There is not
13+
a standard way to represent this kind of extension in Gateway API yet, so we recommend
14+
referring to implementation-specific documentation for how to deploy this extension.

0 commit comments

Comments
 (0)