File tree Expand file tree Collapse file tree 1 file changed +6
-1
lines changed Expand file tree Collapse file tree 1 file changed +6
-1
lines changed Original file line number Diff line number Diff line change @@ -6,4 +6,9 @@ model name.
6
6
As per OpenAI spec, it is standard for the model name to be included in the
7
7
body of the HTTP request. However, most implementations do not support routing
8
8
based on the request body. This extension helps bridge the gap for clients that
9
- are unable to write the model name into the headers themselves.
9
+ This extension works by parsing the request body. If it finds a ` model ` parameter in the
10
+ request body, it will copy the value of that parameter into a request header.
11
+
12
+ This extension is intended to be paired with an ` ext_proc ` capable Gateway. There is not
13
+ a standard way to represent this kind of extension in Gateway API yet, so we recommend
14
+ referring to implementation-specific documentation for how to deploy this extension.
You can’t perform that action at this time.
0 commit comments