Code

Support full duplex streaming#450

Code

Merged

kfswain merged 18 commits intokubernetes-sigs:mainkubernetes-sigs/gateway-api-inference-extension:mainfrom

kfswain:duplex-streamkfswain/llm-instance-gateway:duplex-streamCopy head branch name to clipboard

Mar 6, 2025

Commits

Commits on Mar 5, 2025

• manifest modifications to enable duplex streaming

  kfswain

  committed
  ff5ab61

  Copy full SHA for ff5ab61

• Initial working hard code of duplex streaming

  kfswain

  committed
  d94680a

  Copy full SHA for d94680a

• Enabling full duplex streaming for request & response flows.

  kfswain

  committed
  5d859d9

  Copy full SHA for 5d859d9

• Cleanup of local dev work

  kfswain

  committed
  4e10f9e

  Copy full SHA for 4e10f9e

• Removing WG as it is unneeded, close the reader after decode for both request and response

  kfswain

  committed
  b2c7b4b

  Copy full SHA for b2c7b4b

• Remove empty body check, simplify code

  kfswain

  committed
  b4e1e14

  Copy full SHA for b4e1e14

• build fix after rebase

  kfswain

  committed
  c1ee3ac

  Copy full SHA for c1ee3ac

• fixing comment scope

  kfswain

  committed
  a331092

  Copy full SHA for a331092

• Extracting immediate response error handling logic to a func and implementing on both servers

  kfswain

  committed
  99bcfdc

  Copy full SHA for 99bcfdc

• Simplifying cyclometric complexity

  kfswain

  committed
  a59449d

  Copy full SHA for a59449d

• Removing dev logs

  kfswain

  committed
  cd14149

  Copy full SHA for cd14149

• Fixing err handling of writers

  kfswain

  committed
  01da659

  Copy full SHA for 01da659

• white space change

  kfswain

  committed
  47f8428

  Copy full SHA for 47f8428

• CLA test commit

  kfswain

  committed
  7c9eb76

  Copy full SHA for 7c9eb76

• Review comments

  kfswain

  committed
  dba0d27

  Copy full SHA for dba0d27

• update extproc config

  kfswain

  committed
  08925b2

  Copy full SHA for 08925b2

• CLA test

  kfswain

  committed
  0030d5d

  Copy full SHA for 0030d5d

• verification test

  kfswain

  committed
  7c6c599

  Copy full SHA for 7c6c599