Code

Implemented KVCacheAwareScorer#34

Code

Merged

vMaroon merged 6 commits intoneuralmagic:devneuralmagic/gateway-api-inference-extension:devfrom

vMaroon:kvcache-awarevMaroon/gateway-api-inference-extension:kvcache-awareCopy head branch name to clipboard

Apr 30, 2025

Commits

Commits on Apr 30, 2025

• - implemented kvcache-aware-scorer

  Show description for dc174c2
  vMaroon

  committed
  dc174c2

  Copy full SHA for dc174c2

• undo gofumpt

  Show description for 3476f59
  vMaroon

  committed
  3476f59

  Copy full SHA for 3476f59

• added scorer initialization debug msg

  Show description for e6ca553
  vMaroon

  committed
  e6ca553

  Copy full SHA for e6ca553

• - added debug logging

  Show description for 388a7db
  vMaroon

  committed
  388a7db

  Copy full SHA for 388a7db

• updated KVCacheAwareScorer comments

  Show description for 01f019d
  vMaroon

  committed
  01f019d

  Copy full SHA for 01f019d

• reused envutils (review comment)

  Show description for bc2fee3
  vMaroon

  committed
  bc2fee3

  Copy full SHA for bc2fee3