Code

Dynamic lora load/unload sidecar#31

Code

Merged

k8s-ci-robot merged 34 commits intokubernetes-sigs:mainkubernetes-sigs/gateway-api-inference-extension:mainfrom

coolkp:dynamic-lora-sidecarcoolkp/llm-instance-gateway:dynamic-lora-sidecarCopy head branch name to clipboard

Nov 18, 2024

Commits

Commits on Oct 23, 2024

• Dynamic lora load/unload sidecar

  coolkp

  committed
  14e4b10

  Copy full SHA for 14e4b10

• Formatting

  coolkp

  committed
  bcfee4a

  Copy full SHA for bcfee4a

Commits on Oct 30, 2024

• Resolve README comments

  Show description for cb45fe2
  coolkp

  committed
  cb45fe2

  Copy full SHA for cb45fe2

• Address comments on sidecar, store updates in memory, rename base field

  Show description for 62da988
  coolkp

  committed
  62da988

  Copy full SHA for 62da988

• Address comments in example deployment

  Show description for 56cffc2
  coolkp

  committed
  56cffc2

  Copy full SHA for 56cffc2

• Address comments in example deployment

  Show description for 5cbaeef
  coolkp

  committed
  5cbaeef

  Copy full SHA for 5cbaeef

• base model is optional

  Show description for 5a03f98
  coolkp

  committed
  5a03f98

  Copy full SHA for 5a03f98

Commits on Nov 5, 2024

• Check health of server before querying

  Show description for 1af2df4
  coolkp

  committed
  1af2df4

  Copy full SHA for 1af2df4

• Check health of server before querying

  Show description for 5b51182
  coolkp

  committed
  5b51182

  Copy full SHA for 5b51182

• Docstrings

  Show description for cc1e686
  coolkp

  committed
  cc1e686

  Copy full SHA for cc1e686

• Mock health check in tests

  Show description for 926a71c
  coolkp

  committed
  926a71c

  Copy full SHA for 926a71c

Commits on Nov 7, 2024

• Refactor configmap, switch to watchfiles to detect symbolic link target changes, pull dynamically from configmap

  Show description for cb3c9b2
  coolkp

  committed
  cb3c9b2

  Copy full SHA for cb3c9b2

• Refactor configmap, switch to watchfiles to detect symbolic link target changes, pull dynamically from configmap

  Show description for 3140610
  coolkp

  committed
  3140610

  Copy full SHA for 3140610

Commits on Nov 8, 2024

• Modify unittests

  Show description for 65cea88
  coolkp

  committed
  65cea88

  Copy full SHA for 65cea88

• Change example host and port to be explicit

  Show description for 8012ea3
  coolkp

  committed
  8012ea3

  Copy full SHA for 8012ea3

• Change example sidecar name

  Show description for ba00b85
  coolkp

  committed
  ba00b85

  Copy full SHA for ba00b85

• Add warning about using subPath

  Show description for c8d9c10
  coolkp

  committed
  c8d9c10

  Copy full SHA for c8d9c10

• Add screenshots

  Show description for 828348d
  coolkp

  committed
  828348d

  Copy full SHA for 828348d

• Add screenshots

  Show description for ec40820
  coolkp

  committed
  ec40820

  Copy full SHA for ec40820

Commits on Nov 9, 2024

• Add testing results

  Show description for 1aba325
  coolkp

  committed
  1aba325

  Copy full SHA for 1aba325

• Add testing results

  Show description for b30051a
  coolkp

  committed
  b30051a

  Copy full SHA for b30051a

Commits on Nov 11, 2024

• Add config validation

  Show description for c5d2527
  coolkp

  committed
  c5d2527

  Copy full SHA for c5d2527

• Add config documentation

  Show description for d0d01e1
  coolkp

  committed
  d0d01e1

  Copy full SHA for d0d01e1

• Add config documentation

  Show description for b4867b6
  coolkp

  committed
  b4867b6

  Copy full SHA for b4867b6

• Add config validation

  Show description for e60b434
  coolkp

  committed
  e60b434

  Copy full SHA for e60b434

• Add config validation

  Show description for bea4068
  coolkp

  committed
  bea4068

  Copy full SHA for bea4068

• Make reconciling non blocking

  coolkp

  committed
  100f636

  Copy full SHA for 100f636

Commits on Nov 12, 2024

• Move under tools

  Show description for c24ff35
  coolkp

  committed
  c24ff35

  Copy full SHA for c24ff35

• Move under tools

  Show description for 472b545
  coolkp

  committed
  472b545

  Copy full SHA for 472b545

Commits on Nov 13, 2024

• Document usage of sidecar, available by default from 1.29

  coolkp

  committed
  5354a47

  Copy full SHA for 5354a47

• Document usage of sidecar, available by default from 1.29

  coolkp

  committed
  bc2ce32

  Copy full SHA for bc2ce32

• Document usage of sidecar, available by default from 1.29

  Show description for f82d8b2
  coolkp

  committed
  f82d8b2

  Copy full SHA for f82d8b2

Commits on Nov 16, 2024

• Update tools/dynamic-lora-sidecar/README.md

  Show description for e01ec51
  

  coolkp

  and

  ahg-g

  authored
  e01ec51

  Copy full SHA for e01ec51

• Update tools/dynamic-lora-sidecar/README.md

  Show description for 28779e7
  

  coolkp

  and

  ahg-g

  authored
  28779e7

  Copy full SHA for 28779e7