Skip to content

Commit 5d72b59

Browse files
authored
model.config handle breaking change in hub (#416)
1 parent c503d91 commit 5d72b59

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

docker_images/peft/app/pipelines/text_generation.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -19,7 +19,7 @@ def __init__(self, model_id: str):
1919
config_dict = model_data.config.get("peft")
2020

2121
if config_dict:
22-
base_model_id = config_dict["base_model_name"]
22+
base_model_id = config_dict["base_model_name_or_path"]
2323
if base_model_id:
2424
self.tokenizer = AutoTokenizer.from_pretrained(base_model_id)
2525
model = AutoModelForCausalLM.from_pretrained(

0 commit comments

Comments
 (0)