dnrops
/
icebreaker
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity

Enable `cache_prompt` in `Assistant::chat`

This commit is contained in:
Héctor Ramón Jiménez 2024-07-12 10:03:31 +02:00
parent 7796a82a1e
commit 537b385381
No known key found for this signature in database
GPG Key ID: 7CC46565708259A7
1 changed files with 1 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

1
src/assistant.rs
View File

@ -350,6 +350,7 @@ impl Assistant {
"model": "tgi",
"messages": messages,
"stream": true,
"cache_prompt": true,
}))
};