Skip to content

Commit

Permalink
add responseType, responseSchema to cache key
Browse files Browse the repository at this point in the history
  • Loading branch information
pelikhan committed Feb 8, 2025
1 parent dc54d74 commit 5909806
Show file tree
Hide file tree
Showing 2 changed files with 4 additions and 0 deletions.
2 changes: 2 additions & 0 deletions .gitignore.genai
Original file line number Diff line number Diff line change
Expand Up @@ -6,3 +6,5 @@ package.json
package-lock.json
yarn.lock
**/package.lock
docs/dist/
docs/distasw/
2 changes: 2 additions & 0 deletions packages/core/src/chat.ts
Original file line number Diff line number Diff line change
Expand Up @@ -1078,6 +1078,8 @@ export async function executeChatSession(
const cachedKey = deleteUndefinedValues({
modelid: model,
...req,
responseType,
responseSchema,
...cfgNoToken,
}) satisfies ChatCompletionRequestCacheKey
const validator = (value: ChatCompletionResponse) => {
Expand Down

0 comments on commit 5909806

Please sign in to comment.