Feature/add integration to deepseek #1176
Merged
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
This pull request includes several significant changes to improve the functionality and robustness of the codebase. The most important changes include adding a new method to extract the final answer from text, handling exceptions more effectively, and updating parameters for model evaluation.
Enhancements to exception handling and text processing:
langtest/modelhandler/llm_modelhandler.py
: Added theextract_final_answer
method to process the text and extract the final answer for reasoning models, and modified thepredict
method to utilize this new method. Additionally, improved exception handling by raising aValueError
with a specific error message.Updates to model evaluation parameters:
langtest/utils/custom_types/sample.py
: Added a new parametermodel_type
to the__update_params
method to support different model types during evaluation.langtest/utils/custom_types/sample.py
: Updated the call toload_eval_model.model
within the__update_params
method to include the newmodel_type
parameter.