We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
There was an error while loading. Please reload this page.
1 parent 4e219bf commit 33c747fCopy full SHA for 33c747f
generative_ai/evaluation/pairwise_summarization_quality.py
@@ -52,7 +52,7 @@ def evaluate_output() -> EvalResult:
52
eval_dataset = pd.DataFrame({"prompt": [prompt]})
53
54
# Baseline model for pairwise comparison
55
- baseline_model = GenerativeModel("gemini-2.0-flash-001")
+ baseline_model = GenerativeModel("gemini-2.0-flash-lite-001")
56
57
# Candidate model for pairwise comparison
58
candidate_model = GenerativeModel(
0 commit comments