feat: Add comment field to langfuse Evaluation from autoevals metadata (#1452)

rmaceissoft · hassiebp · ellipsis-dev[bot] · web-flow · commit 2f0da0b2ff13 · 2025-12-01T15:22:43.000+01:00
* feat: update create_evaluator_from_autoevals to add comment field to langfuse Evaluation from autoevals metadata

* Update langfuse/experiment.py

Co-authored-by: ellipsis-dev[bot] &lt;65095814+ellipsis-dev[bot]@users.noreply.github.com&gt;

---------

Co-authored-by: Hassieb Pakzad &lt;68423100+hassiebp@users.noreply.github.com&gt;
Co-authored-by: ellipsis-dev[bot] &lt;65095814+ellipsis-dev[bot]@users.noreply.github.com&gt;
diff --git a/langfuse/experiment.py b/langfuse/experiment.py
@@ -1039,7 +1039,10 @@ def langfuse_evaluator(
         )
 
         return Evaluation(
-            name=evaluation.name, value=evaluation.score, metadata=evaluation.metadata
+            name=evaluation.name,
+            value=evaluation.score,
+            comment=(evaluation.metadata or {}).get("comment"),
+            metadata=evaluation.metadata,
         )
 
     return langfuse_evaluator

Original file line number	Diff line number	Diff line change
`@@ -1039,7 +1039,10 @@ def langfuse_evaluator(`
`1039`	`1039`	`)`
`1040`	`1040`
`1041`	`1041`	`return Evaluation(`
`1042`		`- name=evaluation.name, value=evaluation.score, metadata=evaluation.metadata`
	`1042`	`+ name=evaluation.name,`
	`1043`	`+ value=evaluation.score,`
	`1044`	`+ comment=(evaluation.metadata or {}).get("comment"),`
	`1045`	`+ metadata=evaluation.metadata,`
`1043`	`1046`	`)`
`1044`	`1047`
`1045`	`1048`	`return langfuse_evaluator`