Skip to content

Commit e3c842d

Browse files
authored
Expose prediction IDs for model code (#2591)
Signed-off-by: Nikhil Sinha <nikhil@replicate.com>
1 parent c29e6b7 commit e3c842d

File tree

1 file changed

+5
-0
lines changed

1 file changed

+5
-0
lines changed

python/cog/server/runner.py

Lines changed: 5 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -113,6 +113,11 @@ def predict(
113113
else:
114114
payload = prediction.input.copy()
115115

116+
if prediction.context is None:
117+
prediction.context = {}
118+
if prediction.id is not None:
119+
prediction.context["id"] = prediction.id
120+
116121
sid = self._worker.subscribe(task.handle_event, tag=tag)
117122
task.track(self._worker.predict(payload, context=prediction.context, tag=tag))
118123
task.add_done_callback(self._task_done_callback(tag, sid))

0 commit comments

Comments
 (0)