Commit a182584
committed
Pass timeout to OpenAI client object
Not doing this makes client use the default 10 minute timeout. It causes client to stop generation after 10 minutes even if timeout option is higher, making models with slow inference unusable.1 parent bc66c5b commit a182584
1 file changed
+1
-0
lines changed| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
38 | 38 | | |
39 | 39 | | |
40 | 40 | | |
| 41 | + | |
41 | 42 | | |
42 | 43 | | |
43 | 44 | | |
| |||
0 commit comments