Commit 1bdf927
committed
fix(v3): adopt v4 dequeue strategy to increase perf
We will now dequeue into a redis list as many messages as we possibly
can from actual queues, trying to dequeue up to 10 runs at a time for
each queue in an env, in separate queue consumers. Then the
SharedQueueConsumer can simply `lpop` off that list and process a run to
be dequeued very quickly. This should get runs through the platform side
dequeue system very quickly.1 parent 5b40c44 commit 1bdf927
File tree
5 files changed
+319
-110
lines changed- apps/webapp/app
- v3/marqs
5 files changed
+319
-110
lines changed| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
410 | 410 | | |
411 | 411 | | |
412 | 412 | | |
| 413 | + | |
| 414 | + | |
413 | 415 | | |
414 | 416 | | |
415 | 417 | | |
| |||
0 commit comments