Fieldnotes / engineering
← Queues and backpressure

Watch & compare

Queues and backpressure

Different ways to see the same idea. Play one cut at a time, then return to the guide to try it yourself.

Why we recommend Queued ≠ complete

Use Astra as the chapter entry: it follows F from blocked submission through admission, execution and completion in the guide’s documentation-check/search-tool setting. Baseline offers a spare producer–worker view and now visibly continues service at the end, while Sol adds the complementary refusal-and-resubmission policy with acknowledgement-controlled delivery credit. Astra’s larger queue cells and explicit Done 6/6 ending make admission versus completion easiest to verify on a phone.

Revised original · 26 sec

Backpressure — bounded queue

Queues buffer work, while backpressure limits incoming work when consumers cannot keep up.

Read the video sequence
  1. 0–9s: Worker A runs while B, C and D fill the bounded queue. A FULL signal travels to the producer.
  2. 10–14s: The producer pauses with E waiting outside the full queue; the worker continues.
  3. 15.5–19s: Taking B frees a slot. The producer resumes and admits E.
  4. 21–26s: C leaves the queue and completes. D then leaves and is still running as the scene fades, with E waiting and three jobs completed. This is continued service, not completion of the whole batch.
About this cut

Production: Original prototype; model not recorded.

Revision: gpt-6-astra comparative review.

Generic finite producer/worker example; five jobs, three waiting slots and one worker.

Ends with work in progress; no delivery, durability, rate or deadline guarantee.

Original model was not recorded; this correction does not establish authorship.

Audio analysed, not listened to.

Recommended · Astra · 30 sec

Queued ≠ complete

A full queue can delay an agent tool submission; a free place admits the job, but admission is not successful tool completion.

Read the video sequence
  1. 0–5.5s A documentation-check agent submits search job A. It passes through the queue, runs on the single tool worker, and completes normally.
  2. 5.5–10.8s Search job B runs slowly. C, D and E fill all three waiting places while B continues.
  3. 10.8–15s The full-queue signal pauses the agent with job F held outside the queue. F has not been admitted; existing tool work continues.
  4. 15–19.8s After B completes, removing C frees a place. The agent resumes and submits F. F is now queued, while C is running; admission has not completed F.
  5. 19.8–25.6s F stays queued while earlier search jobs finish. Only after D and E have run does F leave its waiting place for the tool worker.
  6. 25.6–30s F runs and its progress bar fills. Its state changes to complete only after execution finishes. The queue is empty and all six jobs have outcomes. This finite example is not a delivery or timing guarantee.
About this cut

Production: gpt-6-astra.

Illustrative finite batch with one worker and three waiting places; job durations are not benchmarks.

FULL and SPACE visualize local admission feedback, not RabbitMQ protocol messages or acknowledgements.

Bounding waiting items does not guarantee bounded memory, request rate, deadlines, permissions, durability or exactly-once effects.

Audio was checked by waveform, spectrum, cue timing and encoded peak analysis; it was not physically listened to.

This is an author-reviewed alternative, not a comparative recommendation.

Alternative · Sol · 30 sec

Bound the backlog

Bound waiting agent work at intake as well as active deliveries; acknowledge completion before the next delivery, and resume admission when a waiting slot is free.

Read the video sequence
  1. 0–7.4s Normal work: task A enters an empty queue, runs on one agent, finishes, and sends an acknowledgement back. The example uses illustrative limits of one active task and three waiting tasks. Active execution falls to zero on completion; acknowledgement releases delivery credit separately.
  2. 7.4–15.3s A burst arrives while task B runs slowly. Tasks C, D and E fill the three waiting slots. The runner still executes only one task, but its execution limit has not prevented the waiting queue from filling.
  3. 15.3–21s The full intake gate refuses task F and returns it to the caller. F remains deferred outside the queue, and the caller pauses new intake. The queued tasks remain visible while B continues running.
  4. 21–23.6s B completes, active execution falls to zero, and its acknowledgement returns to release delivery credit. C then leaves the first queue slot for the runner. Waiting work falls from three tasks to two, so the application intake gate reopens.
  5. 23.6–30s The caller deliberately resubmits F once. F occupies the free slot, the queue returns to three waiting tasks, and intake closes again while C runs. Work stays bounded even though demand remains. The stage fades to the opening title. Runtime code must enforce the limits; persistent prompts do not enforce permissions.
About this cut

Production: gpt-6.1-sol.

Revision: gpt-6-astra comparative review.

Illustrative runtime policy: one active task and three waiting tasks are not performance measurements or recommended defaults.

The application admission gate is separate from RabbitMQ prefetch; enforce waiting capacity atomically in runtime code.

One producer and successful reliable delivery are assumed; failures, durable deferral, redelivery, deadlines and concurrent admission races are omitted.

Persistent prompts do not enforce queue bounds or tool permissions, and these limits do not guarantee output quality or completion time.

Audio was analysed for peak, cue energy and synchronization; it was not physically listened to.

These animations use sound effects rather than narration. The written guide explains the mechanism and its limits. Model names describe how a cut was made, not a quality ranking.

What the review found