← Graph

async

tool 9 connections

Newer Ruby concurrency framework based on fibers. Not available when David Halasz started his VNC proxy project; he notes he would probably use it today. Adam Okoń recommends async at wroclove.rb 2026 for LLM-heavy IO workloads: switching Active Job's adapter to async lets Rails jobs run on fibers, and the async gem exposes a barrier abstraction that schedules concurrent IO tasks until the system reaches ~80% load and cancels unbounded tasks past that. It also supports manual concurrency management via a semaphore for throttling outbound service calls. In Adam's production case async cut a workflow from above 50 seconds to 15–20 seconds.

category
library
about
async tool
Would have been the author's preferred choice if it had existed
Recommended for heavy IO-bound LLM workloads using fibers and the barrier abstraction.
about
async tool
Recommends adopting the async gem for LLM workflows.
Question specifically about async's performance characteristics.
Benchmarks compare UringMachine against the async fiber scheduler.
person Adam Okoń
recommends
async tool
Recommends async and fibers over threads for heavy IO-bound LLM workloads.
tool async
uses
Fiber Scheduler concept
async is a fiber-scheduler implementation.
tool Falcon
uses
async tool
Falcon is built on top of the async ecosystem.
works_on
async tool
Author of the async family of gems.
role: author

Provenance

Read by
22 extractions