11.4 Futures (original) (raw)
11.4 Futures🔗ℹ
Parallelism with Futures in The Racket Guide introduces futures.
Currently, parallel support for future is enabled by default for Windows, Linux x86/x86_64, and Mac OS x86/x86_64. To enable support for other platforms, use --enable-futures withconfigure when building Racket.
The future and touch functions fromracket/future provide access to parallelism as supported by the hardware and operating system. In contrast to thread, which provides concurrency for arbitrary computations without parallelism, future provides parallelism for limited computations. A future executes its work in parallel (assuming that support for parallelism is available) until it detects an attempt to perform an operation that is too complex for the system to run safely in parallel. Similarly, work in a future is suspended if it depends in some way on the current continuation, such as raising an exception. A suspended computation for a future is resumed when touch is applied to the future.
“Safe” parallel execution of a future means that all operations provided by the system must be able to enforce contracts and produce results as documented. “Safe” does not preclude concurrent access to mutable data that is visible in the program. For example, a computation in a future might use set! to modify a shared variable, in which case concurrent assignment to the variable can be visible in other futures and threads. Furthermore, guarantees about the visibility of effects and ordering are determined by the operating system and hardware—which rarely support, for example, the guarantee of sequential consistency that is provided for thread-based concurrency; see also Machine Memory Order. At the same time, operations that seem obviously safe may have a complex enough implementation internally that they cannot run in parallel. See also Parallelism with Futures in The Racket Guide.
A future never runs in parallel if all of the custodians that allow its creating thread to run are shut down. Such futures can execute through a call to touch, however.
11.4.1 Creating and Touching Futures🔗ℹ
The future procedure returns a future value that encapsulatesthunk. The touch function forces the evaluation of the thunk inside the given future, returning the values produced by thunk. After touch forces the evaluation of a thunk, the resulting values are retained by the future in place of thunk, and additional touches of the future return those values.
Between a call to future and touch for a given future, the given thunk may run speculatively in parallel to other computations, as described above.
Example:
Returns whether parallel support for futures is enabled in the current Racket configuration.
Returns the descriptor of the future whose thunk execution is the current continuation; that is, if a future descriptor f is returned,(touch f) will produce the result of the current continuation. If a future thunk itself uses touch, future-thunk executions can be nested, in which case the descriptor of the most immediately executing future is returned. If the current continuation does not return to the touch of any future, the result is#f.
Returns #t if v is a future value, #fotherwise.
Returns a future that never runs in parallel, but that consistently logs all potentially “unsafe” operations during the execution of the future’s thunk (i.e., operations that interfere with parallel execution).
With a normal future, certain circumstances might prevent the logging of unsafe operations. For example, when executed with debug-level logging,
might log three messages, one for each printfinvocation. However, if the touch is performed before the future has a chance to start running in parallel, the future thunk evaluates in the same manner as any ordinary thunk, and no unsafe operations are logged. Replacing future with would-be-futureensures the logging of all three calls to printf.
Returns the number of parallel computation units (e.g., processors or cores) that are available on the current machine.
This is the same binding as available from racket/place.
(for/async (for-clause ...) body-or-break ... body) (for*/async (for-clause ...) body-or-break ... body)
Like for and for*, but each iteration of thebody is executed in a separate future, and the futures may be touched in any order.
11.4.2 Future Semaphores🔗ℹ
Creates and returns a new future semaphore with the counter initially set to init.
A future semaphore is similar to a plain semaphore, but future-semaphore operations can be performed safely in parallel (to synchronize parallel computations). In contrast, operations on plain semaphoresare not safe to perform in parallel, and they therefore prevent a computation from continuing in parallel.
Beware of trying to use an fsemaphore to implement a lock. A future may run concurrently and in parallel to other futures, but a future that is not demanded by a Racket thread can be suspended at any time—such as just after it takes a lock and before it releases the lock. If you must share mutable data among futures, lock-free data structures are generally a better fit.
Returns #t if v is an future semaphorevalue, #f otherwise.
Increments the future semaphore’s internal counter and returns #.
Blocks until the internal counter for fsema is non-zero. When the counter is non-zero, it is decremented andfsemaphore-wait returns #.
Like fsemaphore-wait, but fsemaphore-try-wait?never blocks execution. If fsema’s internal counter is zero,fsemaphore-try-wait? returns #f immediately without decrementing the counter. If fsema’s counter is positive, it is decremented and #t is returned.
Returns fsema’s current internal counter value.
11.4.3 Future Performance Logging🔗ℹ
Racket traces use logging (see Logging) extensively to report information about how futures are evaluated. Logging output is useful for debugging the performance of programs that use futures.
Though textual log output can be viewed directly (or retrieved in code via trace-futures), it is much easier to use the graphical profiler tool provided byfuture-visualizer.
Future events are logged with the topic 'future. In addition to its string message, each event logged for a future has a data value that is an instance of a future-event prefab structure:
The future-id field is an exact integer that identifies a future, or it is #f when action is'missing. The future-id field is particularly useful for correlating logged events.
The proc-id fields is an exact, non-negative integer that identifies a parallel process. Process 0 is the main Racket process, where all expressions other than future thunks evaluate.
The time field is an inexact number that represents time in the same way as current-inexact-milliseconds.
The action field is a symbol:
- 'create: a future was created.
- 'complete: a future’s thunk evaluated successfully, so that touch will produce a value for the future immediately.
- 'start-work and 'end-work: a particular process started and ended working on a particular future.
- 'start-0-work: like 'start-work, but for a future thunk that for some structural reason could not be started in a process other than 0 (e.g., the thunk requires too much local storage to start).
- 'start-overflow-work: like 'start-work, where the future thunk’s work was previously stopped due to an internal stack overflow.
- 'sync: blocking (processes other than 0) or initiation of handing (process 0) for an “unsafe” operation in a future thunk’s evaluation; the operation must run in process 0.
- 'block: like 'sync, but for a part of evaluation that must be delayed until the future istouched, because the evaluation may depend on the current continuation.
- 'touch (never in process 0): like 'sync or'block, but for a touch operation within a future thunk.
- 'overflow (never in process 0): like 'sync or'block, but for the case that a process encountered an internal stack overflow while evaluating a future thunk.
- 'result or 'abort: waiting or handling for'sync, 'block, or 'touch ended with a value or an error, respectively.
- 'suspend (never in process 0): a process blocked by'sync, 'block, or 'touch abandoned evaluation of a future; some other process may pick up the future later.
- 'touch-pause and 'touch-resume (in process 0, only): waiting in touch for a future whose thunk is being evaluated in another process.
- 'missing: one or more events for the process were lost due to internal buffer limits before they could be reported, and the time-id field reports an upper limit on the time of the missing events; this kind of event is rare.
Assuming no 'missing events, then 'start-work,'start-0-work, 'start-overflow-work is always paired with 'end-work;'sync, 'block, and 'touch are always paired with 'result, 'abort, or 'suspend; and'touch-pause is always paired with 'touch-resume.
In process 0, some event pairs can be nested within other event pairs:'sync, 'block, or 'touch with'result or 'abort; 'touch-pause with'touch-resume; and 'start-work with 'end-work.
A 'block in process 0 is generated when an unsafe operation is handled. This type of event will contain a symbol in theunsafe-op-name field that is the name of the operation. In all other cases, this field contains #f.
The prim-name field will always be #f unless the event occurred on process 0 and its action is either 'block or 'sync. If these conditions are met, prim-name will contain the name of the Racket primitive which required the future to synchronize with the runtime thread (represented as a symbol).
The user-data field may take on a number of different values depending on both the action and prim-name fields:
- 'touch on process 0: contains the integer ID of the future being touched.
- 'sync and prim-name is '|allocate memory|: The size (in bytes) of the requested allocation.
- 'sync and prim-name is 'jit_on_demand: The runtime thread is performing a JIT compilation on behalf of the future future-id. The field contains the name of the function being JIT compiled (as a symbol).
- 'create: A new future was created. The field contains the integer ID of the newly created future.