Eventbox
Manage multithreading with the safety of event based programming
Eventbox is a model of concurrent computation that is used to build thread-safe objects with arbitrary interfaces. It is kind of advancement of the well known actor model leveraging the possibilities of the ruby language. It is a small, consistent but powerful threading abstraction which integrates well into existing environments.
Eventbox objects are event based and single threaded from the inside but thread-safe and blocking from the outside. Eventbox enforces a separation of code for event processing and code running blocking operations. Code inside an Eventbox object is executed non-concurrently and hence shouldn’t do any blocking operations. This is similar to the typical JavaScript programming style.
On the other hand all blocking operations can be executed in action threads spawned by the action method type. Communication between actions, event processing and external environment is done through ordinary method and lambda calls. They arbitrate between blocking versus event based scheme and ensure thread-safety.
An important task of Eventbox is to avoid race conditions through shared data. Such data races between event scope and external/action scope are avoided through filters applied to all inputs and outputs. That way Eventbox guarantees stable states while event processing without a need for any locks.
Requirements
- Ruby-2.3 or newer or
- JRuby 9.1 or newer
Installation
Add this line to your application’s Gemfile:
“by gem ‘eventbox’
“
And then execute:
$ bundle
Or install it yourself as:
$ gem install eventbox
Usage
Eventbox is an universal approach to build thread-safe objects. It can therefore be used to build well known multithread abstractions like a Queue class:
“by require “eventbox” class MyQueue < Eventbox # Called at MyQueue.new just like Object#initialize in ordinary ruby classes async_call def init @que = [] # List of values waiting for being fetched by deq @waiting = [] # List of blocking deq calls waiting for new values to be pushed by enq end
# Push a value to the queue - async methods always return immediately async_call def enq(€value) # €-variables are passed through as reference instead of copies @que « €value # Push the value to the queue if [email protected] # Is there a thread already waiting for a value? w.yield @que.shift # Let the waiting `deq' call return the oldest value in the queue end end
# Fetch a value from the queue or suspend the caller until a value has been enqueued # yield methods are completely processed, but return not before a result has been yielded yield_call def deq(result) if @que.empty? @waiting « result # Don’t return a value now, but enqueue the request as waiting else result.yield @que.shift # Immediately return the next value from the queue end end end
“
A picture describes it best:
Although there are no mutex or condition variables in use, the implementation is thread-safe. This is due to the wrapping that is activated by async_call and yield_call prefixes. The yield_call method definition divides the single external call into two internal events: The event of the start of call and the event of releasing the call with a return value. In contrast async_call defines a method which handles one event only - the start of the call: The external call completes immediately and always returns self
.
The branch in Queue#deq
shows a typical decision taking in Eventbox: If the call can be processed immediately it yields the result, else wise the result is added to an internal list to be processes later. This list must be checked at each event which could signal the ability to complete the enqueued processing. This is done in Queue#enq
in the above example.
Our new queue class unsurprisingly has semantics like ruby’s builtin Queue implementation:
“by q = MyQueue.new Thread.new do 5.times do |i| q.enq i # Enqueue integers 0 to 4 end end
5.times do p q.deq # Fetch and print 5 integers from the queue end
It gives the following output:
0 1 2 3 4
“
If you just need a queue it’s better to stay at the Queue implementations of the standard library or concurrent-ruby. However if you want to cancel items in the queue for example, you need more control about waiting items or waiting callers than common thread abstractions offer. The same if you want to query and visualize the internal state of processing (the pending items in the queue).
Hands on
The following examples illustrate most important aspects of Eventbox. It is recommended to work them through, in order to fully understand how Eventbox can be used to implement all kind of multi-threaded applications.
- HTTP client - Understand how to use actions to build a HTTP client which downloads several URLs in parallel.
- TCP server - Understand how to startup and shutdown blocking actions and to combine several Eventbox classes to handle parallel connections.
- Thread-pool - Understand how parallel external requests can be serialized and scheduled.
Seeing curly braces instead of links? Switch to the API documentation.
Method types
Event Scope
Eventbox offers 3 different types of external callable methods:
- yield_call defines a blocking or non-blocking method with return value. It is the most flexible call type.
- sync_call is a convenience version of
yield_call
for a non-blocking method with return value. - async_call is a convenience version of
yield_call
for a non-blocking method without return value.
They can be defined with private
, protected
or public
visibility. The method body is referred to as “event scope” of a given Eventbox object. Code in the event scope is based on an event driven programming style where events are signaled by method calls or by callback functions.
The event scope shouldn’t be used to do blocking operations. There is no hard criteria for what is considered a blocking operation, but since event scope methods of one object don’t run concurrently, it decreases the overall responsiveness of the Eventbox instance. If the processing time of an event scope method or block exceeds the limit of 0.5 seconds, a warning is print to STDERR
. This limit can be changed by Eventbox.with_options.
Arguments of async, sync and yield calls can be prefixed by a €
sign. This marks them as to be passed through as reference, instead of being copied. A €
-variable is wrapped and protected within the event scope, but unwrapped when passed to action or external scope. It can be called within the event scope by Eventbox::ExternalObject#send.
In addition there are accessor methods usable as known from ordinary ruby objects: attr_reader, attr_writer and attr_accessor. They allow thread-safe access to instance variables.
Beside async_call, sync_call and yield_call methods it’s possible to define plain private
methods, since they are not accessible externally. However any plain public
or protected
methods within Eventbox classes are rejected.
Seeing curly braces instead of links? Switch to the API documentation.
Action Scope
Action methods are very different from the above. They run concurrently to all event scope methods within their own thread. Although actions reside within the same class they don’t share instance variables with the event scope. However they can safely call all instance methods. The method body is referred to as “action scope”.
Eventbox doesn’t provide specific methods for asynchronous IO, but relies on ruby’s builtin methods or gems for this purpose. The intention is, that IO or any other blocking calls are done through action methods. In contrast to event scope, they should not share any data with other actions or threads. Instead a shared-nothing approach is the recommended way to build actions. That means, that all data required for one particular action call, should be passed as arguments, but nothing more. And all data generated by the action should be passed as arguments back to event scope methods and the outcome should be managed there.
Some data shall just be managed as reference in some scope without being accessed there. Or it is passed through a given scope only. In such cases it can be marked as shared_object. This wrapping is similar to €
argument variables, however shared_object it more versatile. It marks objects permanently and wraps them even when they are stored inside of a copied object.
External scope
Code outside of the Eventbox class is referred to as “external scope”. The external scope is recognized as one common space.
External objects can be directly called from action scope, since they are unwrapped when passed from event to action scope. In this case the object to be called should be thread-safe. See also What is safe and what isn’t? below.
External objects can also be called from event scope per Eventbox::ExternalObject#send, but with some restrictions. The same restrictions apply to external closures too, which are callable from event scope per Eventbox::ExternalProc#call.
Block and Proc types
Similary to the 3 method calls above there are 3 types of proc objects which act as anonymous counterparts of the method call types.
- yield_proc allocates a blocking or non-blocking proc object with a return value. It is the most flexible proc type.
- sync_proc is a convenience version of yield_proc for a non-blocking code block with return value.
- async_proc is a convenience version of yield_proc for a non-blocking code block without return value.
These proc objects can be created within event scope, can be passed to external scope and called from there.
Arguments of async, sync and yield procs can be prefixed by a €
sign. In that case, they are passed as reference, equally to €
-variables of async_call, sync_call and yield_call methods.
The other way around - Proc objects or blocks which are defined in external or action scope - can be passed to event scope. Such a Proc object is wrapped as a Eventbox::ExternalProc object within the event scope. There it can be called as usual - however the execution of the proc doesn’t stall the Eventbox object. Instead the event scope method is executed until its end, while the block is executed within the thread which has called the current event scope method. Optionally the block can be called with a completion block as the last argument, which is called with the result of the external proc when it has finished.
Exceptions
Eventbox makes use of exceptions in several ways.
All exceptions raised within the event scope are passed to the internal or external caller, like in ordinary ruby objects. It’s also possible to raise deferred exceptions through the result proc of a yield_call or yield_proc. See the Eventbox::CompletionProc#raise method.
Exceptions raised in the action scope are not automatically passed to a caller, but must be handled appropriately by the Eventbox instance. It is recommended to handle exceptions in actions similar to the following, unless you’re very sure, that no exception happens:
“by action def start_connection(host, port) sock = TCPSocket.new(host, port) rescue => err conn_failed(err) else conn_succeeded(sock) end
async_call def conn_succeeded(sock) # handle the success event (e.g. start communication by another action) end
async_call def conn_failed(error) # handle the failure event (retry or similar) end
“
Alternatively closures can be passed to the action which are called in case of success or failure. See the download example for more description about this variation.
Another use of exceptions is for sending signals to running actions. This is done by Eventbox::Action#raise.
What is safe and what isn’t?
At each transition of the scope all passing objects are sanitized by the Eventbox::Sanitizer. It protects the event scope from data races and arbitrates between blocking and event based semantics. This is done by copying or wrapping the objects conveniently as described in the Eventbox::Sanitizer. That way event scope methods never get an inconsistent state regardless of the activities of external threads.
Obviously it’s not safe to do things like using send
to call private methods from external, access instance variables per instance_variable_set
or use class or global variables in a multithreading context. Such rough ways of communication with an Eventbox object are surely neither recommended nor supported. Other than these the event scope of an Eventbox instance is pretty well protected against accident mistakes.
However there’s a catch which needs to take note of: It is not restricted to access any constants from event scope. Therefore it’s possible to call for example Thread.new
within the event scope. Unsurprisingly is a very bad idea, since the provided block is called with no synchronization and can therefore lead to all kind of threading issues. It would be safe to call Thread.new
with an async_proc, however since the proc is not allowed to do any blocking operations, it’s recommended to use an action method definition instead to spawn threads.
Also note that Eventbox doesn’t protect external scope or action scope from threading issues. The external scope is recognized as one common space. External libraries and objects must be thread-safe on its own if used from different threads in external or action scope. Protecting them is beyond the scope of Eventbox.
Object distribution and persistence
Eventbox objects can be serialized to be stored persistent or distributed across the network. This allows the utilization by job schedulers, messaging libraries and distributed object systems. However there are the following restrictions:
- Only objects without running actions can be serialized, since running code can not be serialized.
- Objects with a custom thread-pool can be serialized only, when the thread-pool can be serialized.
- Objects with guard_time set to a Proc object can not be serialized.
Time based events
Although timer events can be easily generated by an action with a sleep
function, they are so common, that Eventbox bundles a dedicated timer module for scheduling timer events. It can be included into Eventbox classes by:
“by include Eventbox::Timer
“
It offers Eventbox::Timer#timer_after and Eventbox::Timer#timer_every functions to schedule blocks to be called. See the Eventbox::Timer module for further description.
Derived classes and mixins
Eventbox classes can be derived like ordinary ruby classes - there are no restrictions specific to Eventbox. Methods of base classes can be called by super
. All classes of the hierarchy share the same instance variables like ordinary ruby objects. Only action methods use their own variable space.
It’s also possible to mix a module into the Eventbox class. See the description of Eventbox::Boxable for how it works.
When to use Eventbox?
Eventbox comes into play when things are getting more complicated or more customized. For instance a module which shall distribute work orders to external processes. When it shall visualize the progress and allow cancellation of orders, available abstractions don’t fit well to the problem.
In such a case Eventbox helps to manage a consistent state about these running activities. It also allows to query this state in a natural way, since states can be stored in plain ruby objects (arrays, hashs, etc) instead of specialized thread abstractions.
While not impossible to implement things per raw threads, mutexes and condition variables, it’s pretty hard to do that right. There are no tools to verify correct usage of mutexes or other threading abstractions in ruby. However threading errors are subtle, so you’ll probably not notice mistakes, until going to production.
Due to Eventbox’s checks and guaranties it’s easier to verify and prove correctness of implementations running on top of it. This was the primary motivation to develop this library.
Comparison with other threading abstractions
The Actor model
Eventbox is kind of advancement of the well known actor model leveraging the possibilities of the ruby language. While the actor model uses explicit message passing, Eventbox relies on method calls, closure calls and exceptions, which makes it much more natural to use. Unlike an actor, Eventbox doesn’t start a thread per object, but uses the thread of the caller to execute non-blocking code. This makes instantiation of Eventbox objects cheaper than Actor objects. Instead it can create and manage in-object private threads in form of actions to be used for blocking operations.
Many actor implementations manage an inheritance tree of actor objects. Parent actors are then notified about failures of child actors. In contrast Eventbox objects maintain a list of all running internal actions instead, but are completely independent from each other. Failures are handled either object internal or by the caller - see chapter Exceptions above.
Internal state
Eventbox keeps all instance variables in a consistent state as a whole. This is an important difference to thread-safe collections like Concurrent::Hash
. They mislead the developer to believe that a module is thread-safe when it’s just using these classes.
Unfortunately this is often wrong: They require a lot of experience to avoid mistakes through non-atomic updates, non-atomic test-and-set operations or race-conditions through using several thread-safe objects in combination (although a consistent state is only managed on a per object base).
Data races
Most thread abstractions don’t do deeper checks for wrong usage of data. In particular they don’t protect from data races like Eventbox does. Ruby doesn’t (yet) have mechanisms to bind objects to threads, so that there’s no builtin safety.
Blocking and non-blocking scope
Beside this, Eventbox has an explicit specification where blocking and where non-blocking code has to be executed and the compliance is monitored. This ensures that events are processed in time regardless of the current state. Such a specification is not enforced by most other threading abstractions and can quickly lead to delayed reactions in particular situations.
No global states
Eventbox doesn’t manage or use any global states other than class definitions. Even configuration options are handled on a class basis. This is why Eventbox can be combined with other threading abstractions and integrated in any applications without side effects. Vice versa Eventbox objects can easily replaced by other threading abstractions, if these fit better.
Comparison with other async libraries
Eventbox doesn’t implement any own IO or other kinds of blocking operations. Instead it encourages the use of blocking operations and threads for things which should run in parallel, while keeping the management code in safe internal methods written in an event based style. Because IO is done in action threads, the only type of events handled by the event scope are method or closure calls received from actions or external. They are processed by a kind of local event loop which runs one per Eventbox object.
This is in contrast to libraries like async, EventMachine or Celluloid which provide dozens of IO wrappers. Due to these differences the focus of Eventbox is on a consistent, solid and accurate core that developers can rely on. Intentionally there is no ecosystem around Eventbox.
Eventbox performance
Eventbox is reasonably fast, but far from the performance of low level threading primitives (like implemented in concurrent-ruby ). It is not written to minimize resource consumption or maximize performance or throughput. Instead it is written to minimize race conditions and implementation complexity in a multithreaded environment. And it is written to act as a solid and consistent foundation for a wide range of concurrent computation problems.
So if your use case requires raw performance more than implementation safety, Eventbox is probably not the right tool.
Still there is lots of room for performance improvements in Eventbox, like faster method invocations or copy-on-write objects. If there’s a stronger interest in Eventbox performance, it’s even possible to source relevant parts out to a C extension. The introduction of guilds in ruby will probably be helpful for Eventbox as well.
Contributing
Bug reports and pull requests are welcome on GitHub at https://github.com/larskanis/eventbox. This project is intended to be a safe, welcoming space for collaboration, and contributors are expected to adhere to the Contributor Covenant code of conduct.
License
The gem is available as open source under the terms of the MIT License.
Code of Conduct
Everyone interacting in the Eventbox project’s codebases, issue trackers, chat rooms and mailing lists is expected to follow the code of conduct.