fervo / deferred-event-bundle
Defer your events to another process (via FastCGI)
Installs: 93 462
Dependents: 0
Suggesters: 0
Security: 0
Stars: 43
Watchers: 10
Forks: 10
Open Issues: 4
Type:symfony-bundle
Requires
- php: >=5.4
- symfony/console: ~3.0
- symfony/event-dispatcher: ~3.0
- symfony/framework-bundle: ~3.0
Suggests
- musicglue/sidekiq-job-pusher: dev-master
- redeye/sidekiq-bundle: Simplifies the configuration of your Sidekiq client
- videlalvaro/php-amqplib: To enable pushing to a AMQP compatible queue like RabbitMQ. Use version 2.3.0 or above
This package is auto-updated.
Last update: 2024-11-12 04:10:35 UTC
README
This bundle allows you to run asynchronous background processes in PHP. You don't need a PHP-daemon nor do you have to create a new php process for each job (which is expensive). We use PHP-FPM because it solves the performance and stability issues for us.
I wrote a blog entry with the reasoning behind this bundle, which you may want to read.
Caveat
This project is no longer actively developed by Fervo. We're still willing to merge PRs, but we're moving away from this internally. If you have a vested interest in this project and want to adopt it, contact us at magnus@fervo.se.
Usage
You can defer events in two ways. You can decide when you dispatch an event that it should be deferred or you could let some listeners to decide if they should be deferred or not. In both cases we dispatch the event and put the job on a message queue.
As if by magic, at some later time, a worker will dispatch your event to your listeners. Pretty much the only caveats you'll need to keep in mind is that it is in another process, and that the code isn't executing in the request scope anymore.
Let the listeners decide
Just tag your listener with fervo_deferred_event.listener
instead of kernel.event_listener
,
and the bundle will do the rest. Simple as pie.
Let the publisher decide
If you want all listeners to a event to be executed in a different thread you must wrap your Event in a DeferEvent. Then use the event dispatcher and dispatch 'fervo.defer'.
$event = new DeferEvent('foo.action', new MyEvent()); $this->get('event_dispatcher')->dispatch('fervo.defer', $event);
Setup
Server software
You need to install a message queue and a worker. The worker will pull jobs from the message queue and initiate the execution.
Currently we do support all message queues that support AMQP and Sidekiq.
Here is a list of workers:
- fervo/deferred-event-worker written in Ruby.
- HappyR/DeferredEventJavaWorker written in Java.
Symfony setup
Add the bundle to your composer file, as well as well as your AppKernel. Configure the bundle as follows:
# Sidekiq example
fervo_deferred_event:
backend:
type: sidekiq
sidekiq_client_service: sidekiq_client
# Java/AMQP example:
fervo_deferred_event:
backend:
type: amqp
amqp_config:
host: "localhost" #default
port: 5672 #default
batch_publishing: false #can only be true if you are using videlalvaro/php-amqplib v.2.2.0 or above
message_headers:
fastcgi_host: "localhost" #default
fastcgi_port: 9000 #default
You do also need to setup one of the following (depending on you backend type):
- musicglue/sidekiq-job-pusher. Set up a client service, and pass it into the configuration.
- videlalvaro/php-amqplib. Just add it to your composer.json.
Error handling
The Java worker we take care of errors. When a worker unexpectedly terminates we will save the message and the error message on a separate queue. You may subscribe to that queue to log the error and to retry executing the job.