zlik/magento-resque

Magento Upgrade Resque allows to organize a queue of SQL queries and use multiple workers to execute them in parallel during Magento upgrade.

Maintainers

Details

github.com/zlik/magento-resque

Homepage

Source

Issues

Installs: 8

Dependents: 0

Suggesters: 0

Security: 0

Stars: 3

Watchers: 4

Forks: 1

Open Issues: 0

0.1.0 2015-04-02 07:13 UTC

Requires

MIT 20029e59499b290067c0d1c43d358415ccaa9e7f

This package is auto-updated.

Last update: 2024-04-13 03:33:04 UTC

README

The main idea for the fast Magento database upgrade was to run SQL queries in parallel. This approach was first introduced in Magento Upgrade Replay project.

Magento Resque is an utility intended to be used as an extendible standalone solution for SQL queries paralell execution during Magento upgrade.

It's nothing more than a tiny wrapper around PHP Resque – a Radis-backed library for creating jobs, placing them into a queue and processing by workers. Please reffer to https://github.com/chrisboulton/php-resque for detailed documentation.

Please note: there is a similar project for using PHP Resque with Magento we are not associated with called mage-resque. The main and the only purpose of our tool is to help speed up Magento DB upgrade, while mage-resque is all-purpose. Feel free to check it out.

Magento Resque basically implements two classes:

Queue – reads SQL queries from the specified file, wraps them into Resque jobs and enqueues the jobs in the Redis queue.

Job – run by workers. Instantiates Magento DB adapter and runs SQL queries wrapped into the job.

Installation

The easiest way to install Magento Resque is using Composer.

Create shell/magento-resque/composer.json file under Magento root directory.

Include Magento Resque to your project:

composer require zlik/magento-resque

Run composer install.

Usage Example

Change the current working directory to demo.

To enqueue SQL queries from the sql/queries.sql file to the upgrade queue run the following command:

$ php resque.php sql/queries.sql

To launch eight simultaneous workers:

$ QUEUE='upgrade' COUNT=8 ../vendor/bin/resque

The result should be like this:

[notice] Starting work on (Job{upgrade} | ID: 1 | Job | [{"q":"CREATE TABLE `resque_test_1` ..."}])
[notice] Starting work on (Job{upgrade} | ID: 2 | Job | [{"q":"CREATE TABLE `resque_test_2` ..."}])
[notice] (Job{upgrade} | ID: 2 | Job | [{"q":"CREATE TABLE `resque_test_2` ..."}]) has finished
[notice] (Job{upgrade} | ID: 1 | Job | [{"q":"CREATE TABLE `resque_test_1` ..."}]) has finished

##Requirements

PHP Redis requires

  • PHP 5.3+
  • Redis 2.2+