cleaniquecoders/data-migration

This package allows data migration from one source to another

1.1.0 2024-03-21 04:09 UTC

Requires

• php: ^8.1 | ^8.2 | ^8.3
• illuminate/contracts: ^10.0 | ^11.0
• spatie/laravel-package-tools: ^1.14.0

Requires (Dev)

• laravel/pint: ^1.0
• nunomaduro/collision: ^7.9
• orchestra/testbench: ^8.0 | ^9.0
• pestphp/pest: ^2.0
• pestphp/pest-plugin-arch: ^2.0
• pestphp/pest-plugin-laravel: ^2.0

MIT

• Nasrul Hazim Bin Mohamad

• laravel
• cleaniquecoders
• data-migration

README

This package allows data migration from one source to another.

Installation

At the moment, we only provide table-to-table migration. We are not yet implementing column mapping, or data transformation at this point in time.

You can install the package via composer:

composer require cleaniquecoders/data-migration

You can publish the config file with:

php artisan vendor:publish --tag="data-migration-config"

Configure the connections to the database that you need to migrate from (the source) and it's destination in the config/data-migration.php in connections key.

Once that completed, update the tables configuration in config/data-migration.php. This is the mapping of the data migration from source table to destination table.

'tables' => [
    '_source_table' => 'destination_table',
    'media' => 'app_media',
]

You can set to run the Laravel migration by following setting. By default this option is disabled.

DATA_MIGRATION_RUN=true

You may want to enable Foreign Key check as well. By default this option is disabled.

DATA_MIGRATION_FK_CHECK=false

You also can truncate the destination table before migrating the data. By default this option is enabled.

DATA_MIGRATE_TRUNCATE=true

Usage

Before you run this command, please make sure you are firmed with the configuration and run the data migration in non-production environment.

To start migrate, run the following command:

php artisan data:migrate mysql pgsql

By default, the migration will query by chunk of 100. If you need to increase the numbers, you can provide the option:

php artisan data:migrate mysql pgsql --chunk=1000

By increasing the chunk, it might impact the performance of the migration.

Testing

composer test

Changelog

Please see CHANGELOG for more information on what has changed recently.

Contributing

Please see CONTRIBUTING for details.

Security Vulnerabilities

Please review our security policy on how to report security vulnerabilities.

Credits

• Nasrul Hazim Bin Mohamad
• All Contributors

License

The MIT License (MIT). Please see License File for more information.