elysian/dataprocessor

High-performance data import/export library with cloud storage support, chunking, and Swoole coroutines

v1.0.0 2025-08-12 07:10 UTC

Requires

• php: ^8.1
• ext-json: *
• openspout/openspout: ^4.0

Requires (Dev)

• friendsofphp/php-cs-fixer: ^3.0
• phpstan/phpstan: ^1.10
• phpunit/phpunit: ^10.0

Suggests

• ext-pdo: For database operations in import/export classes
• ext-swoole: For high-performance queue processing with coroutines
• aws/aws-sdk-php: For Amazon S3 cloud storage support
• google/cloud-storage: For Google Cloud Storage support
• microsoft/azure-storage-blob: For Azure Blob Storage support

MIT

• Elysian Development Team

• performance
• excel
• csv
• import
• export
• data-processing
• chunking
• swoole
• Coroutines
• cloud-storage
• openspout

README

A high-performance PHP library for importing and exporting large datasets with cloud storage support, automatic chunking, Swoole coroutines, and memory-efficient generators. Built on top of OpenSpout for maximum performance and minimal memory usage.

Features

• ⚡ High Performance: Process millions of rows with minimal memory usage
• ☁️ Cloud Storage: Native support for AWS S3, Google Cloud Storage, Azure Blob Storage
• 🔄 Auto Chunking: Automatically splits large files into smaller chunks
• 🚀 Swoole Support: Background processing with Swoole coroutines for enhanced performance
• 🧠 Memory Efficient: Uses PHP generators to handle large datasets
• 📁 Multiple Formats: Excel (XLSX), CSV, ODS support
• ✅ Data Validation: Built-in validation system
• 🎯 Framework Agnostic: No Laravel dependency - works with any PHP framework
• 🧪 Well Designed: Clean contract-based architecture with extensive examples

Requirements

• PHP 8.1+
• OpenSpout 4.0+
• Optional: Swoole extension for enhanced performance
• Optional: Cloud storage SDKs (AWS, Google Cloud, Azure)

Installation

composer require elysian/dataprocessor