petrknap/php-filestorage

This package is abandoned and no longer maintained. The author suggests using the petrknap/php-splitfilesystem package instead.

File storage for PHP

v1.1.2 2016-06-27 14:53 UTC

Requires

• php: >=5.5
• league/flysystem: ^1.0
• nunzion/php-expect: ^1.1
• petrknap/php-migrationtool: ^1.0

Requires (Dev)

• petrknap/php-profiler: ^0.2.0
• phpunit/phpunit: 4.*

MIT

• Petr Knap

README

• About resolved issue
  • Advantages
  • Disadvantages
• Usage of php-filestorage
  • Standard usage
• How to install

About resolved issue

I need to use something where around 60,000 files with average size of 30kb are stored in a single directory (this is a requirement so can't simply break into sub-directories with smaller number of files).

The files will be accessed randomly, but once created there will be no writes to the same filesystem. I'm currently using Ext3 but finding it very slow. Any suggestions?

-- Filesystem large number of files in a single directory - bugmenot77, voretaq7

This file storage solves this issue simply - it creates virtual layer between file system and application. Every path is converted into path which is composed from many directories which contains only small amount of sub-directories.

If you wish to store 1 000 000 files in single directory, this file storage converts paths and stores them in huge tree-structure. Every directory (exclude leafs) contains up to 256 sub-directories. Leafs contains only files.

Advantages

• Can store a huge amount of files in single directory
• Can use fully localized paths to files (f.e.: /シックス.log)
• Naturally protects files outside the storage
• Every user can has separated and isolated file storage
• Fully compatible and based on League\Flysystem

Disadvantages

• Real file structure is not user-friendly
• Can not effectively get files sorted by any key (without DBMS)

Usage of php-filestorage

Standard usage

<?php

use League\Flysystem\Adapter\Local as LocalAdapter;
use PetrKnap\Php\FileStorage\FileSystem;
use PetrKnap\Php\FileStorage\Plugin\SQLiteIndexPlugin;

$fileSystem = new FileSystem(new LocalAdapter(__DIR__ . "/temp"));
SQLiteIndexPlugin::register($fileSystem, __DIR__ . "/temp/index.sqlite"); // optional

$fileSystem->write("/file.txt", null);
$fileSystem->update("/file.txt", "Hello World!");

printf("%s", $fileSystem->read("/file.txt"));

foreach ($fileSystem->listContents() as $metadata) {
    $fileSystem->delete($metadata["path"]);
}

How to install

Run composer require petrknap/php-filestorage or merge this JSON code with your project composer.json file manually and run composer install. Instead of dev-master you can use one of released versions.

{
    "require": {
        "petrknap/php-filestorage": "dev-master"
    }
}

Or manually clone this repository via git clone https://github.com/petrknap/php-filestorage.git or download this repository as ZIP and extract files into your project.