keboola/input-mapping

Input mapping library for downloading tables and files from Keboola Storage API with support for CSV and Parquet formats

22.1.0 2025-09-09 15:21 UTC

Requires

• php: >=8.2
• ext-json: *
• keboola/key-generator: *@dev
• keboola/php-file-storage-utils: ^0.2
• keboola/staging-provider: *@dev
• keboola/storage-api-client: ^18.3.0
• keboola/storage-api-php-client-branch-wrapper: ^6.0
• symfony/config: ^5.4|^6.0|^7.0
• symfony/finder: ^5.4|^6.0|^7.0
• symfony/serializer: ^5.4|^6.0|^7.0
• symfony/yaml: ^5.4|^6.0|^7.0

Requires (Dev)

• brianium/paratest: ^6.11
• flow-php/filesystem: ^0.22.0
• flow-php/parquet: ^0.22.0
• flow-php/types: ^0.22.0
• keboola/coding-standard: >=14.0
• keboola/php-temp: ^2.0
• keboola/settle: *@dev
• monolog/monolog: ^3.0
• phpstan/phpstan: ^1.9
• phpstan/phpstan-phpunit: ^1.3
• phpstan/phpstan-symfony: ^1.2
• phpunit/phpunit: ^9.5
• sempro/phpunit-pretty-print: ^1.4
• symfony/dotenv: ^5.4|^6.0|^7.0

MIT

• Keboola

README

Input mapping library for Keboola Runner and Workspaces. Downloads tables and files from Keboola Storage API: tables can be exported to CSV or Parquet, files are downloaded as-is. Creates manifests and tracks incremental file state. Supports staging via Local, S3, Azure Blob Storage, and loading into Snowflake/BigQuery workspaces.

Development

Prepare local environment

Create .env.local file from this .env template and fill the required environment variables:

cp .env .env.local

Prepare resources

You need to provide the following environment variables:

• STORAGE_API_URL - The Keboola Storage API URL (e.g., https://connection.keboola.com)
• STORAGE_API_TOKEN - A non-admin token with "Full Access" to Files, Components & Buckets and Trash
• STORAGE_API_TOKEN_MASTER - An admin user token from the same project (with role admin)

Available composer commands

Development commands:

• composer phpcs - Check code style
• composer phpcbf - Automatically fix code style issues
• composer phpstan - Run static analysis

Testing commands:

• composer tests - Run tests with PHPUnit
• composer paratests - Run tests in parallel with Paratest

License

MIT licensed, see LICENSE file.