keboola / input-mapping
Input mapping library for downloading tables and files from Keboola Storage API with support for CSV and Parquet formats
Requires
- php: >=8.2
- ext-json: *
- keboola/key-generator: *@dev
- keboola/php-file-storage-utils: ^0.2
- keboola/staging-provider: *@dev
- keboola/storage-api-client: ^18.3.0
- keboola/storage-api-php-client-branch-wrapper: ^6.0
- symfony/config: ^5.4|^6.0|^7.0
- symfony/finder: ^5.4|^6.0|^7.0
- symfony/serializer: ^5.4|^6.0|^7.0
- symfony/yaml: ^5.4|^6.0|^7.0
Requires (Dev)
- brianium/paratest: ^6.11
- flow-php/filesystem: ^0.22.0
- flow-php/parquet: ^0.22.0
- flow-php/types: ^0.22.0
- keboola/coding-standard: >=14.0
- keboola/php-temp: ^2.0
- keboola/settle: *@dev
- monolog/monolog: ^3.0
- phpstan/phpstan: ^1.9
- phpstan/phpstan-phpunit: ^1.3
- phpstan/phpstan-symfony: ^1.2
- phpunit/phpunit: ^9.5
- sempro/phpunit-pretty-print: ^1.4
- symfony/dotenv: ^5.4|^6.0|^7.0
This package is auto-updated.
Last update: 2026-06-18 09:06:32 UTC
README
Input mapping library for Keboola Runner and Workspaces. Downloads tables and files from Keboola Storage API: tables can be exported to CSV or Parquet, files are downloaded as-is. Creates manifests and tracks incremental file state. Supports staging via Local, S3, Azure Blob Storage, and loading into Snowflake/BigQuery workspaces.
Development
Prepare local environment
Create .env.local file from this .env template and fill the required environment variables:
cp .env .env.local
Prepare resources
You need to provide the following environment variables:
STORAGE_API_URL- The Keboola Storage API URL (e.g.,https://connection.keboola.com)STORAGE_API_TOKEN- A non-admin token with "Full Access" to Files, Components & Buckets and TrashSTORAGE_API_TOKEN_MASTER- An admin user token from the same project (with roleadmin)
Available composer commands
Development commands:
composer phpcs- Check code stylecomposer phpcbf- Automatically fix code style issuescomposer phpstan- Run static analysis
Testing commands:
composer tests- Run tests with PHPUnitcomposer paratests- Run tests in parallel with Paratest
License
MIT licensed, see LICENSE file.