bisight/etl

BiSight ETL: Extract, Transform, Load toolkit

v1.5.0 2016-03-21 21:28 UTC

Requires

• jdorn/sql-formatter: ~1.2
• symfony/console: ~2.4
• symfony/expression-language: ~2.4

Requires (Dev)

• dbtk/schema-loader: ~2.0
• doctrine/dbal: ~2.4
• herrera-io/phar-update: 1.*
• linkorb/conventions-checker: ~1.1
• linkorb/haigha: ~2.1
• phpunit/phpunit: ~4.6
• secondtruth/phar-compiler: ~1.1
• symfony/process: ~2.1

MIT

• Joost Faassen
• LinkORB

• transform
• extract
• etl
• load
• linkorb
• business intelligence
• BI

README

BiSight ETL is a simple, extensible and powerful E(xtract), T(ransform), L(oad) application and library.

It provides a pluggable set of Extractors, Transformers and Loaders. New and/or custom extensions can be easily integrated by implementing one of the 3 interfaces.

What is ETL ?

According to Wikipedia

In computing, Extract, Transform and Load (ETL) refers to a process in database usage and especially in data warehousing that:

• Extracts data from homogeneous or heterogeneous data sources
• Transforms the data for storing it in proper format or structure for querying and analysis purpose
• Loads it into the final target (database, more specifically, operational data store, data mart, or data warehouse)

Docs

Read the docs at etl.readthedocs.org.

How to try?

Just run:

bin/try

and follow instructions.

TODO

• Standardize columns
• Ability to provide just names of extractors/loaders/transformers, not classes
• Make bin/publish shell script automating phar building and publishing process

Brought to you by the LinkORB Engineering team

Check out our other projects at engineering.linkorb.com.

Btw, we're hiring!