BiSight ETL: Extract, Transform, Load toolkit

v1.5.0 2016-03-21 21:28 UTC

README

BiSight ETL is a simple, extensible and powerful E(xtract), T(ransform), L(oad) application and library.

It provides a pluggable set of Extractors, Transformers and Loaders. New and/or custom extensions can be easily integrated by implementing one of the 3 interfaces.

What is ETL ?

According to Wikipedia

In computing, Extract, Transform and Load (ETL) refers to a process in database usage and especially in data warehousing that:

  • Extracts data from homogeneous or heterogeneous data sources
  • Transforms the data for storing it in proper format or structure for querying and analysis purpose
  • Loads it into the final target (database, more specifically, operational data store, data mart, or data warehouse)

Docs

Read the docs at etl.readthedocs.org.

How to try?

Just run:

bin/try

and follow instructions.

TODO

  • Standardize columns
  • Ability to provide just names of extractors/loaders/transformers, not classes
  • Make bin/publish shell script automating phar building and publishing process

Brought to you by the LinkORB Engineering team

687474703a2f2f7777772e6c696e6b6f72622e636f6d2f642f6d6574612f74696572312f696d616765732f6c696e6b6f7262656e67696e656572696e672d6c6f676f2e706e67
Check out our other projects at engineering.linkorb.com.

Btw, we're hiring!