bisight / etl
BiSight ETL: Extract, Transform, Load toolkit
Installs: 4 110
Dependents: 0
Suggesters: 0
Security: 0
Stars: 11
Watchers: 6
Forks: 4
Open Issues: 0
Requires
- jdorn/sql-formatter: ~1.2
- symfony/console: ~2.4
- symfony/expression-language: ~2.4
Requires (Dev)
- dbtk/schema-loader: ~2.0
- doctrine/dbal: ~2.4
- herrera-io/phar-update: 1.*
- linkorb/conventions-checker: ~1.1
- linkorb/haigha: ~2.1
- phpunit/phpunit: ~4.6
- secondtruth/phar-compiler: ~1.1
- symfony/process: ~2.1
README
BiSight ETL is a simple, extensible and powerful E(xtract), T(ransform), L(oad) application and library.
It provides a pluggable set of Extractors, Transformers and Loaders. New and/or custom extensions can be easily integrated by implementing one of the 3 interfaces.
What is ETL ?
According to Wikipedia
In computing, Extract, Transform and Load (ETL) refers to a process in database usage and especially in data warehousing that:
- Extracts data from homogeneous or heterogeneous data sources
- Transforms the data for storing it in proper format or structure for querying and analysis purpose
- Loads it into the final target (database, more specifically, operational data store, data mart, or data warehouse)
Docs
Read the docs at etl.readthedocs.org.
How to try?
Just run:
bin/try
and follow instructions.
TODO
- Standardize columns
- Ability to provide just names of extractors/loaders/transformers, not classes
- Make
bin/publish
shell script automating phar building and publishing process
Brought to you by the LinkORB Engineering team
Check out our other projects at engineering.linkorb.com.
Btw, we're hiring!