ETL with Python and MySQL

ETL with Python Training - Taught during Data Warehousing course - Tel Aviv University 2017

The Training is planned for ~2 hours and contains 4 notebook files:

• jupyter-notebook.ipynb - quick Jupiter notebook introduction and tutorial

• Mysql-io.ipynb - Input/Output to MySQL using MySQLdb connector

• ETL with Python.ipynb - ETL with python using petl package

• Extra: CSV-io - csv library usage examples

Data files:

• drinks.json - drinks consumption data (source)

• drinks.zip - zipped json file (used for a zip file example in ETL notebook)

• assuming you have default build-in world schema of MySQL (for mysql-io exercise). If not you can get it by running CreateWorld.sql - dump of sql scripy for creating world schema for mysql-io exercise.

• file1.csv/file2.csv/flie3.csv - csv examples for csv library

• simpsons_phone_book.csv - csv example for sniffer