data-warehouse-build
Building an Equity Data Warehouse in PostgreSQL with Python is a project that uses Python and SQL to build a local equity data warehouse intended for future quantitative research. It creates a PostgreSQL database, sets up the schema, scrapes stock listings from the internet, loads equity data into the database, and retrieves the data as a test. The project requires PostgreSQL and Python, and uses the psycopg2, requests, bs4, os, and datetime libraries. Local setup involves downloading the repository, editing the databaseinfo.txt file with local PostgreSQL credentials including localhost name, username, and password, then running four scripts in sequence: dbpartoneschemabuilder.py to create the schema, dbparttwosp500stockbuilder.py to scrape stocks, dbpartthreeretrieveprices.py to load price data, and dbpartfouroutputdates.py to run a retrieval test. The development environment uses Spyder IDE 3.2.8 with Python 3.6.5 and PostgreSQL 9.5.9. It serves as a practical starting point for anyone looking to construct