A project I’m working on involves running Oracle queries on a PeopleSoft system and getting the results as CSV files. I use those query results, plus information from other places (the New York State Department of Education’s website and Degreeworks information for academic programs) to derive a Postgres database that is the backend for a “Transfer App” (https://transfer-app.qc.cuny.edu) for the City University of New York.

In working with the PeopleSoft query results, I needed to explore the results before deciding how to combine them in the derived database, and Excel, Google Sheets, and Numbers all are too limited for working with some of the results, which are millions of lines long. So I wrote a Python script to turn CSV files into database tables.

It’s a convenient utility, so I put it up on GitHub for sharing: https://github.com/cvickery/csv2db