A startup called Sparkify wants to analyze the data they've been collecting on songs and user activity on their new music streaming app. The analysis team is particularly interested in understanding what songs users are listening to. Currently, there is no easy way to query the data to generate the results, since the data reside in a directory of CSV files on user activity on the app.
They'd like a data engineer to create an Apache Cassandra database that can create queries on song play data to answer the questions, and wish to bring you on the project. My role is to create a database for this analysis.
See file Jupyter notebook for the ETL pipeline that preprocesses the files and creates the Cassandra tables.