Data-Collection & Web Scraping

I first gathered the data on current open Title IX investigation from Office of Civil Rights’ “Pending Cases Currently Under Investigation at Elementary-Secondary and Post-Secondary Schools” as of March 17, 2020 Search. The data contains the institution name, State, institution type (element-secondary or post-secondary), and open investigation date.

I wrote Javascript and Python scripts using Puppeteer.js and Selenium to scrape data related to the institution’s tuition, institution type (private vs public), and physical coordinates, as well as Google Search images using the search terms “Instuitution Name + students”. After processing and cleaning the data, I visualized it using DataTables and Leaflet.js.

Explore the Data

Feel free to download the data, in JSON format, that I compiled for this project.

Research & Interviews

Much of my understanding on the subject comes from my personal experience filing a Title IX complaint both at my institution and at the Department of Education. I revisited the reserach I did during that time, and also Kirby Dick’s documentary The Hunting Ground, which examines sexual assault on college campuses in the United States and the reported failure of college administrations to deal with it adequately.

I had also interviewed several others who have filed Title IX complaints regarding their experience, as well as consult them on the design and implementation of this project.