Big Data Visualization Using Python for Duke Researchers


Year: 2023

A team of students will work with Duke’s Office of Information Technology and Research Computing staff to develop advanced interactive user interfaces, tools, and workflows for visualization/analysis of large datasets. The goal is to help make Duke Research Computing resources more accessible to all disciplines and computational skill levels across campus. By creating and documenting exemplar workflows we will both address researchers’ needs for live large-scale visualizations and demonstrate how to use Duke's research computing infrastructure to the broader community.

Students will work with three Duke researchers (William Pan, Mark Janko, and Shineng Hu) to develop visualization tools for both a Peruvian Amazon malaria early warning system and climate dynamics related to extreme snowfall events in connection to El Niño/La Niña. This project will expose students to air-sea climate interactions, semi-real time data, global health surveillance systems, and contribute to advancing malaria surveillance and control.

Watch the team's final presentation on YouTube.

Big Data handout




IT Professionals

Student Project Managers/Facilitators