Zhe Jiang Homepage


Mapping Road Safety Barriers from Google Street View: Each year, around 6 million car accidents occur in the U.S. on average. Road safety barriers (e.g., concrete barriers, guardrails, rumble strips) help prevent or mitigate the impact of vehicle crashes. Accurate maps of road safety features play a crucial role in highway safety management systems for federal or state transportation agencies. In current practice, road safety barrier mapping is often done manually (e.g., observations on the road or visual interpretation of street view imagery), both expensive and time-consuming. We explore a deep learning approach to automatically map road safety features from street view imagery in this work. We propose to use recurrent network (Long Short-Term Memory) on top of convolutional neural networks to capture the autocorrelation in an image sequence. Evaluations on real-world street view imagery show that our proposed model outperforms several baseline methods.

Model architecture for street view image classification.

Mining GPS Bicycle Trajectories on Green Corridors: The project aims to develop effective and efficient spatiotemporal data mining tools that analyze GPS trajectories of urban cyclists to understand their riding behaviors and preferred paths. The topic contributes towards green transportation, which is important for enhancing public health, reducing pollution and greenhouse gas emission. Specifically, the project proposes a K-primary-corridor algorithm that identifies representative paths from cyclists' trajectories. The algorithm involves efficient computational of shortest paths with an upper bound filter based on "trace envelopes". The results were published in InfoSysJ 15.

Identify primary corridors from bicycle trajectories in Minneapolis.

Traffic Flow Prediction: Traffic flow prediction is of great importance in traffic management and public safety, but is challenging due to the complex spatial-temporal dependencies as well as temporal dynamics. Existing work either focuses on traditional statistical models, which have limited prediction accuracy, or relies on black-box deep learning models, which have superior prediction accuracy but are hard to interpret. In contrast, we propose a novel interpretable spatiotemporal deep learning model for traffic flow prediction. Our main idea is to model the physics of traffic flow through a number of latent spatiotemporal potential energy fields (ST-PEFs), similar to water flows driven by the gravity field. We design a novel spatiotemporal deep learning model for the ST-PEFs. The model consists of a temporal component (temporal autocorrelation and periodicity) and a spatial component (spatial graph convolutions). To the best of our knowledge, this is the first work that make traffic flow prediction based on ST-PEF. Experimental results on real-world traffic datasets show the effectiveness of our model compared over the existing methods. Case studies confirm our model interpretability.


  1. Arpan Man Sainju, Zhe Jiang, "Mapping Road Safety Features from Streetview Imagery: A Deep Learning Approach", ACM Transactions on Data Science (TDS), Special Issue on Urban Computing and Smart Cities, 2019, PDF (accepted)
  2. Arpan Man Sainju, Zhe Jiang, "Mapping Road Safety Features from Streetview Imagery: A Deep Learning Approach", ACM SIGKDD International Workshop on Urban Computing (UrbComp 2019), PDF
  3. Jiahao Ji, Jingyuan Wang, Zhe Jiang, Jingtian Ma, and Hu Zhang, "Interpretable Spatiotemporal Deep Learning Model for Traffic Flow Prediction based on Potential Energy Fields", IEEE International Conference on Data Mining (ICDM), 2020 (accepted)
  4. Benjamin Romano, Zhe Jiang. "Visualizing Traffic Accident Hotspots Based on Spatial-Temporal Network Kernel Density Estimation." In Proceedings of the 25th ACM SIGSPATIAL International Conference on Advances in Geographic Information Systems (GIS). ACM, 2017 PDF
  5. Zhe Jiang, Micheal Evans, Dev Oliver, Shashi Shekhar. "Identifying K Primary Corridors from Urban Bicycle GPS Trajectories on a Road Network." Special Issues on Mining Urban Data, Information Systems Journal, Elsevier, 2016 PDF