Satellite Image Analysis and Sidewalk Classification using Deep Learning Models

<p>Lack of sidewalk pavement can contribute to pedestrian fatalities and injuries in the USA. Although many researchers have conducted research on sidewalk detection, there are not many publicly available datasets that we would work on for sidewalk classification. In this study, I conducted classification tasks using pretrained CNN models including VGG16 and ResNet50. I extended these models by adding custom layers at the top of pretrained layers, employing various techniques to improve the classification accuracy.</p> <p>The dataset comprises 4,731 images of sidewalk based on occlusion levels, including images where the sidewalk is visible from overhead and instances where sidewalk is occluded by tree canopies, buildings, or vehicles etc. These images were collected manually using ArcGIS Pro from Allegheny County, PA USA.</p> <p>Different preprocessing techniques were applied to the dataset, such as image resizing, image extraction from bounding boxes, and image mapping to actual class label. Due to the class imbalance nature of the dataset, an augmentation technique was employed to augment the minority class and reduce the imbalanced. The data was partitioned into a training (80%) and test (20%) sets. The models were trained with and without augmentation and their performances were evaluated using metrics including precision, recall, F1- score, accuracy, and area under receiver operating curve. The results showed VGG16 outperforms ResNet50 in sidewalk classification and employing data augmentation technique to the minority class proves beneficial when dealing with imbalanced data in image classification tasks.</p>

Name thesis:degree_name

Master of Science (MS)

Level thesis:degree_level

Masters Thesis

Year dc:date.available

2024

Author dc:creator

• Khanal, Subeksha

Contributors dc:contributor

• Chaoyang Zhang
• Yuanyuan Zhang
• Zhaoxian Zhou

• Deep Learning
• Convolutional Neural Networks
• Classification
• Satellite Image
• Sidewalk Detection
• Data Augmentation
• Artificial Intelligence and Robotics

Repository record dc:identifier

https://aquila.usm.edu/masters_theses/1041

OAI identifier oai:identifier

oai:aquila.usm.edu:masters_theses-2117