Visualizing and interpreting convolutional neural networks on genomic data

Deep learning's capability to learn derived features through a hierarchy of non-linear layers has proven superior to other machine learning methods. However, interpretation of the resulting genomic deep learning networks remains challenging. While many network visualization tools focus on directly mapping high level neuron features into input space, they do not explicitly reflect how a network combines these features when making predictions. Moreover, many of these methods only examine network's response to a specific input sample. This thesis presents DeepResolve, a visualization framework for genomic convolutional neural networks that reveals how combinatorial interactions of sequence features contribute to solve a single genomics task, as well as revealing feature sharing across tasks in a multi-task setting. DeepResolve employs a gradient ascent based method to visualize feature maps in intermediate layers of a network and 1) summarizes overall knowledge of a class contained in a network in an input independent manner, 2) recovers network linear and non-linear combinatorial logic, and 3) reveals class relationships in a multi-task application. DeepResolve is compatible with existing visualization tools and provides complementary insights. We demonstrate the visualization of convolutional neural networks trained on both synthetic and experimental data, and show DeepResolve's capability to recover key sequence features and non-linear logic, and reveal correlation in feature space between uncorrelated genome annotations including histone marks, DNase hypersensitivity, and transcription factor binding that suggest shared biological mechanism.

Department dc:contributor.department

Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science

Grantor dc:publisher

Massachusetts Institute of Technology

Year dc:date.issued

2018

Author dc:creator

• Liu, Ge, Ph. D. Massachusetts Institute of Technology

Advisor dc:contributor.advisor

• David Gifford.

• Electrical Engineering and Computer Science.

Statement dc:rights

• MIT theses are protected by copyright. They may be viewed, downloaded, or printed from this source but further reproduction or distribution in any format is prohibited without written permission.

Licence dc:rights.uri

• http://dspace.mit.edu/handle/1721.1/7582

Language dc:language.iso

eng

Handle dc:identifier.uri

http://hdl.handle.net/1721.1/118058

OAI identifier oai:identifier

oai:dspace.mit.edu:1721.1/118058