An optimizing compiler for ONNX models on heterogeneous systems

In order to build, train, and deploy deep learning models for modern data-driven applications, programs need to be executed on top of specialized heterogeneous systems for better performance. However, programming on those heterogeneous systems remains a fundamental challenge in terms of the interoperability issue between high-level deep learning frameworks and the programmability issue between different low-level heterogeneous systems. In this work, we propose a portable and highly optimizing compiler for neural network models, which is based on an open format - ONNX of deep learning models, running on heterogeneous systems. It consists of a front-end and a back-end to address those above issues. The goal of this neural network compiler is also to map high-level neural network models to low-level executable programs. We evaluate this work with several deep learning neural network models and our neural network compiler is able to outperform ONNX runtime by up to 3.15x and Keras by up to 4.37x on certain workloads.

Name thesis:degree_name

M.S.

Level thesis:degree_level

Thesis

Discipline thesis:degree_discipline

Computer Science

Grantor

University of Illinois at Urbana-Champaign

Year dc:date

2020

Author dc:creator

• Shi, Yuanjing

Contributors dc:contributor

• Adve, Vikram S.

• Compiler

Statement dc:rights

• Copyright 2020 Yuanjing Shi

Language dc:language

en

Handle dc:identifier

http://hdl.handle.net/2142/108171

OAI identifier oai:identifier

oai:www.ideals.illinois.edu:2142/108171