Predicting Chemical Reactions at the MechanisticLevel through Deep Reinforcement Learning

Reaction prediction is a fundamental problem in chemistry. Previous work has mostly targeted chemical product prediction only, but did not elucidate any mechanisms or elementary steps from which the reaction proceeds. Here, we attempt to predict chemical mechanisms via deep reinforcement learning. We first define a new type of graph molecular representation that can better keep track of electron flow and can be generalized to non-traditional bonding, such as 3- center-4-electron bonds. We then define a molecular environment Markov Decision Process (MDP) that codifies the allowed mechanistic steps and evaluates them by utilizing a thermodynamic energy oracle as the reward function. To solve this environment, we build a graph neural network-based policy and value network, where the policy network is first pre-trained on an open database of elementary radical reactions (RMechDB). Then, we use proximal policy optimization (PPO) to fine-tune the model and predict reasonable reaction mechanisms for two case studies: a radical oxidation of the terpene limonene, and a radical cyclization cascade in the synthesis of hirsutene.

Name thesis:degree_name

Master

Department dc:contributor.department

Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science

Grantor dc:publisher

Massachusetts Institute of Technology

Year dc:date.issued

2023

Author dc:creator

• Jin, Edward H.

Advisor dc:contributor.advisor

• Coley, Connor W.

Statement dc:rights

• In Copyright - Educational Use Permitted
• Copyright retained by author(s)

Licence dc:rights.uri

• https://rightsstatements.org/page/InC-EDU/1.0/

Handle dc:identifier.uri

https://hdl.handle.net/1721.1/151666

OAI identifier oai:identifier

oai:dspace.mit.edu:1721.1/151666