Back to results

University of Houston

Partially Observable Markov Process Decision Modeling for the Optimal Maintenance of Oil and Gas Pipelines

Abstract

dc:description.abstract

Partially Observable Markov Decision Process (POMDP) frameworks are employed across various fields. This dissertation studies the applications of POMDP for maintaining oil and gas pipelines. Pipeline maintenance operations comprise several uncertain elements, especially when addressing deteriorations caused by corrosion. These include the deterioration rate, the effectiveness of maintenance operations, and the accuracy of inspection or monitoring methods. POMDP is proposed to model these uncertainties. The POMDP solution method plays a crucial role in formulating and solving problems. Therefore, the first part of the study reviewed the diverse solution methods pursued in the literature. Based on this review, an improved vector pruning algorithm was introduced to enhance the pruning operation for an incremental pruning solution method. It formulated the LP optimization as prime and dual with Bender’s decomposition and incorporated bootstrap to expedite the optimization process. Various experiments were performed to demonstrate the improvements attained from the proposed solution method. The second part presents a discrete model for the practical application of POMDP to oil and gas pipeline corrosion maintenance. In this model, the states were discretized to represent a range of deterioration, while the actions represented the maintenance operations. Monte Carlo simulation and a pure birth Kolmogorov's forward equations approach were used to derive the transition matrix. Tool inaccuracies for an inline inspection (ILI) method were integrated into observations and observation function formulation. Rewards considered the costs associated with maintenance and failures. The model was numerically illustrated using generated values, data from the literature, and MDPToolBox solvers & the proposed improved pruning method. In the third part of the study, the continuous deterioration feature of corrosion was directly modeled using a continuous state POMDP. States measured the pipe deterioration as continuous values, whereas the ILI inaccuracies were included as continuous variables. A Generative function was formulated to perform the transition, and the discrete formulation for action and reward was kept the same. POMCP and ARDESPOT solvers were used to demonstrate a numerical example. Altogether, the proposed POMDP models represented some of the uncertain features of corrosion maintenance, enabling better decision-making in implementing the function.

Degree

thesis:*
Name thesis:degree_name
Doctor of Philosophy
Level thesis:degree_level
Doctoral
Discipline thesis:degree_discipline
Industrial Engineering
Grantor
University of Houston
Year dc:date.issued
2024

Author and committee

dc:creator, dc:contributor.*
Author dc:creator
  • Wari, Ezra
Advisor dc:contributor.advisor
  • Lim, Gino
Committee members dc:contributor.committeemember
  • Zhu, Weihang
  • Xiang, Yisha
  • Fan, Lei
  • Lin, Ying

Subjects

dc:subject × 3

Rights

Language dc:language.iso
en

Identifiers

dc:identifier.*
Handle dc:identifier.uri
https://hdl.handle.net/10657/17784
OAI identifier oai:identifier
oai:uh-ir.tdl.org:10657/17784

Chain of custody

source
Harvested from
University of Houston
Base URL
uh-ir.tdl.org/server/oai/request
Last updated
2026-07-24
Source record
OAI-PMH GetRecord
citation

Wari, Ezra. Partially Observable Markov Process Decision Modeling for the Optimal Maintenance of Oil and Gas Pipelines. Doctoral thesis, University of Houston, 2024. https://hdl.handle.net/10657/17784