Real-time Image Processing on an FPGA for an Intraoperative Goggle Device

The emergence of near-infrared dyes for fluorescence imaging has had a tremendous impact in the medical field. In particular, indocyanin green (ICG) has been widely used for assessing tumor margins during intraoperative procedures. Typically, the dye is intravenously injected into the patient, and after 24 hours the dye is removed from the patient’s body, except where binding between the dye and tumor cells has occurred. This selective binding between ICG and cancerous tissue allows for easy and accurate detection of cancer margins as well as detection of metastasis throughout the patient’s body. In order to detect the binding sites, a near infrared light source at 780nm is used to excite the dye molecules, and emission is observed at 800nm. To take advantage of fluorescent imaging during intraoperative procedures, we have developed a goggle system equipped for real-time imaging in both visible and near infrared spectra. The goggle system has to be light, compact and able to perform real-time image processing to assist the physician for easy detection of tumor margins. To this end, I have developed Verilog code for a Spartan III FPGA that performs the following: 1) Real-time acquisition of both visible and near infrared spectrum images from a pair of CMOS imaging detectors; 2) Real-time image processing for both near infrared and color images in order to enhance the captured information; and 3) Real-time display of fused visible-near infrared images in high definition (HDMI) format on a goggle device. The imaging device has been successfully used for intraoperative procedures during tumor resection in animal models.

Name thesis:degree_name

Master of Science (MS)

Level thesis:degree_level

Thesis

Discipline thesis:degree_discipline

Electrical & Systems Engineering

Year dc:date.available

2014

Author dc:creator

• Zhang, Yiyi

Contributors dc:contributor

• Hiro Mukai

• FPGA
• Electrical and Computer Engineering

Statement dc:rights

• I have not registered my thesis with the U.S. Copyright Office, but intend to later.

Language dc:language

English (en)

Identifier

https://openscholarship.wustl.edu/eng_etds/3

OAI identifier oai:identifier

oai:openscholarship.wustl.edu:eng_etds-1002