{"id":{"repo_id":"mit","oai_identifier":"oai:dspace.mit.edu:1721.1/133076"},"canonical_url":"https://search.dev.ndltd.org/etd/mit/oai:dspace.mit.edu:1721.1/133076","repository":{"repo_id":"mit","name":"MIT","base_url":"https://dspace.mit.edu/oai/request"},"display":{"title":"Reconstructing neurons from serial section electron microscopy images","abstract":"Neuronal connectivity can be reconstructed from a 3D electron microscopy (EM) image of a brain volume. A challenging and important subproblem is the segmentation of the image into neurons. For the past decade, convolutional networks have been used for 3D reconstruction of neurons from EM brain images. In this thesis, we develop a set of deep learning algorithms based on convolutional nets for automated reconstruction of neurons, with particular focus on highly anisotropic images of brain tissue acquired by serial section EM (ssEM). In the first part of the thesis, we propose a recursively trained hybrid 2D-3D convolutional net architecture, and demonstrate the feasibility of exploiting 3D context to further improve boundary detection accuracy despite the high anisotropy of ssEM images. In the following parts, we propose two techniques for training convolutional nets that can substantially improve boundary detection accuracy. First, we introduce novel forms of training data augmentation based on simulation of known types of image defects such as misalignments, missing sections, and out-of-focus sections. Second, we add the auxiliary task of predicting affinities between nonneighboring voxels, reflecting the structured nature of neuronal boundary detection. We demonstrate the effectiveness of the proposed techniques on large-scale ssEM images acquired from the mouse primary visual cortex. Lastly, we take a radical departure from simple boundary detection by exploring an alternative approach to object-centered representation, that is, learning dense voxel embeddings via deep metric learning. Convolutional nets are trained to generate dense voxel embeddings by assigning similar vectors to voxels within the same objects and well-separated vectors to voxels from different objects. Our proposed method achieves state-of-the-art accuracy with substantial improvements on very thin objects.","abstract_html":"Neuronal connectivity can be reconstructed from a 3D electron microscopy (EM) image of a brain volume. A challenging and important subproblem is the segmentation of the image into neurons. For the past decade, convolutional networks have been used for 3D reconstruction of neurons from EM brain images. In this thesis, we develop a set of deep learning algorithms based on convolutional nets for automated reconstruction of neurons, with particular focus on highly anisotropic images of brain tissue acquired by serial section EM (ssEM). In the first part of the thesis, we propose a recursively trained hybrid 2D-3D convolutional net architecture, and demonstrate the feasibility of exploiting 3D context to further improve boundary detection accuracy despite the high anisotropy of ssEM images. In the following parts, we propose two techniques for training convolutional nets that can substantially improve boundary detection accuracy. First, we introduce novel forms of training data augmentation based on simulation of known types of image defects such as misalignments, missing sections, and out-of-focus sections. Second, we add the auxiliary task of predicting affinities between nonneighboring voxels, reflecting the structured nature of neuronal boundary detection. We demonstrate the effectiveness of the proposed techniques on large-scale ssEM images acquired from the mouse primary visual cortex. Lastly, we take a radical departure from simple boundary detection by exploring an alternative approach to object-centered representation, that is, learning dense voxel embeddings via deep metric learning. Convolutional nets are trained to generate dense voxel embeddings by assigning similar vectors to voxels within the same objects and well-separated vectors to voxels from different objects. Our proposed method achieves state-of-the-art accuracy with substantial improvements on very thin objects.","abstract_has_math":false,"creators":["Lee, Kisuk, Ph. D. Massachusetts Institute of Technology."],"institution":"Massachusetts Institute of Technology","degree_name":"Doctoral","degree_level":null,"degree_discipline":null,"degree_department":"Massachusetts Institute of Technology. Department of Brain and Cognitive Sciences","school":null,"contributors":[],"advisors":["H. Sebastian Seung."],"committee_chairs":[],"committee_members":[],"year":2019,"date_issued":"2019","date_published":"2019","updated_at":"2026-07-22T22:21:07Z","subjects":["Brain and Cognitive Sciences."],"languages":["eng"],"rights":["MIT theses may be protected by copyright. Please reuse MIT thesis content according to the MIT Libraries Permissions Policy, which is available through the URL provided."],"rights_urls":["http://dspace.mit.edu/handle/1721.1/7582"],"identifier_entries":[]},"links":{"outbound_url":"https://hdl.handle.net/1721.1/133076","outbound_label":"Handle","outbound_source":"dc:identifier.uri"},"metadata_groups":[{"id":"people","label":"People","entries":[{"key":"dc:contributor.advisor","label":"Advisor","values":["H. Sebastian Seung."]},{"key":"dc:contributor.department","label":"Department","values":["Massachusetts Institute of Technology. Department of Brain and Cognitive Sciences","Brain"]},{"key":"dc:contributor.other","label":"Dc Contributor Other","values":["Massachusetts Institute of Technology. Department of Brain and Cognitive Sciences."]},{"key":"dc:creator","label":"Author","values":["Lee, Kisuk, Ph. D. Massachusetts Institute of Technology."]}]},{"id":"academic_context","label":"Academic Context","entries":[{"key":"dc:date.accessioned","label":"Dc Date Accessioned","values":["2021-10-22T20:27:20Z"]},{"key":"dc:date.available","label":"Dc Date Available","values":["2021-10-22T20:27:20Z"]},{"key":"dc:date.issued","label":"Date","values":["2019"]},{"key":"dc:publisher","label":"Institution","values":["Massachusetts Institute of Technology"]},{"key":"dc:type","label":"Dc Type","values":["Thesis"]},{"key":"thesis:degree_name","label":"Degree Name","values":["Doctoral"]}]},{"id":"subjects_keywords","label":"Subjects and Keywords","entries":[{"key":"dc:subject","label":"Dc Subject","values":["Brain and Cognitive Sciences."]}]},{"id":"language_rights","label":"Language and Rights","entries":[{"key":"dc:language.iso","label":"Language (ISO)","values":["eng"]},{"key":"dc:rights","label":"Dc Rights","values":["MIT theses may be protected by copyright. Please reuse MIT thesis content according to the MIT Libraries Permissions Policy, which is available through the URL provided."]},{"key":"dc:rights.uri","label":"Rights URI","values":["http://dspace.mit.edu/handle/1721.1/7582"]}]},{"id":"identifiers","label":"Identifiers","entries":[{"key":"dc:identifier.uri","label":"Identifier URI","values":["https://hdl.handle.net/1721.1/133076"]}]},{"id":"additional","label":"Additional Metadata","entries":[{"key":"dc:description","label":"Description","values":["This electronic version was submitted by the student author. The certified thesis is available in the Institute Archives and Special Collections.","Thesis: Ph. D. in Computation, Massachusetts Institute of Technology, Department of Brain and Cognitive Sciences, June, 2019","Cataloged from student-submitted PDF version of thesis.","Includes bibliographical references (pages 155-167)."]},{"key":"dc:description.abstract","label":"Abstract","values":["Neuronal connectivity can be reconstructed from a 3D electron microscopy (EM) image of a brain volume. A challenging and important subproblem is the segmentation of the image into neurons. For the past decade, convolutional networks have been used for 3D reconstruction of neurons from EM brain images. In this thesis, we develop a set of deep learning algorithms based on convolutional nets for automated reconstruction of neurons, with particular focus on highly anisotropic images of brain tissue acquired by serial section EM (ssEM). In the first part of the thesis, we propose a recursively trained hybrid 2D-3D convolutional net architecture, and demonstrate the feasibility of exploiting 3D context to further improve boundary detection accuracy despite the high anisotropy of ssEM images. In the following parts, we propose two techniques for training convolutional nets that can substantially improve boundary detection accuracy. First, we introduce novel forms of training data augmentation based on simulation of known types of image defects such as misalignments, missing sections, and out-of-focus sections. Second, we add the auxiliary task of predicting affinities between nonneighboring voxels, reflecting the structured nature of neuronal boundary detection. We demonstrate the effectiveness of the proposed techniques on large-scale ssEM images acquired from the mouse primary visual cortex. Lastly, we take a radical departure from simple boundary detection by exploring an alternative approach to object-centered representation, that is, learning dense voxel embeddings via deep metric learning. Convolutional nets are trained to generate dense voxel embeddings by assigning similar vectors to voxels within the same objects and well-separated vectors to voxels from different objects. Our proposed method achieves state-of-the-art accuracy with substantial improvements on very thin objects."]},{"key":"dc:description.degree","label":"Dc Description Degree","values":["Ph. D. in Computation"]},{"key":"dc:title","label":"Title","values":["Reconstructing neurons from serial section electron microscopy images"]}]}],"canonical_facts":{"dc:contributor.advisor":["H. Sebastian Seung."],"dc:contributor.department":["Massachusetts Institute of Technology. Department of Brain and Cognitive Sciences","Brain"],"dc:contributor.other":["Massachusetts Institute of Technology. Department of Brain and Cognitive Sciences."],"dc:creator":["Lee, Kisuk, Ph. D. Massachusetts Institute of Technology."],"dc:date.accessioned":["2021-10-22T20:27:20Z"],"dc:date.available":["2021-10-22T20:27:20Z"],"dc:date.issued":["2019"],"dc:description":["This electronic version was submitted by the student author. The certified thesis is available in the Institute Archives and Special Collections.","Thesis: Ph. D. in Computation, Massachusetts Institute of Technology, Department of Brain and Cognitive Sciences, June, 2019","Cataloged from student-submitted PDF version of thesis.","Includes bibliographical references (pages 155-167)."],"dc:description.abstract":["Neuronal connectivity can be reconstructed from a 3D electron microscopy (EM) image of a brain volume. A challenging and important subproblem is the segmentation of the image into neurons. For the past decade, convolutional networks have been used for 3D reconstruction of neurons from EM brain images. In this thesis, we develop a set of deep learning algorithms based on convolutional nets for automated reconstruction of neurons, with particular focus on highly anisotropic images of brain tissue acquired by serial section EM (ssEM). In the first part of the thesis, we propose a recursively trained hybrid 2D-3D convolutional net architecture, and demonstrate the feasibility of exploiting 3D context to further improve boundary detection accuracy despite the high anisotropy of ssEM images. In the following parts, we propose two techniques for training convolutional nets that can substantially improve boundary detection accuracy. First, we introduce novel forms of training data augmentation based on simulation of known types of image defects such as misalignments, missing sections, and out-of-focus sections. Second, we add the auxiliary task of predicting affinities between nonneighboring voxels, reflecting the structured nature of neuronal boundary detection. We demonstrate the effectiveness of the proposed techniques on large-scale ssEM images acquired from the mouse primary visual cortex. Lastly, we take a radical departure from simple boundary detection by exploring an alternative approach to object-centered representation, that is, learning dense voxel embeddings via deep metric learning. Convolutional nets are trained to generate dense voxel embeddings by assigning similar vectors to voxels within the same objects and well-separated vectors to voxels from different objects. Our proposed method achieves state-of-the-art accuracy with substantial improvements on very thin objects."],"dc:description.degree":["Ph. D. in Computation"],"dc:identifier.uri":["https://hdl.handle.net/1721.1/133076"],"dc:language.iso":["eng"],"dc:publisher":["Massachusetts Institute of Technology"],"dc:rights":["MIT theses may be protected by copyright. Please reuse MIT thesis content according to the MIT Libraries Permissions Policy, which is available through the URL provided."],"dc:rights.uri":["http://dspace.mit.edu/handle/1721.1/7582"],"dc:subject":["Brain and Cognitive Sciences."],"dc:title":["Reconstructing neurons from serial section electron microscopy images"],"dc:type":["Thesis"],"thesis:degree_name":["Doctoral"]},"updated_at":"2026-07-22T22:21:07Z"}