{"id":{"repo_id":"mit","oai_identifier":"oai:dspace.mit.edu:1721.1/145597"},"canonical_url":"https://search.dev.ndltd.org/etd/mit/oai:dspace.mit.edu:1721.1/145597","repository":{"repo_id":"mit","name":"MIT","base_url":"https://dspace.mit.edu/oai/request"},"display":{"title":"Advancing System Models of Brain Processing via Integrative Benchmarking","abstract":"Research in the brain and cognitive sciences attempts to uncover the neural mechanisms underlying intelligent behavior in domains such as vision or language. Due to the complexities of brain processing, studies necessarily had to start with a narrow scope of experimental investigation and computational modeling. This thesis argues that it is time for our field to take the next step: build system models that capture neural mechanisms and supported behaviors within an entire domain of intelligence. To make progress on system models, we propose integrative benchmarking – integrating experimental results from many laboratories into suites of benchmarks that guide and constrain those models at multiple stages and scales. We show-case this approach by developing Brain-Score benchmark suites for neural and behavioral experiments in the primate visual ventral stream and the human language system, as well as direct neural (causal) perturbation experiments in inferotemporal cortex. By systematically evaluating a wide variety of model candidates, we not only identify models beginning to match a range of brain data (∼ 50% explained variance), but also discover key relationships: Models’ brain scores are predicted by their object categorization performance in vision (but only up to 70% ImageNet accuracy), and their next-word prediction performance in language. The better models predict internal neural activity, the better they match human behavioral outputs, with architecture substantially contributing to brain-like representations. Using the integrative benchmarks, we develop improved state-of-the-art system models that more closely match shallow recurrent neuroanatomy and predict primate temporal processing, as well as models that require only a fraction of supervised synaptic updates. Taken together, the integrative benchmarks and system models presented here are first steps to modeling the complexities of brain processing in entire domains of intelligence.","abstract_html":"Research in the brain and cognitive sciences attempts to uncover the neural mechanisms underlying intelligent behavior in domains such as vision or language. Due to the complexities of brain processing, studies necessarily had to start with a narrow scope of experimental investigation and computational modeling. This thesis argues that it is time for our field to take the next step: build system models that capture neural mechanisms and supported behaviors within an entire domain of intelligence. To make progress on system models, we propose integrative benchmarking – integrating experimental results from many laboratories into suites of benchmarks that guide and constrain those models at multiple stages and scales. We show-case this approach by developing Brain-Score benchmark suites for neural and behavioral experiments in the primate visual ventral stream and the human language system, as well as direct neural (causal) perturbation experiments in inferotemporal cortex. By systematically evaluating a wide variety of model candidates, we not only identify models beginning to match a range of brain data (∼ 50% explained variance), but also discover key relationships: Models’ brain scores are predicted by their object categorization performance in vision (but only up to 70% ImageNet accuracy), and their next-word prediction performance in language. The better models predict internal neural activity, the better they match human behavioral outputs, with architecture substantially contributing to brain-like representations. Using the integrative benchmarks, we develop improved state-of-the-art system models that more closely match shallow recurrent neuroanatomy and predict primate temporal processing, as well as models that require only a fraction of supervised synaptic updates. Taken together, the integrative benchmarks and system models presented here are first steps to modeling the complexities of brain processing in entire domains of intelligence.","abstract_has_math":false,"creators":["Schrimpf, Martin"],"institution":"Massachusetts Institute of Technology","degree_name":"Doctoral","degree_level":null,"degree_discipline":null,"degree_department":"Massachusetts Institute of Technology. Department of Brain and Cognitive Sciences","school":null,"contributors":[],"advisors":["DiCarlo, James J."],"committee_chairs":[],"committee_members":[],"year":2022,"date_issued":"2022-05","date_published":"2022-05","updated_at":"2026-07-22T22:21:13Z","subjects":[],"languages":[],"rights":["In Copyright - Educational Use Permitted","Copyright MIT"],"rights_urls":["http://rightsstatements.org/page/InC-EDU/1.0/"],"identifier_entries":[]},"links":{"outbound_url":"https://hdl.handle.net/1721.1/145597","outbound_label":"Handle","outbound_source":"dc:identifier.uri"},"metadata_groups":[{"id":"people","label":"People","entries":[{"key":"dc:contributor.advisor","label":"Advisor","values":["DiCarlo, James J."]},{"key":"dc:contributor.department","label":"Department","values":["Massachusetts Institute of Technology. Department of Brain and Cognitive Sciences"]},{"key":"dc:creator","label":"Author","values":["Schrimpf, Martin"]}]},{"id":"academic_context","label":"Academic Context","entries":[{"key":"dc:date.accessioned","label":"Dc Date Accessioned","values":["2022-09-27T20:16:06Z"]},{"key":"dc:date.available","label":"Dc Date Available","values":["2022-09-27T20:16:06Z"]},{"key":"dc:date.issued","label":"Date","values":["2022-05"]},{"key":"dc:publisher","label":"Institution","values":["Massachusetts Institute of Technology"]},{"key":"dc:type","label":"Dc Type","values":["Thesis"]},{"key":"thesis:degree_name","label":"Degree Name","values":["Doctoral","Doctor of Philosophy"]}]},{"id":"language_rights","label":"Language and Rights","entries":[{"key":"dc:rights","label":"Dc Rights","values":["In Copyright - Educational Use Permitted","Copyright MIT"]},{"key":"dc:rights.uri","label":"Rights URI","values":["http://rightsstatements.org/page/InC-EDU/1.0/"]}]},{"id":"identifiers","label":"Identifiers","entries":[{"key":"dc:identifier.uri","label":"Identifier URI","values":["https://hdl.handle.net/1721.1/145597"]}]},{"id":"additional","label":"Additional Metadata","entries":[{"key":"dc:description.abstract","label":"Abstract","values":["Research in the brain and cognitive sciences attempts to uncover the neural mechanisms underlying intelligent behavior in domains such as vision or language. Due to the complexities of brain processing, studies necessarily had to start with a narrow scope of experimental investigation and computational modeling. This thesis argues that it is time for our field to take the next step: build system models that capture neural mechanisms and supported behaviors within an entire domain of intelligence. To make progress on system models, we propose integrative benchmarking – integrating experimental results from many laboratories into suites of benchmarks that guide and constrain those models at multiple stages and scales. We show-case this approach by developing Brain-Score benchmark suites for neural and behavioral experiments in the primate visual ventral stream and the human language system, as well as direct neural (causal) perturbation experiments in inferotemporal cortex. By systematically evaluating a wide variety of model candidates, we not only identify models beginning to match a range of brain data (∼ 50% explained variance), but also discover key relationships: Models’ brain scores are predicted by their object categorization performance in vision (but only up to 70% ImageNet accuracy), and their next-word prediction performance in language. The better models predict internal neural activity, the better they match human behavioral outputs, with architecture substantially contributing to brain-like representations. Using the integrative benchmarks, we develop improved state-of-the-art system models that more closely match shallow recurrent neuroanatomy and predict primate temporal processing, as well as models that require only a fraction of supervised synaptic updates. Taken together, the integrative benchmarks and system models presented here are first steps to modeling the complexities of brain processing in entire domains of intelligence."]},{"key":"dc:description.degree","label":"Dc Description Degree","values":["Ph.D."]},{"key":"dc:title","label":"Title","values":["Advancing System Models of Brain Processing via Integrative Benchmarking"]}]}],"canonical_facts":{"dc:contributor.advisor":["DiCarlo, James J."],"dc:contributor.department":["Massachusetts Institute of Technology. Department of Brain and Cognitive Sciences"],"dc:creator":["Schrimpf, Martin"],"dc:date.accessioned":["2022-09-27T20:16:06Z"],"dc:date.available":["2022-09-27T20:16:06Z"],"dc:date.issued":["2022-05"],"dc:description.abstract":["Research in the brain and cognitive sciences attempts to uncover the neural mechanisms underlying intelligent behavior in domains such as vision or language. Due to the complexities of brain processing, studies necessarily had to start with a narrow scope of experimental investigation and computational modeling. This thesis argues that it is time for our field to take the next step: build system models that capture neural mechanisms and supported behaviors within an entire domain of intelligence. To make progress on system models, we propose integrative benchmarking – integrating experimental results from many laboratories into suites of benchmarks that guide and constrain those models at multiple stages and scales. We show-case this approach by developing Brain-Score benchmark suites for neural and behavioral experiments in the primate visual ventral stream and the human language system, as well as direct neural (causal) perturbation experiments in inferotemporal cortex. By systematically evaluating a wide variety of model candidates, we not only identify models beginning to match a range of brain data (∼ 50% explained variance), but also discover key relationships: Models’ brain scores are predicted by their object categorization performance in vision (but only up to 70% ImageNet accuracy), and their next-word prediction performance in language. The better models predict internal neural activity, the better they match human behavioral outputs, with architecture substantially contributing to brain-like representations. Using the integrative benchmarks, we develop improved state-of-the-art system models that more closely match shallow recurrent neuroanatomy and predict primate temporal processing, as well as models that require only a fraction of supervised synaptic updates. Taken together, the integrative benchmarks and system models presented here are first steps to modeling the complexities of brain processing in entire domains of intelligence."],"dc:description.degree":["Ph.D."],"dc:identifier.uri":["https://hdl.handle.net/1721.1/145597"],"dc:publisher":["Massachusetts Institute of Technology"],"dc:rights":["In Copyright - Educational Use Permitted","Copyright MIT"],"dc:rights.uri":["http://rightsstatements.org/page/InC-EDU/1.0/"],"dc:title":["Advancing System Models of Brain Processing via Integrative Benchmarking"],"dc:type":["Thesis"],"thesis:degree_name":["Doctoral","Doctor of Philosophy"]},"updated_at":"2026-07-22T22:21:13Z"}