{"id":{"repo_id":"mit","oai_identifier":"oai:dspace.mit.edu:1721.1/119550"},"canonical_url":"https://search.dev.ndltd.org/etd/mit/oai:dspace.mit.edu:1721.1/119550","repository":{"repo_id":"mit","name":"MIT","base_url":"https://dspace.mit.edu/oai/request"},"display":{"title":"A flexible framework for composing end to end machine learning pipelines","abstract":"In this thesis, we aim to simplify the building of end-to-end machine learning pipelines while preserving the performance of such pipelines on real data. As a solution to this, we propose the MLBlocks framework, a system that allows an end user to obtain a pipeline with only data and a list of data science blocks. Once a pipeline is specified, a user can tune its hyper-parameters, as well as fit and predictions, with minimal code. When building MLBlocks, we first develop a data science block library that seamlessly integrates third party blocks without integration code, providing a foundation for users to start building data science pipelines. We then provide the MLPipeline framework that allows users to simply tie together these blocks and perform the aforementioned tuning, fitting, and predicting operations with the resulting pipelines. Finally, we test the framework's usability as well as its ability to preserve performance on real data by running several pipelines on various data modalities and by integrating MLBlocks into a larger scale project. Since we are able to replicate the pipelines already in use, we are able to obtain identical results while dramatically simplifying application logic. We conclude that MLBlocks succeeds in providing a simple but effective solution to making the construction of high-performing end-to-end pipelines both simpler and more accessible.","abstract_html":"In this thesis, we aim to simplify the building of end-to-end machine learning pipelines while preserving the performance of such pipelines on real data. As a solution to this, we propose the MLBlocks framework, a system that allows an end user to obtain a pipeline with only data and a list of data science blocks. Once a pipeline is specified, a user can tune its hyper-parameters, as well as fit and predictions, with minimal code. When building MLBlocks, we first develop a data science block library that seamlessly integrates third party blocks without integration code, providing a foundation for users to start building data science pipelines. We then provide the MLPipeline framework that allows users to simply tie together these blocks and perform the aforementioned tuning, fitting, and predicting operations with the resulting pipelines. Finally, we test the framework's usability as well as its ability to preserve performance on real data by running several pipelines on various data modalities and by integrating MLBlocks into a larger scale project. Since we are able to replicate the pipelines already in use, we are able to obtain identical results while dramatically simplifying application logic. We conclude that MLBlocks succeeds in providing a simple but effective solution to making the construction of high-performing end-to-end pipelines both simpler and more accessible.","abstract_has_math":false,"creators":["Xue, William, M. Eng. Massachusetts Institute of Technology"],"institution":"Massachusetts Institute of Technology","degree_name":null,"degree_level":null,"degree_discipline":null,"degree_department":"Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science.","school":null,"contributors":[],"advisors":["Kalyan Veeramachaneni."],"committee_chairs":[],"committee_members":[],"year":2018,"date_issued":"2018","date_published":"2018","updated_at":"2026-07-22T22:21:49Z","subjects":["Electrical Engineering and Computer Science."],"languages":["eng"],"rights":["MIT theses are protected by copyright. They may be viewed, downloaded, or printed from this source but further reproduction or distribution in any format is prohibited without written permission."],"rights_urls":["http://dspace.mit.edu/handle/1721.1/7582"],"identifier_entries":[]},"links":{"outbound_url":"http://hdl.handle.net/1721.1/119550","outbound_label":"Handle","outbound_source":"dc:identifier.uri"},"metadata_groups":[{"id":"people","label":"People","entries":[{"key":"dc:contributor.advisor","label":"Advisor","values":["Kalyan Veeramachaneni."]},{"key":"dc:contributor.department","label":"Department","values":["Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science."]},{"key":"dc:contributor.other","label":"Dc Contributor Other","values":["Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science."]},{"key":"dc:creator","label":"Author","values":["Xue, William, M. Eng. Massachusetts Institute of Technology"]}]},{"id":"academic_context","label":"Academic Context","entries":[{"key":"dc:date.accessioned","label":"Dc Date Accessioned","values":["2018-12-11T20:39:45Z"]},{"key":"dc:date.available","label":"Dc Date Available","values":["2018-12-11T20:39:45Z"]},{"key":"dc:date.issued","label":"Date","values":["2018"]},{"key":"dc:publisher","label":"Institution","values":["Massachusetts Institute of Technology"]},{"key":"dc:type","label":"Dc Type","values":["Thesis"]}]},{"id":"subjects_keywords","label":"Subjects and Keywords","entries":[{"key":"dc:subject","label":"Dc Subject","values":["Electrical Engineering and Computer Science."]}]},{"id":"language_rights","label":"Language and Rights","entries":[{"key":"dc:language.iso","label":"Language (ISO)","values":["eng"]},{"key":"dc:rights","label":"Dc Rights","values":["MIT theses are protected by copyright. They may be viewed, downloaded, or printed from this source but further reproduction or distribution in any format is prohibited without written permission."]},{"key":"dc:rights.uri","label":"Rights URI","values":["http://dspace.mit.edu/handle/1721.1/7582"]}]},{"id":"identifiers","label":"Identifiers","entries":[{"key":"dc:identifier.uri","label":"Identifier URI","values":["http://hdl.handle.net/1721.1/119550"]}]},{"id":"additional","label":"Additional Metadata","entries":[{"key":"dc:description","label":"Description","values":["Thesis: M. Eng. in Computer Science and Engineering, Massachusetts Institute of Technology, Department of Electrical Engineering and Computer Science, 2018.","This electronic version was submitted by the student author. The certified thesis is available in the Institute Archives and Special Collections.","Cataloged from student-submitted PDF version of thesis.","Includes bibliographical references (pages 91-92)."]},{"key":"dc:description.abstract","label":"Abstract","values":["In this thesis, we aim to simplify the building of end-to-end machine learning pipelines while preserving the performance of such pipelines on real data. As a solution to this, we propose the MLBlocks framework, a system that allows an end user to obtain a pipeline with only data and a list of data science blocks. Once a pipeline is specified, a user can tune its hyper-parameters, as well as fit and predictions, with minimal code. When building MLBlocks, we first develop a data science block library that seamlessly integrates third party blocks without integration code, providing a foundation for users to start building data science pipelines. We then provide the MLPipeline framework that allows users to simply tie together these blocks and perform the aforementioned tuning, fitting, and predicting operations with the resulting pipelines. Finally, we test the framework's usability as well as its ability to preserve performance on real data by running several pipelines on various data modalities and by integrating MLBlocks into a larger scale project. Since we are able to replicate the pipelines already in use, we are able to obtain identical results while dramatically simplifying application logic. We conclude that MLBlocks succeeds in providing a simple but effective solution to making the construction of high-performing end-to-end pipelines both simpler and more accessible."]},{"key":"dc:description.degree","label":"Dc Description Degree","values":["M. Eng. in Computer Science and Engineering"]},{"key":"dc:title","label":"Title","values":["A flexible framework for composing end to end machine learning pipelines"]}]}],"canonical_facts":{"dc:contributor.advisor":["Kalyan Veeramachaneni."],"dc:contributor.department":["Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science."],"dc:contributor.other":["Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science."],"dc:creator":["Xue, William, M. Eng. Massachusetts Institute of Technology"],"dc:date.accessioned":["2018-12-11T20:39:45Z"],"dc:date.available":["2018-12-11T20:39:45Z"],"dc:date.issued":["2018"],"dc:description":["Thesis: M. Eng. in Computer Science and Engineering, Massachusetts Institute of Technology, Department of Electrical Engineering and Computer Science, 2018.","This electronic version was submitted by the student author. The certified thesis is available in the Institute Archives and Special Collections.","Cataloged from student-submitted PDF version of thesis.","Includes bibliographical references (pages 91-92)."],"dc:description.abstract":["In this thesis, we aim to simplify the building of end-to-end machine learning pipelines while preserving the performance of such pipelines on real data. As a solution to this, we propose the MLBlocks framework, a system that allows an end user to obtain a pipeline with only data and a list of data science blocks. Once a pipeline is specified, a user can tune its hyper-parameters, as well as fit and predictions, with minimal code. When building MLBlocks, we first develop a data science block library that seamlessly integrates third party blocks without integration code, providing a foundation for users to start building data science pipelines. We then provide the MLPipeline framework that allows users to simply tie together these blocks and perform the aforementioned tuning, fitting, and predicting operations with the resulting pipelines. Finally, we test the framework's usability as well as its ability to preserve performance on real data by running several pipelines on various data modalities and by integrating MLBlocks into a larger scale project. Since we are able to replicate the pipelines already in use, we are able to obtain identical results while dramatically simplifying application logic. We conclude that MLBlocks succeeds in providing a simple but effective solution to making the construction of high-performing end-to-end pipelines both simpler and more accessible."],"dc:description.degree":["M. Eng. in Computer Science and Engineering"],"dc:identifier.uri":["http://hdl.handle.net/1721.1/119550"],"dc:language.iso":["eng"],"dc:publisher":["Massachusetts Institute of Technology"],"dc:rights":["MIT theses are protected by copyright. They may be viewed, downloaded, or printed from this source but further reproduction or distribution in any format is prohibited without written permission."],"dc:rights.uri":["http://dspace.mit.edu/handle/1721.1/7582"],"dc:subject":["Electrical Engineering and Computer Science."],"dc:title":["A flexible framework for composing end to end machine learning pipelines"],"dc:type":["Thesis"]},"updated_at":"2026-07-22T22:21:49Z"}