Developmental Sentence Scoring (DSS; Lee 1974) is a well established, structured method for analyzing a child's expressive syntax within the context of a conversational speech sample. Automated DSS programs may increase efficiency of DSS analysis; however the program must be accurate in order to yield valid and reliable results. A recent study by Sagae, Lavie, and MacWhinney (2005) proposed a new method for analyzing the accuracy of automated language analysis programs. This method was used in addition to previously established methods to analyze the accuracy of a new automated DSS program, entitled DSSA (Channell, 2006). Previously collected language samples from 118 children between the ages of 3 and 11 years in age were manually and automatedly coded for DSS. The overall accuracy of DSSA was about 86%, while the mean point difference was approximately .7. DSSA generally scored language samples of children achieving lower manual DSS scores or children with language impairment with less accuracy than those of other children. While some precautions may need to be taken, accuracy levels are sufficiently high to allow the fully automated use of DSSA as an alternative to manual DSS scoring.
","abstract_html":"<p>Developmental Sentence Scoring (DSS; Lee 1974) is a well established, structured method for analyzing a child's expressive syntax within the context of a conversational speech sample. Automated DSS programs may increase efficiency of DSS analysis; however the program must be accurate in order to yield valid and reliable results. A recent study by Sagae, Lavie, and MacWhinney (2005) proposed a new method for analyzing the accuracy of automated language analysis programs. This method was used in addition to previously established methods to analyze the accuracy of a new automated DSS program, entitled DSSA (Channell, 2006). Previously collected language samples from 118 children between the ages of 3 and 11 years in age were manually and automatedly coded for DSS. The overall accuracy of DSSA was about 86%, while the mean point difference was approximately .7. DSSA generally scored language samples of children achieving lower manual DSS scores or children with language impairment with less accuracy than those of other children. While some precautions may need to be taken, accuracy levels are sufficiently high to allow the fully automated use of DSSA as an alternative to manual DSS scoring.</p>","abstract_has_math":false,"creators":["Judson, Carrie Ann"],"institution":"Brigham Young University - Provo","degree_name":"MS","degree_level":null,"degree_discipline":null,"degree_department":null,"school":null,"contributors":[],"advisors":[],"committee_chairs":[],"committee_members":[],"year":null,"date_issued":"","date_published":null,"updated_at":"2026-07-24T01:28:20Z","subjects":["Developmental Sentence Scoring","DSS","language sample","automated","software","Communication Sciences and Disorders"],"languages":["English"],"rights":[],"rights_urls":[],"identifier_entries":[]},"links":{"outbound_url":"https://scholarsarchive.byu.edu/etd/788","outbound_label":"Repository record","outbound_source":"dc:identifier"},"metadata_groups":[{"id":"people","label":"People","entries":[{"key":"dc:creator","label":"Author","values":["Judson, Carrie Ann"]}]},{"id":"academic_context","label":"Academic Context","entries":[{"key":"dc:date","label":"Dc Date","values":["2006-07-14T07:00:00Z"]},{"key":"dc:publisher","label":"Institution","values":["Brigham Young University - Provo"]},{"key":"dc:type","label":"Dc Type","values":["Thesis"]},{"key":"thesis:degree_name","label":"Degree Name","values":["MS"]}]},{"id":"subjects_keywords","label":"Subjects and Keywords","entries":[{"key":"dc:subject","label":"Dc Subject","values":["Developmental Sentence Scoring","DSS","language sample","automated","software","Communication Sciences and Disorders"]}]},{"id":"language_rights","label":"Language and Rights","entries":[{"key":"dc:language","label":"Dc Language","values":["English"]}]},{"id":"identifiers","label":"Identifiers","entries":[{"key":"dc:identifier","label":"Identifier","values":["https://scholarsarchive.byu.edu/etd/788","https://scholarsarchive.byu.edu/context/etd/article/1787/viewcontent/ETD_CISOPTR_808.pdf"]}]},{"id":"additional","label":"Additional Metadata","entries":[{"key":"dc:description","label":"Description","values":["David O. McKay School of Education; Communication Disorders","David O. McKay School of Education;Audiology and Speech-Language Pathology
"]},{"key":"dc:description.abstract","label":"Abstract","values":["Developmental Sentence Scoring (DSS; Lee 1974) is a well established, structured method for analyzing a child's expressive syntax within the context of a conversational speech sample. Automated DSS programs may increase efficiency of DSS analysis; however the program must be accurate in order to yield valid and reliable results. A recent study by Sagae, Lavie, and MacWhinney (2005) proposed a new method for analyzing the accuracy of automated language analysis programs. This method was used in addition to previously established methods to analyze the accuracy of a new automated DSS program, entitled DSSA (Channell, 2006). Previously collected language samples from 118 children between the ages of 3 and 11 years in age were manually and automatedly coded for DSS. The overall accuracy of DSSA was about 86%, while the mean point difference was approximately .7. DSSA generally scored language samples of children achieving lower manual DSS scores or children with language impairment with less accuracy than those of other children. While some precautions may need to be taken, accuracy levels are sufficiently high to allow the fully automated use of DSSA as an alternative to manual DSS scoring.
"]},{"key":"dc:format","label":"Dc Format","values":["application:pdf"]},{"key":"dc:source","label":"Dc Source","values":["Brigham Young University - Provo"]},{"key":"dc:title","label":"Title","values":["Accuracy of Automated Developmental Sentence Scoring Software"]}]}],"canonical_facts":{"dc:creator":["Judson, Carrie Ann"],"dc:date":["2006-07-14T07:00:00Z"],"dc:description":["David O. McKay School of Education; Communication Disorders","David O. McKay School of Education;Audiology and Speech-Language Pathology
"],"dc:description.abstract":["Developmental Sentence Scoring (DSS; Lee 1974) is a well established, structured method for analyzing a child's expressive syntax within the context of a conversational speech sample. Automated DSS programs may increase efficiency of DSS analysis; however the program must be accurate in order to yield valid and reliable results. A recent study by Sagae, Lavie, and MacWhinney (2005) proposed a new method for analyzing the accuracy of automated language analysis programs. This method was used in addition to previously established methods to analyze the accuracy of a new automated DSS program, entitled DSSA (Channell, 2006). Previously collected language samples from 118 children between the ages of 3 and 11 years in age were manually and automatedly coded for DSS. The overall accuracy of DSSA was about 86%, while the mean point difference was approximately .7. DSSA generally scored language samples of children achieving lower manual DSS scores or children with language impairment with less accuracy than those of other children. While some precautions may need to be taken, accuracy levels are sufficiently high to allow the fully automated use of DSSA as an alternative to manual DSS scoring.
"],"dc:format":["application:pdf"],"dc:identifier":["https://scholarsarchive.byu.edu/etd/788","https://scholarsarchive.byu.edu/context/etd/article/1787/viewcontent/ETD_CISOPTR_808.pdf"],"dc:language":["English"],"dc:publisher":["Brigham Young University - Provo"],"dc:source":["Brigham Young University - Provo"],"dc:subject":["Developmental Sentence Scoring","DSS","language sample","automated","software","Communication Sciences and Disorders"],"dc:title":["Accuracy of Automated Developmental Sentence Scoring Software"],"dc:type":["Thesis"],"thesis:degree_name":["MS"]},"updated_at":"2026-07-24T01:28:20Z"}