{"id":9926,"date":"2020-02-21T14:34:24","date_gmt":"2020-02-21T19:34:24","guid":{"rendered":"https:\/\/scoopmedia-develop.go-vip.net\/edscoop\/?p=9926"},"modified":"2020-02-21T14:34:24","modified_gmt":"2020-02-21T19:34:24","slug":"edtech-performance-data-mind-approach","status":"publish","type":"post","link":"https:\/\/scoopmedia-develop.go-vip.net\/edscoop\/edtech-performance-data-mind-approach\/","title":{"rendered":"Want to use edtech performance data? Try the MIND approach"},"content":{"rendered":"

Administrators selecting educational technology programs for their schools or districts face big decisions. Their choices will sap limited funding and time, so having accurate and relevant information about how the programs affect student performance should be a critical part of the decision-making process.<\/span><\/p>\n

During a recent <\/span>webinar<\/span><\/a> hosted by edWeb.net, Andrew Coulson, chief data science officer at the MIND Research Institute, and Brian LeTendre, the group\u2019s director of content and communications, explained a process for finding data that will help administrators make the best choices for their student populations, and in doing so \u201craise expectations about the availability of information\u201d during program evaluations.<\/span><\/p>\n

Rather than rely solely on randomized controlled trials, generally considered the gold standard for testing medical treatments, the MIND approach emphasizes the use of publicly available schoolwide performance data that can be matched to specific schools and types of students.<\/span><\/p>\n

Evaluating the evaluation process<\/h4>\n

The advantages of the process Coulson outlined include being able to look at student performance for a particular grade level over several years. This avoids \u201ccherry picking\u201d the data to present an exceptional performance in just one year, while ignoring other years that may be more typical. This approach also includes a wide range of students, so administrators can view data relating directly to the types of students in their schools.<\/span><\/p>\n

While acknowledging that randomized controlled trials have their place in what should be an \u201cedtech efficacy portfolio,\u201d Coulson said the time and expense required for this type of study usually makes them feasible only once every five or 10 years, limiting their ability to show progress over time and include the latest data.\u00a0<\/span><\/p>\n

RCTs also require a relatively small sample of students to control all the variables, so it really provides a snapshot of specific types of students at a specific time.<\/span><\/p>\n

In contrast, the MIND approach uses school-wide performance data published annually by the states for language arts and math, which provides a large enough pool of schools for administrators to find an effective match for their particular district or school. Administrators can consider factors such as whether the schools are urban, suburban or rural, and how many students participate in Title I programs.<\/span><\/p>\n

States may also break out the data in regard to specific subsets of learners, such as English-language learners and students with special needs, so the annual publishing of data can allow administrators to see how the same type of student performs in the same grade each year, as well as how much progress occurs as the same students advance.<\/span><\/p>\n

Having access to schoolwide performance data over a number of years also allows administrators to look at how students performed before the purchase of the program, and then for years afterward. This helps to determine how much of an impact the program had and how much improvement can be expected as a result of its purchase.\u00a0<\/span><\/p>\n

Putting good data to good use<\/h4>\n

For the MIND approach to be effective, there must be grade-wide enrollment in the edtech program being evaluated so that the test-score data published by the state applies to all students. Administrators can have confidence in this type of data because it is derived from rigorous standardized tests that are used statewide, so they provide a uniform basis for comparison.<\/span><\/p>\n

This approach has now been used for well over a decade, and Coulson explained that the methodology has been replicated by an independent education research lab, using different sample sizes. The methodology and results have also met What Works Clearinghouse and Every Student Succeeds Act standards for these types of studies.<\/span><\/p>\n

Coulson noted that \u201cother outcomes should also be considered, rather than just what happens on one day in April.\u201d Ideally, an edtech program\u2019s efficacy portfolio would include a randomized controlled test, samples of student work, videos of what happens inside the classroom, and qualitative input from educators and administrators, as well as access to schoolwide performance data that allows administrators to find the right match for their schools.<\/span><\/p>\n

Meanwhile, Coulson said he hopes the approach and results MIND Research Institute has developed will help administrators maximize the impact of an edtech purchase on student performance. He also believes it should create the expectation that every edtech program will have a positive response and supporting evidence when administrators ask, \u201cDo you have a study on a district like mine?\u201d<\/span><\/p>\n

About the presenter<\/b><\/p>\n

Andrew Coulson, chief data science officer at MIND Research Institute, leads a team of data analysts to conduct evaluations of student and teacher usage and outcomes of ST Math. He previously led MIND\u2019s education division for 12 years, where he helped to execute strategies to scale the organization\u2019s reach to over one million students. Prior to joining MIND, Coulson was the first education program officer for a major Orange County foundation and also worked for 17 years in upper management in high-tech manufacturing engineering. Coulson holds a master\u2019s degree in physics from UCLA.<\/span><\/p>\n

About the host<\/b><\/p>\n

Brian LeTendre serves as director of content and communications at MIND Research Institute. In addition to orchestrating content for MIND, he is an author, podcaster and avid gamer.<\/span><\/p>\n

Join the community<\/b><\/p>\n

EdFocus – An EdTech Industry Network<\/span><\/a> is a free professional learning community on edWeb.net that will help you connect with colleagues in the education industry to share information and resources, raise questions, and get advice.<\/span><\/p>\n

The edWeb webinar referenced above, sponsored by <\/span>MIND Research Institute<\/span><\/a>, can be found <\/span>here<\/span><\/a>.<\/span><\/p>\n","protected":false},"excerpt":{"rendered":"

Commentary: EdWeb.net\u2019s Robert Low explains an alternative to randomized controlled trials that might boost student performance.<\/p>\n","protected":false},"author":221,"featured_media":9929,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"disable_grayscale_images":true,"grayscale_contrast":0,"sponsored_content":false,"display_author_bio":true,"story_type":"","footnotes":""},"categories":[3],"tags":[3235,3236,3237,3238],"people":[],"special-report":[],"authors":[2827],"class_list":["post-9926","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-commentary","tag-edtech-performance-data","tag-mind-approach","tag-mind-research-institute","tag-brian-letendre","author-robert-low"],"yoast_head":"\nWant to use edtech performance data? Try the MIND approach | EdScoop<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/scoopmedia-develop.go-vip.net\/edscoop\/edtech-performance-data-mind-approach\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Want to use edtech performance data? Try the MIND approach | EdScoop\" \/>\n<meta property=\"og:description\" content=\"Commentary: EdWeb.net\u2019s Robert Low explains an alternative to randomized controlled trials that might boost student performance.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/scoopmedia-develop.go-vip.net\/edscoop\/edtech-performance-data-mind-approach\/\" \/>\n<meta property=\"og:site_name\" content=\"EdScoop\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/sngedscoop\/\" \/>\n<meta property=\"article:published_time\" content=\"2020-02-21T19:34:24+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/scoopmedia-develop.go-vip.net\/edscoop\/wp-content\/uploads\/sites\/4\/2020\/02\/a-brain-getty.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"1999\" \/>\n\t<meta property=\"og:image:height\" content=\"1499\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"Robert Low\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@EdScoop_news\" \/>\n<meta name=\"twitter:site\" content=\"@EdScoop_news\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/scoopmedia-develop.go-vip.net\\\/edscoop\\\/edtech-performance-data-mind-approach\\\/\",\"url\":\"https:\\\/\\\/scoopmedia-develop.go-vip.net\\\/edscoop\\\/edtech-performance-data-mind-approach\\\/\",\"name\":\"Want to use edtech performance data? Try the MIND approach | EdScoop\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/scoopmedia-develop.go-vip.net\\\/edscoop\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/scoopmedia-develop.go-vip.net\\\/edscoop\\\/edtech-performance-data-mind-approach\\\/#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/scoopmedia-develop.go-vip.net\\\/edscoop\\\/edtech-performance-data-mind-approach\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/scoopmedia-develop.go-vip.net\\\/edscoop\\\/wp-content\\\/uploads\\\/sites\\\/4\\\/2020\\\/02\\\/a-brain-getty.jpg\",\"datePublished\":\"2020-02-21T19:34:24+00:00\",\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/scoopmedia-develop.go-vip.net\\\/edscoop\\\/edtech-performance-data-mind-approach\\\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/scoopmedia-develop.go-vip.net\\\/edscoop\\\/edtech-performance-data-mind-approach\\\/#primaryimage\",\"url\":\"https:\\\/\\\/scoopmedia-develop.go-vip.net\\\/edscoop\\\/wp-content\\\/uploads\\\/sites\\\/4\\\/2020\\\/02\\\/a-brain-getty.jpg\",\"contentUrl\":\"https:\\\/\\\/scoopmedia-develop.go-vip.net\\\/edscoop\\\/wp-content\\\/uploads\\\/sites\\\/4\\\/2020\\\/02\\\/a-brain-getty.jpg\",\"width\":1999,\"height\":1499,\"caption\":\"(Getty Images)\"},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/scoopmedia-develop.go-vip.net\\\/edscoop\\\/#website\",\"url\":\"https:\\\/\\\/scoopmedia-develop.go-vip.net\\\/edscoop\\\/\",\"name\":\"EdScoop\",\"description\":\"Essential higher ed and K-12 information technology news\",\"publisher\":{\"@id\":\"https:\\\/\\\/scoopmedia-develop.go-vip.net\\\/edscoop\\\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/scoopmedia-develop.go-vip.net\\\/edscoop\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\\\/\\\/scoopmedia-develop.go-vip.net\\\/edscoop\\\/#organization\",\"name\":\"EdScoop\",\"url\":\"https:\\\/\\\/scoopmedia-develop.go-vip.net\\\/edscoop\\\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/scoopmedia-develop.go-vip.net\\\/edscoop\\\/#\\\/schema\\\/logo\\\/image\\\/\",\"url\":\"https:\\\/\\\/scoopmedia-develop.go-vip.net\\\/edscoop\\\/wp-content\\\/uploads\\\/sites\\\/4\\\/2023\\\/01\\\/EdScoop-Black.png\",\"contentUrl\":\"https:\\\/\\\/scoopmedia-develop.go-vip.net\\\/edscoop\\\/wp-content\\\/uploads\\\/sites\\\/4\\\/2023\\\/01\\\/EdScoop-Black.png\",\"width\":1098,\"height\":187,\"caption\":\"EdScoop\"},\"image\":{\"@id\":\"https:\\\/\\\/scoopmedia-develop.go-vip.net\\\/edscoop\\\/#\\\/schema\\\/logo\\\/image\\\/\"},\"sameAs\":[\"https:\\\/\\\/www.facebook.com\\\/sngedscoop\\\/\",\"https:\\\/\\\/x.com\\\/EdScoop_news\",\"https:\\\/\\\/www.linkedin.com\\\/company\\\/edscoop\",\"https:\\\/\\\/www.youtube.com\\\/@edscoop\"]}]}<\/script>\n<!-- \/ Yoast SEO Premium plugin. -->","yoast_head_json":{"title":"Want to use edtech performance data? Try the MIND approach | EdScoop","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/scoopmedia-develop.go-vip.net\/edscoop\/edtech-performance-data-mind-approach\/","og_locale":"en_US","og_type":"article","og_title":"Want to use edtech performance data? Try the MIND approach | EdScoop","og_description":"Commentary: EdWeb.net\u2019s Robert Low explains an alternative to randomized controlled trials that might boost student performance.","og_url":"https:\/\/scoopmedia-develop.go-vip.net\/edscoop\/edtech-performance-data-mind-approach\/","og_site_name":"EdScoop","article_publisher":"https:\/\/www.facebook.com\/sngedscoop\/","article_published_time":"2020-02-21T19:34:24+00:00","og_image":[{"width":1999,"height":1499,"url":"https:\/\/scoopmedia-develop.go-vip.net\/edscoop\/wp-content\/uploads\/sites\/4\/2020\/02\/a-brain-getty.jpg","type":"image\/jpeg"}],"author":"Robert Low","twitter_card":"summary_large_image","twitter_creator":"@EdScoop_news","twitter_site":"@EdScoop_news","schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/scoopmedia-develop.go-vip.net\/edscoop\/edtech-performance-data-mind-approach\/","url":"https:\/\/scoopmedia-develop.go-vip.net\/edscoop\/edtech-performance-data-mind-approach\/","name":"Want to use edtech performance data? Try the MIND approach | EdScoop","isPartOf":{"@id":"https:\/\/scoopmedia-develop.go-vip.net\/edscoop\/#website"},"primaryImageOfPage":{"@id":"https:\/\/scoopmedia-develop.go-vip.net\/edscoop\/edtech-performance-data-mind-approach\/#primaryimage"},"image":{"@id":"https:\/\/scoopmedia-develop.go-vip.net\/edscoop\/edtech-performance-data-mind-approach\/#primaryimage"},"thumbnailUrl":"https:\/\/scoopmedia-develop.go-vip.net\/edscoop\/wp-content\/uploads\/sites\/4\/2020\/02\/a-brain-getty.jpg","datePublished":"2020-02-21T19:34:24+00:00","inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/scoopmedia-develop.go-vip.net\/edscoop\/edtech-performance-data-mind-approach\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/scoopmedia-develop.go-vip.net\/edscoop\/edtech-performance-data-mind-approach\/#primaryimage","url":"https:\/\/scoopmedia-develop.go-vip.net\/edscoop\/wp-content\/uploads\/sites\/4\/2020\/02\/a-brain-getty.jpg","contentUrl":"https:\/\/scoopmedia-develop.go-vip.net\/edscoop\/wp-content\/uploads\/sites\/4\/2020\/02\/a-brain-getty.jpg","width":1999,"height":1499,"caption":"(Getty Images)"},{"@type":"WebSite","@id":"https:\/\/scoopmedia-develop.go-vip.net\/edscoop\/#website","url":"https:\/\/scoopmedia-develop.go-vip.net\/edscoop\/","name":"EdScoop","description":"Essential higher ed and K-12 information technology news","publisher":{"@id":"https:\/\/scoopmedia-develop.go-vip.net\/edscoop\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/scoopmedia-develop.go-vip.net\/edscoop\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/scoopmedia-develop.go-vip.net\/edscoop\/#organization","name":"EdScoop","url":"https:\/\/scoopmedia-develop.go-vip.net\/edscoop\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/scoopmedia-develop.go-vip.net\/edscoop\/#\/schema\/logo\/image\/","url":"https:\/\/scoopmedia-develop.go-vip.net\/edscoop\/wp-content\/uploads\/sites\/4\/2023\/01\/EdScoop-Black.png","contentUrl":"https:\/\/scoopmedia-develop.go-vip.net\/edscoop\/wp-content\/uploads\/sites\/4\/2023\/01\/EdScoop-Black.png","width":1098,"height":187,"caption":"EdScoop"},"image":{"@id":"https:\/\/scoopmedia-develop.go-vip.net\/edscoop\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/www.facebook.com\/sngedscoop\/","https:\/\/x.com\/EdScoop_news","https:\/\/www.linkedin.com\/company\/edscoop","https:\/\/www.youtube.com\/@edscoop"]}]}},"distributor_meta":false,"distributor_terms":false,"distributor_media":false,"distributor_original_site_name":"EdScoop","distributor_original_site_url":"https:\/\/scoopmedia-develop.go-vip.net\/edscoop","push-errors":false,"jetpack_featured_media_url":"https:\/\/scoopmedia-develop.go-vip.net\/edscoop\/wp-content\/uploads\/sites\/4\/2020\/02\/a-brain-getty.jpg","_links":{"self":[{"href":"https:\/\/scoopmedia-develop.go-vip.net\/edscoop\/wp-json\/wp\/v2\/posts\/9926","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/scoopmedia-develop.go-vip.net\/edscoop\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/scoopmedia-develop.go-vip.net\/edscoop\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/scoopmedia-develop.go-vip.net\/edscoop\/wp-json\/wp\/v2\/users\/221"}],"replies":[{"embeddable":true,"href":"https:\/\/scoopmedia-develop.go-vip.net\/edscoop\/wp-json\/wp\/v2\/comments?post=9926"}],"version-history":[{"count":1,"href":"https:\/\/scoopmedia-develop.go-vip.net\/edscoop\/wp-json\/wp\/v2\/posts\/9926\/revisions"}],"predecessor-version":[{"id":9927,"href":"https:\/\/scoopmedia-develop.go-vip.net\/edscoop\/wp-json\/wp\/v2\/posts\/9926\/revisions\/9927"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/scoopmedia-develop.go-vip.net\/edscoop\/wp-json\/wp\/v2\/media\/9929"}],"wp:attachment":[{"href":"https:\/\/scoopmedia-develop.go-vip.net\/edscoop\/wp-json\/wp\/v2\/media?parent=9926"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/scoopmedia-develop.go-vip.net\/edscoop\/wp-json\/wp\/v2\/categories?post=9926"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/scoopmedia-develop.go-vip.net\/edscoop\/wp-json\/wp\/v2\/tags?post=9926"},{"taxonomy":"people","embeddable":true,"href":"https:\/\/scoopmedia-develop.go-vip.net\/edscoop\/wp-json\/wp\/v2\/people?post=9926"},{"taxonomy":"special-report","embeddable":true,"href":"https:\/\/scoopmedia-develop.go-vip.net\/edscoop\/wp-json\/wp\/v2\/special-report?post=9926"},{"taxonomy":"author","embeddable":true,"href":"https:\/\/scoopmedia-develop.go-vip.net\/edscoop\/wp-json\/wp\/v2\/authors?post=9926"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}