Evaluation & Assessment
Evaluation & Assessment
Contributing to the Jewish EdTech ecosystem requires an agile investment approach. The Lean start-up methodology (often referred to in the social sector as Lean Impact) offers an intuitive framework for achieving that agility. Simply stated, the method entails setting a hypothesis and then testing the hypothesis with three potential outcomes: validated, invalidated or unclear results. The next steps are scale-up, revisiting the hypothesis or tweaking the tests respectively.
The Lean Impact methodology is not a silver bullet; it depends on:
- Asking the right questions (generating the right hypothesis)
- Effectively testing these hypothesis
- Extracting meaningful lessons
- Iterating based on the lessons learned
More about the methodology can be found here
|Step 1. Hypothesis - We believe that…||Step 1. Hypothesis - We believed that…|
|Step 2. Test - To verify that, we will…||Step 2. Observation - We observed…|
|Step 3. Metric - And measure…||Step 3. Learning and insights - From that we learned that…|
|Step 4. Criteria - We are right if…||Step 4. Decisions and actions - Therefore we will…|
Simple but Complex
On the one hand, assessment is simple: it should clearly indicate what works, why and when. On the other hand, it’s complex: assessment seldom unfolds with such simplicity, given the practical barriers to effectively collecting data and measuring effectiveness in education generally and in education technology specifically.
EdTech simplifies data collection and validation. But it also increases the complexities, since many interventions measure movement rather than impact, which distorts rather than elucidates. All this is further complicated when seen through a Jewish educational lens, since the desired outcomes are more than academic.
Effective evaluation and assessment require technical expertise. Below are some high-level pointers for funders:
* Identify the educational technology standards for quality assurance
- Select the relevant tools for quality assurance
- Establish the data collection and data validation processes
- Most importantly, put in place a feedback loop which will enable lessons learned to inform future practice
Additional details on compliance monitoring, diagnostic monitoring and performance monitoring can be found here
Make a Difference and Contribute to the World of Jewish EdTech
As a potential funder looking to make an investment that contributes to the rapid growth of educational technologies within Jewish education initiatives, it is important to understand the various details involved in making successful investments with maximum impact.
Explore the following pages to learn more about integral elements to becoming an investor in educational innovation.