Project Everest

Adopted Experiment

[EXPERIMENT ADOPTED]: Impact assessment 2/2 - FarmEd Timor December 2018

India Shepherd
India Shepherd | 11 months ago | in FarmEd - Timor-Leste

To be completed alongside: The Quantitative Impact assessment experiment.


Lean phase: Key Metrics.


Assumption: The impact of the FarmEd app is positive and can be validated through both qualitative assessment.


Time Period: One year.


Success metric: % of people who:


  1. Have increased physical and personal energy levels.


  1. Increased time spent with family.


  1. Decreased levels of frustration or concern.


This can result in positive, neutral or negative impacts.



Green light: Proceed with the sales, improvement and scalability of the FarmEd app across Timor-Leste.


Success point: If the amount of positive outcomes is 70% or more, or if the negative outcomes is less than 20%.


Orange light: Optimise app using the data and feedback received from the farmers themselves, creating a more user centric product that is increasingly tailored to the specific needs of the Timorese farmers.


Red light: Assess the negative impacts of the FarmEd app and adjust the service to negate these impacts to the highest possible extent. Assess impact again.


Failure point: If the amount of positive impacts that the app has on the Timorese community is 20% or less, or if the amount of negative impacts is 50% or more.


Experiment build:


  1. Select 10 case study farmers through empathising. Get a wide spread from different regions, socio-economic status and farm sizes.

  2. Gather specific information in regards to information on their general health, emotions in regards to farming and how their farms affect their family life.

  3. Empathise with farmers in February, have discussion as to what of the app they have or haven’t used and how helpful they’ve found it.

  4. Allow case study customers to implement app on longer term- giving approximately six months before first follow up (July).

  5. Follow up feedback to be retrieved by July team, assessing the same areas as stated in step one along with some other questions.

  6. Allow another six months before second follow up, the same questions are to be used.

  7. Collate data and evaluate the impact

edited on 11th December 2018, 23:12 by Lucy Preiss

Grace Blackford 11 months ago

Hey India,

Both experiments look great! I was just wondering if there was capacity in your research to identify and measure the impacts upon specific areas such as community/economic/infrastructure/social structure etc, rather than focusing purely on the crops yields or emotions as identified in both the first and second experiment? This will be useful for FarmEd in both Timor and Fiji to ensure that all potential impacts can be mitigated.

Love this and am excited to see the results later on this year.

Reply 0

India Shepherd 11 months ago

Hey Grace,

Definitely! This is something I hope to develop over the month here in Timor, an experiment that looks at these larger scale impacts perhaps over an even larger time frame!

Thanks for the feedback! :)

Users tagged:

Reply 0

Lucy Preiss 11 months ago

Status label added: Experiment adopted

Reply 0

Marco Stocca 11 months ago

Great post India, keep it up!

Reply 0

Fiona Aaron 11 months ago

Just wondering how you have come up with the 3 impact metrics?
1. Have increased physical and personal energy levels.
2. Increased time spent with family.
3. Decreased levels of frustration or concern.
Has this been based on feedback that the farmers have given? Does yield/farmed app correlate with personal energy levels?
Definitely understand 2 and 3 though. Just hoping for a clarification. Thanks!

Reply 0

India Shepherd 10 months ago

Hi Fiona!
One of the apps features is harvest timings, this is to guide farmers on when the crops will be at peak nutritional value. This would therefore theoretically correlate with energy levels, however this would be a hard to establish due to energy being dependant on a lot of things.

Reply 0