Project Everest

Adopted Experiment

[EXPERIMENT ADOPTED]: Impact assessment 1/2 - FarmEd Timor December 2018

India Shepherd
India Shepherd | 11 months ago | in FarmEd - Timor-Leste

To be completed alongside: The Qualitative Impact assessment experiment.  


Lean phase: Key Metrics.


Assumption: The impact of the FarmEd app is positive and can be validated through quantitative assessment.


Time Period: One year.


Success metric: % of people who


  1. Increase levels of production measured by yield.


  1. Increase income as a result of ability to sell more produce.


  1. Implementation of app advice tracked by farm map collating crop types and location within farm.



Green light: Proceed with the sales, improvement and scalability of the FarmEd app across Timor-Leste.


Success point: If the amount of positive outcomes is 70% or more, or if the negative outcomes is less than 20%.


Orange light: Optimise app using the data and feedback received from the farmers themselves, creating a more user centric product that is increasingly tailored to the specific needs of the Timorese farmers.


Red light: Assess the negative impacts of the FarmEd app and adjust the service to negate these impacts to the highest possible extent, followed by a reassessment of impact.



Failure point: If the amount of positive impacts that the app has on the Timorese community is 20% or less, or if the number of negative impacts is 50% or more.


Experiment build:


  1. Select 10 case study farmers through empathising. Get a wide spread from different regions, socio-economic status and farm sizes.

  2. Gather specific information in regards to information on their general health, emotions in regards to farming and how their farms affect their family life.

  3. Empathise with farmers in February, have discussion as to what of the app they have or haven’t used and how helpful they’ve found it.

  4. Allow case study customers to implement app on longer term- giving approximately six months before first follow up (July).

  5. Follow up feedback to be retrieved by July team, assessing the same areas as stated in step one along with some other questions.

  6. Allow another six months before second follow up, the same questions are to be used.

  7. Collate data and evaluate the impact.

edited on 11th December 2018, 23:12 by Lucy Preiss

James Balzer 11 months ago

This is great India!

It's really good to see that you're looking at FarmEd's benefits in both a manner that is economic and also lifestyle orientated, as is obvious in both parts 1 and 2 of the impact assessment.

Could you potentially develop a different set of questions for each part of the impact assessment?

Likewise, be careful when it comes to recording data. It's easy to use Google Sheets, and it isn't a bad method per se, but be really careful to make sure that all of the data is recorded accurately and in its entirety between each individual that you perform the surveys with. This just provides better accuracy across the board and makes comparing data points easier.

Likewise, how will you remain in contact with the farmers on a 6 month interval basis?

Reply 0

India Shepherd 11 months ago

Thanks James!

Yes I agree it would be easier to track with separated forms, I will definitely get onto this ASAP. In terms of tracking the data, as this assessment is only planned to be performed on 10 farmers, I believe a google form / sheets situation would not be necessary, and instead observation and interviewing with the specific questions linked as a guide, would be the best method as it allows the most data to be obtained and then collated after.

As the case study participants will be customers of FarmEd, their exact location (longitude and latitude) will be recorded upon sale, along with their customer ID in the sales form currently in development, this will be entered into the map along with contact details. Visits to each of the case study participants will be imperative to this experiment as face to face contact will allow better assessment of impact.

Thanks for the feedback! :)

Reply 2

Lucy Preiss 11 months ago

Status label added: Experiment adopted

Reply 0

Fiona Aaron 11 months ago

Really good India. Just a thought however, I think that waiting 6 months to follow up is too challenging. With farmers using the app, maybe there is a better way for us to do a monthly check in from AUS to make sure they are logging their data and aren't having any issues - like messenger or whatsapp? It is important that we have regular contact with them while they are using the app so that we can ensure they are using it properly and can be agile with the development of the tech based on feedback received/difficulties encountered with farmers.
What do you think?

Reply 0

India Shepherd 11 months ago

Hey Fiona! Yes definitely, this is something we have been discussing regularly in terms of continual use for all the app users rather than just these case study participants! The current ideas we have been brainstorming include both using our facebook page to send reminders to check the app and also for them to ask us any questions. In future I think it could also be viable to integrate notifications sent straight from the app to the consumers phone as a reminder for usage, and to also set up a in app feedback form thus providing customer relevant suggestions for the developers in an efficient manner! Would you have any more suggestions for how this could be done?

Reply 1

Fiona Aaron 10 months ago

I think facebook/messenger/whatsapp seems like a good method. Have you done an experiment around how many have access/know how to use these services to contact us until the app has capability to have this? What has the feedback from farmers been like in terms of their view or expectation on customer support as part of our offering?

Reply 0

View all replies (2)