Project Everest

Proposed Experiment

[Proposed Experiment]: FarmEd Timor-Leste (Solution) Application Feature Usability Test July 2019

Jemima Crawford
Jemima Crawford | 11 months ago | in FarmEd - Timor-Leste


This experiment aims to test the usability of the FarmEd application with its early adopter customer segment. It is to be conducted separately on each individual feature of the app (My Crops, My Calendar, Pests and Diseases, My Crop Growth).


Lean Phase:

Solution (MVP)



Farmers are able to navigate a smartphone and the FarmEd application effectively.


Time Box:

4 weeks


Success Metric:

% of early adopter farmers that are able to navigate the feature without instruction on the first or second attempt.


Green Light - Proceed with feature X inclusion on the app


Success point: 75% of farmers are able to navigate the feature X without instruction on the first or second attempt.


Orange light - analyse feedback and use to optimise feature X and tailor customers usability.


Failure Point: 80% of farmers are unable to navigate feature X without instruction on second attempt.


Red Light- Failure Protocol: Remove feature X from app.


Experiment Build:


  • Arrange time and place to meet with farmers (community meeting is recommended
  • Ensure farmers fit the criteria of early adopters (are literate, own a smartphone, own a farm, want to increase the quality/quantity of their crop yield)
  • Prepare translators and transport for farm visits
  • Download and set-up FarmEd app on a team members phone per experiment team
  • Prepare a results spreadsheet based on what the app looks like in July.


  • Establish one team member to speak with farmer while the others observe and take notes on how they interact with app
  • Hand farmer phone with feature currently being tested on screen
  • Initially don’t give instructions and observe whether they instinctively understand how to use feature
  • If the farmer appears not to understand, offer verbal instructions on how to use feature. 
  • Observe the ease at which the farmer follows these instructions.
  • If farmer requires instructions, repeat test on this feature at a later point (ie. after testing other features) and observe whether or not they remember how to navigate it without prompt


  • Enter all results into spreadsheet and analyse
  • Follow success metrics for future actions


Resources required:

  • Phone with app downloaded
  • Notebook and pen
  • Battery packs for phones
  • Translators


Potential Problems/Blocks:

  • Farmers are not home
  • App is malfunctioning/glitching
  • Translators not properly trained in how to use the app


Conduct 30 utility tests (per feature)

We believe this is adequate data to understand the utility of the app amongst Timorese farmers.


edited on 11th April 2019, 00:04 by Andrew Vild

Rose Gooding 11 months ago

Status label added: Experiment adopted

Reply 0

Rose Gooding 11 months ago

Status label added: Proposed Experiment

Status label removed: Experiment adopted

Reply 0