Project Everest

Proposed Experiment

[JAN 19] User Experience Testing (Solution) - Fiji FarmEd I

Katerina Grypma
Katerina Grypma | Jan 7, 2019 | in FarmEd - Fiji

Lean Phase:

- Solution (MVP/Prototyping)


Farmers are regularly implementing the information given by the application.

Time Box:

3 weeks

Key Metrics:

Whether the app is being implemented regularly, i.e. once a week.

2 seperate data collection methods will operate: one for use of app and one for use of text message alternative.

See attached multiple choice questionnaire. Aiming to survey 30 farmers using this questionnaire.

Success point:

At least 80% of farmers surveyed have been implementing information from the app at least once a week (surveying will take place at least 4 days after farmers initially have access to the app to allow farmers time to use the app).

Only 0-20% have experienced negative results from implementing the app info.


Green Light:

  1. Collect feedback from farmers that weren’t satisfied with the app and/or experienced negative results.

  2. Collect more long-term feedback regarding regular implementation of the app (i.e. test regularity of use over 1-3 months), as well as any recommendations from farmers who had positive results.

  3. Move to testing next assumption.


Orange Light Range:

50-70% of farmers have been implementing information from the app at least once a week.


Orange Light:

Focus on collecting feedback from the farmers that weren’t satisfied with the app and/or experienced negative results, in order to identify potentially major issues.


Failure Point:

0-50% of farmers reached the success point.


Red Light:

  1. Compile a database of all negative results to identify most common negative results to target.

  2. Thoroughly review and alter information provided by app based upon this, and hence test new version of app to ensure negative results have been minimised.


Experiment build:

  1. Develop text message-based alternative to test regular or interaction with information provided (only to be used with farmers that do not have access to mobile data).

  2. Develop multiple choice questionnaire to easily categorise data collected.

  3. 4 days after sales of app commence, begin to meet with farmers and conduct surveys.

  4. Survey each farmer 3 times over the 3 weeks (at regular intervals) to track regularity of use of app. Text message alternative will simulate use of app for farmers without access to mobile data. See standard operating procedure for details.

  5. Survey 30 farmers (in total, i.e. sum of those with data and those without data) using this method.

edited on 13th January 2019, 21:01 by Jess Riley

Fiona Aaron Jan 8, 2019

This feels so similar to the other 2 experiments about UX and interaction with the content.

Where have the timelines in this experiment come from? Why is once a week the appropriate time frame to be interacting with the app? Just wondering because for example a farmer might use the calendar feature and say that he wants to grow corn in March (for e.g.) and it'll tell him when to do all the steps. He might need to sow the land week 1, and then seed week 2, but then not fertilise until week 4 (not sure if this is the case but trying to understand why 1 week is the chosen time here).
Similarly, how often do they detect and want to treat pests and diseases?
I just wonder if the use of this app (particularly without sensors for regular pH monitoring) is going to be something used more than once a week.

Are these all assumptions? Or have farmers said that's how they think they will be interacting?

If anything, I would design an experiment around questioning the farmers on how they expect to be interacting with the app based on the features we have given them (i.e. how often do they plant a new crop, how often are diseases/pests recognised and treated etc) so we have a baseline to compare your experiment information to. Without this info, we don't really know how to judge a success or failure...

Reply 2

James Balzer Jan 11, 2019

I can see what Fi's saying. I think that FarmEd Fiji is focussing on doing 3 concurrent user experience testing experiments when I don't particularly see the point. They all seem to achieve the similar things.

I think this experiment would most likely be best implemented after you've found out how well the farmers have been able to use the app and its associated features. The reason is that their inability to use certain functions of the app could be a variable that influences how often and how effectively they implement the information that they receive from the app.

Likewise, the app isn't fully complete yet, so perhaps it would be difficult to understand if its lack of completeness is influencing their ability to implement the information that they're provided.

Reply 0

Katerina Grypma Jan 13, 2019

Hey Fiona, thanks so much for your feedback. Originally the one week time frame was settled upon as, looking at the app, it appeared to suggest a few activities to complete each day, and as we assumed a farmer would be able to use the app for a handful of crops at a time while we were here, it appeared a reasonable time frame. Being on project for a week now, I understand that this is based on a few unproven assumptions and that this experiment is quite difficult to conduct at this point in time. I think reframing this experiment to gauge how farmers expect to be interacting with the app would probably be useful, I will work on that in the next couple of days.

Hi James, I agree, looking at the app in its current form, I don't think there's much point going ahead with this right now. Thanks for the comment, also see above for my reply to Fiona's.

Reply 0

View all replies (2)

Jess Riley Jan 13, 2019

Status labels added: Proposed Experiment, Under Review

Reply 0