Staging --> production test acceptance requirements

[spwoodcock]

Testers Needed!

Anyone can test the latest version of FMTM.
We value any user testing that can inform us how to do better.

Please use the staging server for testing: https://staging.fmtm.hotosm.org

Test Requirements

To accept a staging --> production deployment we need a manual verification for each of the below.

Template

Essential functionality for mapping:

• Project summaries / home load
• Project details load
• QR code loads
• QR code works in ODK Collect
• MBTile generation
• PMTile generation, loaded into OPFS

Project creation:

• OSM login
• Temp login
• Data extract creation
• Custom data extract upload
• Custom XForm upload
• Task splitting algorithm

Stats:

• Task activity
• Task comments
• Task instructions
• Graphs
• Tables

General Workflow (from Ivan)

• Does the project load in the browser/PWA?
• Does the project look right in a mobile view (not just in a laptop browser)?
• Do the tasks show up when clicked?
  • Does it take time? How much time?
  • Do the buildings all show up (are there buildings visible in the OSM background that aren't in the data extract)?
  • Do the QR codes download properly?
• If you're using the latest forked version of ODK Collect, does the project launch from the FMTM link with the appropriate entity set preloaded?
• Can you access the MBTiles?
• Can you get the MBTiles onto your phone?
• If you're using the standard (Play Store) version of ODK Collect or Kobo Collect, does the project load correctly from QR Code import?
• Does the project start in a reasonable amount of time?
• Can you see the MBTiles in the map view?
• Do the appropriate buildings show up in the map view?
• Are the buildings displayed n the map view the same as what we see in the FMTM web/PWA view?
• If you try to fill out a survey (with made-up data) does the app or form crash?
• If you complete a form, does the data submit correctly?
• Anything else go wrong?

[spwoodcock]

2024.02 Release

Staging release date: 18th March 2024
Planned production release: 1st April 2024

@susmina94 @manjitapandey

Essential functionality for mapping:

• Project summaries / home load
• Project details load
• QR code loads
• QR code works in ODK Collect

Project creation:

• Login works
• Data extract creation
• Custom extract upload
• Custom XForm upload
• Task splitting algorithm

[spwoodcock]

2024.03 Release

Staging release date: ~24th April 2024
Planned production release: ~30th April 2024

Essential functionality for mapping:

• Project summaries / home load
• Project details load
• QR code loads
• QR code works in ODK Collect
• MBTile generation
• PMTile generation, loaded into OPFS

Project creation:

• OSM login works
• Temp login works
• Data extract creation
• Custom extract upload
• Custom XForm upload
• Task splitting algorithm

[spwoodcock]

From @ivangayton on a recent field test:

• Does the project load in the browser/PWA?
• Does the project look right in a mobile view (not just in a laptop browser)?
• Do the tasks show up when clicked?
  • Does it take time? How much time?
  • Do the buildings all show up (are there buildings visible in the OSM background that aren't in the data extract)?
  • Do the QR codes download properly?
• If you're using the latest forked version of ODK Collect, does the project launch from the FMTM link with the appropriate entity set preloaded?
• Can you access the MBTiles?
• Can you get the MBTiles onto your phone?
• If you're using the standard (Play Store) version of ODK Collect or Kobo Collect, does the project load correctly from QR Code import?
• Does the project start in a reasonable amount of time?
• Can you see the MBTiles in the map view?
• Do the appropriate buildings show up in the map view?
• Are the buildings displayed n the map view the same as what we see in the FMTM web/PWA view?
• If you try to fill out a survey (with made-up data) does the app or form crash?
• If you complete a form, does the data submit correctly?
• Anything else go wrong?

@ramyaragupathy @manjitapandey this is a good checklist for testing