Feature request: Ability to add comments to a test run

Bug #1681574 reported by Rod Smith
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Next Generation Checkbox (CLI)
Fix Released
Medium
Sylvain Pineau

Bug Description

Sometimes I need to run Checkbox with some unusual configuration, hacked test scripts, etc. I may not upload the results to C3, but if I do, the details of what I've done will be lost and forgotten, which may cause confusion if those results are examined in the future. As an example, in working on bug #1681503, I upgraded stress-ng from version 0.07.21 to 0.07.28 on xenial and downgraded it from 0.07.28 to 0.07.21 on zesty, resulting in four submissions with results that depended on the stress-ng version installed. Even in the short term, I had to be careful to not confuse which results were which.

To help avoid confusion, it might be helpful to have a test comment field that can be entered prior to running tests and displayed as a test result on C3, ideally as the first test result shown on C3 so it's noticeable when reviewing old results. When running with an altered configuration, the tester could describe the changes made. There would, of course, still be the possibility of missing such a note, but if it were displayed prominently with the results, there'd at least be less of a chance of confusion; and if a test sequence involved several submissions, the comment field could help keep them straight even in the short term.

Revision history for this message
Maciej Kisielewski (kissiel) wrote :

You mean one comment that's related to the whole testing session?

I guess it would be good to have access to it from any 'screen' that checkbox is expecting user interaction - through some key shortcut.

Revision history for this message
Rod Smith (rodsmith) wrote :

Yes, an overall comment for the entire test run, like "tested with updated foo package" or "testing done with firmware settings X, Y, and Z."

Revision history for this message
Sylvain Pineau (sylvain-pineau) wrote :

Same request logged for HEXR: https://bugs.launchpad.net/hexr/+bug/1680485

Changed in checkbox-ng:
status: New → Triaged
importance: Undecided → Medium
milestone: none → future
Revision history for this message
Sylvain Pineau (sylvain-pineau) wrote :

C3 now allow submission to have a editable description field, just click "Edit Report Description".

From checkbox (dev ppa only for the moment), you'll be able to supply additional info with this command:

$ checkbox-cli submit XXXXXXXXXXX submission.tar.xz -m "tested with stress-ng 0.07.21"

Changed in checkbox-ng:
assignee: nobody → Sylvain Pineau (sylvain-pineau)
milestone: future → 1.1.0
Changed in checkbox-ng:
status: Triaged → Fix Committed
Changed in checkbox-ng:
status: Fix Committed → Fix Released
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.