The test result is empty while submit results to CCC

I have a strong suspicion that this is caused by the XML exporter and how it behaves when working with non-certification providers. This needs more investigation

Hello Betty,

Could you please attach the submission.xml file that was produced? it should be in .cache/plainbox/ somewhere. Maybe Zygmunt can tell us if it's likely to be somewhere else.

Hmm. I don't think it's anywhere in ~/.cache/plainbox. If anything it can be in /tmp/

The code I wrote today will allow us to work with bugs like this easily, using the 'plainbox session archive' command. The resulting tarball can be attached to a bug report and inspected.

@Daniel

Sorry, I have recovered the machine and only tar .cache/plainbox.
I will tried to run the test again and attached submission.xml file later

CCC link
https://certification.canonical.com/hardware/201305-13492/

xml as attached

15:35 < brendand> zyga, are you actively looking at https://bugs.launchpad.net/plainbox/+bug/1314043
15:36 < zyga> brendand: kind of, we talked during that bug today
15:36 < zyga> brendand: we gave Albert the workaround and asked him to check if that works
15:36 < zyga> brendand: if it works that's it
15:36 < zyga> brendand: it's a dupe of the resources-dont-run bug
15:36 < zyga> brendand: if not we'll need to debug it further

Betty, can you please confirm that adding '2013.com.canonical.certification::miscellanea/submission-resources' to your whitelists fixes this issue?

@Zygmunt

I tried to add '2013.com.canonical.certification::miscellanea/submission-resources' in my whitelist.
The result did not send to CCC this time.

CCC Link: https://certification.canonical.com/hardware/201401-14521/

Here is the error from terminal:
file:///usr/share/checkbox-gui/qml/SubmissionDialog.qml:95: ReferenceError: success is not defined
ATTENTION: default value of option force_s3tc_enable overridden by environment.
file:///usr/share/checkbox-gui/qml/SubmissionDialog.qml:95: ReferenceError: success is not defined
file:///usr/share/checkbox-gui/qml/SubmissionDialog.qml:95: ReferenceError: success is not defined
file:///usr/share/checkbox-gui/qml/SubmissionDialog.qml:95: ReferenceError: success is not defined

Version:
ii plainbox 0.6~dev+bzr2996+pkg3~ubuntu14.04.1 all toolkit for software and hardware integration testing
ii plainbox-insecure-policy 0.6~dev+bzr2996+pkg3~ubuntu14.04.1 all policykit policy required to use plainbox (insecure version)
ii plainbox-provider-checkbox 0.5~dev+bzr2992+pkg4~ubuntu14.04.1 amd64 CheckBox provider for PlainBox
ii plainbox-provider-oem 0.1ubuntu7 all plainbox oem provider
ii plainbox-provider-oem-stella 0.1ubuntu7 all plainbox oem provider for stella
ii plainbox-provider-resource-generic 0.3-1 amd64 CheckBox generic resource jobs provider
ii python3-plainbox 0.6~dev+bzr2996+pkg3~ubuntu14.04.1 all toolkit for software and hardware testing (python3 module)
ii checkbox-gui 0.17.9~dev+bzr2992+pkg2~ubuntu14.04.1 amd64 QML based interface for system testing based on PlainBox.
ii checkbox-ng 0.4~dev+bzr2996+pkg7~ubuntu14.04.1 all PlainBox based test runner
ii checkbox-ng-service 0.4~dev+bzr2996+pkg7~ubuntu14.04.1 all CheckBox D-Bus service
ii plainbox-provider-checkbox 0.5~dev+bzr2992+pkg4~ubuntu14.04.1 amd64 CheckBox provider for PlainBox
ii python3-checkbox-ng 0.4~dev+bzr2996+pkg7~ubuntu14.04.1 all PlainBox based test runner (Python 3 library)
ii python3-checkbox-support 0.2-1 all collection of Python modules used by PlainBox providers

I've tried submitting with xml in comment #8 manually using checkbox-certification-submit,
it is still empty on certification website.

https://certification.canonical.com/submissions/status/9256

With the tools we now have understanding bugs like this should be easier. I'll get it debugged and perhaps fixed early next week.

Related to bug 1320253

We have a fix/workaround in place for the empty submission bug in Plainbox.

To apply the fix, please, update to the latest version of plainbox/checkbox (including the certification providers) and you will see that there is a new job in the certification provider called

miscellanea/submission-resources

Add this job to your whitelists and make sure it is always selected to be run in the selection screen.

Marking this bug as Fix Committed. The workaround is in place, and the root cause is this other bug (still open):

https://bugs.launchpad.net/checkbox-gui/+bug/1302388

I try bzr3032 with miscellanea/submission-resources today.
The report can submit to CCC now.

ii plainbox 0.6~dev+bzr3032+pkg4~ubuntu14.04.1 all toolkit for software and hardware integration testing
ii plainbox-insecure-policy 0.6~dev+bzr3032+pkg4~ubuntu14.04.1 all policykit policy required to use plainbox (insecure version)
ii plainbox-provider-checkbox 0.5~dev+bzr3032+pkg5~ubuntu14.04.1 amd64 CheckBox provider for PlainBox
ii plainbox-provider-oem 0.1ubuntu7 all plainbox oem provider
ii plainbox-provider-oem-stella 0.1ubuntu7 all plainbox oem provider for stella
ii plainbox-provider-resource-generic 0.3-1 amd64 CheckBox generic resource jobs provider
ii python3-plainbox 0.6~dev+bzr3032+pkg4~ubuntu14.04.1 all toolkit for software and hardware testing (python3 module)
ii checkbox-gui 0.17.9~dev+bzr3032+pkg2~ubuntu14.04.1 amd64 QML based interface for system testing based on PlainBox.
ii checkbox-ng 0.4~dev+bzr3032+pkg7~ubuntu14.04.1 all PlainBox based test runner
ii checkbox-ng-service 0.4~dev+bzr3032+pkg7~ubuntu14.04.1 all CheckBox D-Bus service
ii plainbox-provider-checkbox 0.5~dev+bzr3032+pkg5~ubuntu14.04.1 amd64 CheckBox provider for PlainBox
ii python3-checkbox-ng 0.4~dev+bzr3032+pkg7~ubuntu14.04.1 all PlainBox based test runner (Python 3 library)
ii python3-checkbox-support 0.3~dev+bzr3032+pkg3~ubuntu14.04.1 all collection of Python modules used by PlainBox providers

The other bug (https://bugs.launchpad.net/checkbox-gui/+bug/1302388) is now marked as fixed, so I'll mark this one as such too.