LAVA Validation Lab

setup known good image tests to determine lab health

Bug #893065 reported by Alexander Sack
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
LAVA Validation Lab
Fix Released
High
Dave Pigott
LAVA Validation Lab 2012.05

Bug Description

Right now have a hard time to figure if lava is in good shape. One way to get such indication is to have a known good image to be continuously tested (e.g. like last release) and use that deduce whether lava is actually reliable if the image is find.

Alexander Sack (asac)
affects: lava-server → lava-lab
Paul Larson (pwlars)
Changed in lava-lab:
assignee: nobody → Dave Pigott (dpigott)
milestone: none → 2011.12
importance: Undecided → High
status: New → Triaged
Revision history for this message
Paul Larson (pwlars) wrote :

This would be a good way of getting a feeling for whether we are having any lab, or even board-specific issues. For now, this should just be limited to deploy+boot, and should be stored in it's own stream (lab-health or something).

Revision history for this message
Paul Larson (pwlars) wrote :

I have some first steps of this done. I have a known-working android and lt-panda/nano on panda, and I just submitted both jobs for every single board in the lab. Next steps will be:
1. review the results, see if there are any issues that need to be fixed, or boards that seem to have problems
2. set this up in a cron job to run daily, preferably before the daily runs (I'll do this tonight)
3. establish a baseline test like this for all the other boards
4. think about how to visualize this - for now, looking at the raw run results is probably ok, but tedious. Would be nice to generate graphs of health history by board.
...this is starting to look bigger than something we should track in a bug and should turn into a blueprint.

Fathi Boudra (fboudra)
Changed in lava-lab:
milestone: 2011.12 → 2012.01
Fathi Boudra (fboudra)
Changed in lava-lab:
milestone: 2012.01 → 2012.03
Fathi Boudra (fboudra)
Changed in lava-lab:
milestone: 2012.03 → 2012.04
Fathi Boudra (fboudra)
Changed in lava-lab:
milestone: 2012.04 → 2012.05
Revision history for this message
Dave Pigott (dpigott) wrote :

This is pretty much done, isn't it? All master images are baselined, and daily health checks are running.

Changed in lava-lab:
status: Triaged → Fix Committed
Fathi Boudra (fboudra)
Changed in lava-lab:
status: Fix Committed → Fix Released
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.
Subscribing...

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.