I noticed tonight that there were 52 jobs stacked up - since this morning! Two things need to be done here.
Michael Hudson-Doyle and I were talking the other day, and he recommended that we timeout the lmc process, not just the whole flock. This way, if a lmc process takes longer than say, an hour or two, it will get killed.
Second, it looks like the reason for the jobs stacking up is that it was stuck in lmc for a very long time. I killed it, and it went through and processed several jobs pretty quickly. After a while though, it got stuck again, both times on an omap3 x11 base hwpack. I suspect there are now binary drivers with license click-throughs on that hwpack, so we also need to check that out.
Thirdly, I noticed that beaglexm03 was not responding in conmux. This has been reported in a separate bug, but for now, I marked it offline anyway. I don't want any more of those hwpacks getting processed until we address this.
Assigning to me for now, but I'm not sure if I'll have a chance to fix this before monday, so feel free to steal it from me.