rob, johnnieM
We were hampered early tonight by the fact that someone sneakily turned off the HP RF Ampflier on the AS table.
After that, we were hampered further by mode cleaner strangeness. It would occasionally spontaneously unlock & blow its watchdogs. It never made it through the ontoMCL script (putting DC-CARM onto the MCL). After some investigation, we found that c1susvme1 and c1susvme2 were running stochastically late (SYNC_FE != 0), even though their computation times never got above 61. Also, the end SUS controllers were never late.
Weird.
After rebooting the vertex SUS controllers and the c1lsc, things appear to be working again. |