Quote: |
I managed to recover c1sus. It required stopping all the models, and the restarting them one-by-one:
$ rtcds stop all # <-- this does the right to stop all the models with the IOP stopped last, so they will all unload properly.
$ rtcds start iop
$ rtcds start c1sus c1mcs c1rfm
I have no idea why the c1sus models got wedged, or why restarting them in this way fixed the issue.
|
In addition to needing obnoxiously regular mxstream restarts, this afternoon the sus machine was doing something slightly differently. Only 1 fb block per core was red (the mxstream symptom is 3 fb-related blocks are red per core), and restarting the mxstream didn't help. Anyhow, I was searching through the elog, and this entry to which I'm replying had similar symptoms. However, by the time I went back to the CDS FE screen, c1sus had regular mxstream symptoms, and an mxstream restart fixed things right up.
So, I don't know what the issue is or was, nor do I know why it is fixed, but it's fine for now, but I wanted to make a note for the future. |