40m QIL Cryo_Lab CTN SUS_Lab TCS_Lab OMC_Lab CRIME_Lab FEA ENG_Labs OptContFac Mariner WBEEShop
  40m Log  Not logged in ELOG logo
Entry  Thu Mar 8 01:10:22 2018, gautam, Update, General, CDS recovery after work at LSC rack CDS-recovery.png
    Reply  Thu Mar 8 14:41:25 2018, gautam, Update, General, CDS recovery after work at LSC rack CDS-recovery.pngc1sus_timing.pngc1sus_crashed.png
       Reply  Thu Mar 8 18:15:42 2018, gautam, Update, General, CDS recovery after work at LSC rack 
Message ID: 13672     Entry time: Thu Mar 8 18:15:42 2018     In reply to: 13670
Author: gautam 
Type: Update 
Category: General 
Subject: CDS recovery after work at LSC rack 

I was forced into a simultaneous power-cycle rebooting of the three vertex FEs just now. I took the opportunity to completely disconnect the c1sus expansion chassis from all power and then restart it.

Everything is back up right now, and the weird timing issues I noticed in the sus model seem to be gone now (I'll need a longer baseline to be sure and I'll post a trend of the CPU timing tomorrow). It's disconcerting that apparently the only way to get everything back up and running is the nuclear option of power-cycling all FE related electronics. I was considering borrowing an ADC adapter card from the Y end and measuring the calibrated IR ALS noise with the digital system, but if I'm going to have to go through this whole dance each time I do a model recompile on c1lsc (which I'm going to have to in order to get the extra ADC recognized), I'm wondering if it's just better to wait till we get the new adapter cards we ordered. I think I'm going to work on tuning the input coupling into the fiber at EX in the next couple of days instead.

Quote:
 

Seems like some high level voodoo indecision.


Edit 330pm: The model just crashed again. dmesg rather unhelpfully just says "ADC timeout". Unclear how to debug further. See Attachment #3.

 

ELOG V3.1.3-