40m QIL Cryo_Lab CTN SUS_Lab CAML OMC_Lab CRIME_Lab FEA ENG_Labs OptContFac Mariner WBEEShop
  40m Log, Page 52 of 357  Not logged in ELOG logo
ID Date Author Type Categoryup Subject Text Attachments
  9531   Tue Jan 7 23:08:01 2014 jamieUpdateCDS/frames is full, causing daqd to die


   
        
            
  
  9533   Tue Jan 7 23:13:47 2014 jamieUpdateCDS/frames is full, causing daqd to die


   
        
            
  
  9535   Tue Jan 7 23:50:27 2014 jamieUpdateCDS/frames space cleared up, daqd stabilizedThe wiper script is done and deleted a
whole bunch of stuff to clean up some space:

controls@fb ~ 0$ /opt/rtcds/caltech/c1/target/fb/wiper.pl
  
  9536   Tue Jan 7 23:53:35 2014 JamieUpdateCDSdaqd can't connect to c1vac1, c1vac2dadq is logging the following error messages
to it's log related to the fact that it can't
connect to c1vac1 and c1vac2:
  
  9567   Wed Jan 22 18:17:46 2014 JenneUpdateCDSfb timing was offSince this morning, the fb's timing has
been off.  Steve pointed it out to me
earlier today, but I didn't have a chance
  
  9587   Thu Jan 30 11:59:03 2014 manasaUpdateCDSfb timing was off

    

       
            
  
  9618   Mon Feb 10 18:03:41 2014 jamieUpdateCDS12 core c1sus replacementI have configured one of the spare Supermicro
X8DTU-F chassis as a dual-CPU, 12-core CDS
front end machine.  This is meant to
  
  9662   Mon Feb 24 13:40:13 2014 JenneUpdateCDSComputer weirdness with c1lsc machineI noticed that the fb lights on all of
the models on the c1lsc machine are red,
and that even though the MC was locked, there
 Screenshot-Untitled_Window-1.png 
  9663   Mon Feb 24 15:25:29 2014 JenneUpdateCDSComputer weirdness with c1lsc machineThe LSC machine isn't any better, and now
c1sus is showing the same symptoms. 
Lame.
  
  9664   Mon Feb 24 16:26:14 2014 JenneUpdateCDSNTP fell out of sync on front end machines - fixed[Koji, Jenne]
Koji noticed that the time on the
front-end detail screens was not correct,
  
  9679   Wed Feb 26 23:14:07 2014 JenneUpdateCDSfb timing was off....fb timing issue happened again.
I thought that it was the thing that
Koji and I saw the other day, where it was
  
  9683   Mon Mar 3 10:42:53 2014 JenneUpdateCDSfb timing was off...yet again.
lsc and sus needed mxstream restarts
after I restarted the ntp on fb.
  
  9684   Mon Mar 3 11:55:39 2014 KojiUpdateCDSfb timing was offWe need to correctly setup crontab or rc.local
for the frontend machines.
  
  9706   Mon Mar 10 11:42:36 2014 JenneUpdateCDSfb timing was offfb timing was off again.   
  9732   Mon Mar 17 12:31:58 2014 manasaUpdateCDSfb timing was offOff again. Restarted ntp on fb.   
  9786   Mon Apr 7 15:26:32 2014 jamie, ericqUpdateCDSaborted attempt to update c1sus machine with second CPUThis morning we attempted to replace the
c1sus front end machine with a spare that
had been given a second CPU, and therefore
 Screenshot-Untitled_Window.png 
  9822   Thu Apr 17 11:00:54 2014 jamieUpdateCDSfailed attempt to get Dolphin working on c1iooI've been trying to get c1ioo on the Dolphin
network, but have not yet been successful.
Background: if we can put the c1ioo
  
  9824   Thu Apr 17 16:59:45 2014 jamieUpdateCDSslightly more successful attempt to get Dolphin working on c1iooSo it turns out that the card that Rolf
had given me was not a Dolphin host adapter
after all.  He did have an actual host
  
  9825   Thu Apr 17 17:15:54 2014 jamieUpdateCDSmx_stream not starting on c1iooWhile
trying to get dolphin working on c1ioo,
the c1ioo
 c1ioo_no_mx_stream.png 
  9826   Thu Apr 17 17:22:32 2014 JenneUpdateCDSmx_stream not starting on c1ioo, locking okayJamie tells me that the 2 big consequences
of this are (a) we are not archiving any
data that is collected on the ioo machine,
  
  9830   Fri Apr 18 14:00:48 2014 rolfUpdateCDSmx_stream not starting on c1ioo 
 To fix open-mx connection to
c1ioo, had to restart the mx mapper on fb
  
  9831   Fri Apr 18 19:05:17 2014 jamieUpdateCDSmx_stream not starting on c1ioo


   
        
            
  
  9839   Tue Apr 22 01:39:57 2014 JenneUpdateCDSFB unhappy again[Jenne, Q]
The frame builder (or something)
is unhappy again.  I know that we've
  
  9879   Wed Apr 30 14:21:50 2014 manasaUpdateCDSfb restartedc1sus and c1isey were not talking to fb.
The usual mxstream restart did not help.
Restarted fb
  
  9881   Wed Apr 30 17:07:19 2014 jamieUpdateCDSc1ioo now on Dolphin networkThe
c1ioo host is now fully on the dolphin network!
After the mx
 dolphin.pngALSXonDolphin.pdf 
  9882   Wed Apr 30 17:45:34 2014 jamieUpdateCDSc1ioo now on Dolphin networkFor reference, here are the new IPC entries
that were made for the ALS X/Y phase between
c1als and c1lsc:
  
  9883   Wed Apr 30 18:06:06 2014 jamieUpdateCDSPOP QPD signals now on dolphinThe POP QPD X/Y/SUM signals, which are
acquired in c1ioo, are now being broadcast
over dolphin.  c1ass was modified to
 c1ass-POPQPD.pngc1ioo-POPQPD.png 
  9890   Thu May 1 10:23:42 2014 jamieUpdateCDSc1ioo dolphin fiber nicely routedSteve and I nicely routed the dolphin fiber
from c1ioo in the 1X2 rack to the dolphin
switch in the 1X4 rack.  I shutdown
 green.png 
  9896   Fri May 2 01:01:28 2014 ranaUpdateCDSc1ioo dolphin fiber nicely routedThis C1IOO business seems to be wiping
out the MC2_TRANS QPD servo settings each
day. 
  
  9903   Fri May 2 11:14:47 2014 jamieUpdateCDSc1ioo dolphin fiber nicely routed

    

       
            
  
  9910   Mon May 5 19:34:54 2014 jamieUpdateCDSc1ioo/c1ioo control output IPCs changed to PCIE DolphinNow the c1ioo in on the Dolphin network,
I changed the c1ioo MC{1,2,3}_{PIT,YAW} and
MC{L,F} outputs to go out over the Dolphin
 ioo-ipc.png 
  9911   Mon May 5 19:51:56 2014 jamieUpdateCDSc1oaf model broken because of broken BLRMS blockI finally tracked down the problem with
the c1oaf model to the BLRMS part:
/opt/rtcds/userapps/release/cds/common/models/BLRMS.mdl
 blrms-hot-mess.pngsddefault.jpg 
  9915   Tue May 6 10:22:28 2014 steveUpdateCDSc1ioo dolphin fiber

    

       
            
 dolphin1x2.png 
  9916   Tue May 6 10:31:58 2014 jamieUpdateCDSc1ioo dolphin fiber

    

       
            
  
  9922   Wed May 7 16:31:12 2014 jamieUpdateCDScdsutils updated to version 226
controls@pianosa:~ 0$ cd /opt/rtcds/cdsutils/trunk/
controls@pianosa:/opt/rtcds/cdsutils/trunk
0$ svn update
...
At revision 226.
controls@pianosa:/opt/rtcds/cdsutils/trunk
0$ make
echo "__version__ = '226'" >lib/cdsutils/_version.py
echo
  
  9923   Wed May 7 17:10:59 2014 ranaUpdateCDScdsutils updated to version 226 This upgrade from Jamie has given
us the new apps (avg, servo, and trigservo).
We should figure out if there's a way to
  
  9924   Wed May 7 22:47:33 2014 ranaUpdateCDScdsutils updated to version 226: not working on pianosa or rossa controls@rossa:~ 0$ cdsutils
read C1:LSC-DARM_GAIN
Traceback (most recent call last):
  
  9926   Wed May 7 23:30:21 2014 jamieUpdateCDScdsutils should be working nowShould be fixed now.  There were python2.6
compatibility issues, which only show up
on these old distros (e.g. ubuntu 10.04).
  
  9928   Thu May 8 01:33:21 2014 ericqUpdateCDSpython issuesOn pianosa: The ezca.Ezca class somehow
initializes with its prefix set to "C1:",
even though the docstring says the default
  
  9931   Thu May 8 15:55:43 2014 jamieUpdateCDSpython issues

    

       
            
  
  9949   Tue May 13 17:45:21 2014 ranaUpdateCDS/frames space cleared up, daqd stabilized 
 Late last night we were getting
some problems with DAQD again. Turned out
  
  9954   Wed May 14 17:36:32 2014 ericqUpdateCDSNew netgpib scripts for SR785 I have redone the SPSR785 (spectrum measurement)   
  9955   Thu May 15 01:42:07 2014 ranaUpdateCDS/frames space cleared up, daqd stabilized Script seems to be working now:
nodus:~>df -h | grep
frames
  
  9982   Wed May 21 13:18:47 2014 ericqUpdateCDSSuspension MEDM BugI fixed a bug in the SUS_SINGLE screen,
where the total YAW output was incorrectly
displayed (TO_COIL_3_1 instead of TO_COIL_1_3).
  
  10010   Mon Jun 9 11:42:00 2014 JenneUpdateCDSComputer statusCurrent computer status:
All fast machines except c1iscey
are up and running. I can't ssh to c1iscey,
  
  10011   Mon Jun 9 12:19:17 2014 ericqUpdateCDSComputer status

    

       
            
  
  10015   Mon Jun 9 22:26:44 2014 rana, zachUpdateCDSSLOW controls recovery All of the SLOW computers were
in limbo since the fileserver/nameserver
change, but me and Zach brought them back.
  
  10016   Mon Jun 9 22:40:36 2014 JenneUpdateCDSFast front end computers upRana
and I now seem to have the fast front end
computers (c1lsc, c1sus, c1ioo, c1iscex and
  
  10018   Tue Jun 10 09:25:29 2014 JamieUpdateCDSComputer status: should not be changing namesI really think it's a bad   
  10025   Wed Jun 11 14:36:57 2014 JenneUpdateCDSSLOW controls recovery 
 I have brought back c1auxex
and c1auxey.  Hopefully this elog
  
ELOG V3.1.3-