40m QIL Cryo_Lab CTN SUS_Lab CAML OMC_Lab CRIME_Lab FEA ENG_Labs OptContFac Mariner WBEEShop
  40m elog, Page 108 of 357  Not logged in ELOG logo
ID Date Authordown Type Category Subject Text Attachments
  9824   Thu Apr 17 16:59:45 2014 jamieUpdateCDSslightly more successful attempt to get Dolphin working on c1iooSo it turns out that the card that Rolf
had given me was not a Dolphin host adapter
after all.  He did have an actual host
  
  9825   Thu Apr 17 17:15:54 2014 jamieUpdateCDSmx_stream not starting on c1iooWhile
trying to get dolphin working on c1ioo,
the c1ioo
 c1ioo_no_mx_stream.png 
  9831   Fri Apr 18 19:05:17 2014 jamieUpdateCDSmx_stream not starting on c1ioo


   
        
            
  
  9881   Wed Apr 30 17:07:19 2014 jamieUpdateCDSc1ioo now on Dolphin networkThe
c1ioo host is now fully on the dolphin network!
After the mx
 dolphin.pngALSXonDolphin.pdf 
  9882   Wed Apr 30 17:45:34 2014 jamieUpdateCDSc1ioo now on Dolphin networkFor reference, here are the new IPC entries
that were made for the ALS X/Y phase between
c1als and c1lsc:
  
  9883   Wed Apr 30 18:06:06 2014 jamieUpdateCDSPOP QPD signals now on dolphinThe POP QPD X/Y/SUM signals, which are
acquired in c1ioo, are now being broadcast
over dolphin.  c1ass was modified to
 c1ass-POPQPD.pngc1ioo-POPQPD.png 
  9890   Thu May 1 10:23:42 2014 jamieUpdateCDSc1ioo dolphin fiber nicely routedSteve and I nicely routed the dolphin fiber
from c1ioo in the 1X2 rack to the dolphin
switch in the 1X4 rack.  I shutdown
 green.png 
  9903   Fri May 2 11:14:47 2014 jamieUpdateCDSc1ioo dolphin fiber nicely routed

    

       
            
  
  9910   Mon May 5 19:34:54 2014 jamieUpdateCDSc1ioo/c1ioo control output IPCs changed to PCIE DolphinNow the c1ioo in on the Dolphin network,
I changed the c1ioo MC{1,2,3}_{PIT,YAW} and
MC{L,F} outputs to go out over the Dolphin
 ioo-ipc.png 
  9911   Mon May 5 19:51:56 2014 jamieUpdateCDSc1oaf model broken because of broken BLRMS blockI finally tracked down the problem with
the c1oaf model to the BLRMS part:
/opt/rtcds/userapps/release/cds/common/models/BLRMS.mdl
 blrms-hot-mess.pngsddefault.jpg 
  9916   Tue May 6 10:31:58 2014 jamieUpdateCDSc1ioo dolphin fiber

    

       
            
  
  9922   Wed May 7 16:31:12 2014 jamieUpdateCDScdsutils updated to version 226
controls@pianosa:~ 0$ cd /opt/rtcds/cdsutils/trunk/
controls@pianosa:/opt/rtcds/cdsutils/trunk
0$ svn update
...
At revision 226.
controls@pianosa:/opt/rtcds/cdsutils/trunk
0$ make
echo "__version__ = '226'" >lib/cdsutils/_version.py
echo
  
  9926   Wed May 7 23:30:21 2014 jamieUpdateCDScdsutils should be working nowShould be fixed now.  There were python2.6
compatibility issues, which only show up
on these old distros (e.g. ubuntu 10.04).
  
  9931   Thu May 8 15:55:43 2014 jamieUpdateCDSpython issues

    

       
            
  
  10155   Tue Jul 8 17:59:12 2014 jamieOmnistructureElectronicsJamie 1811 power supply fixed!I finally made good on the LIFE TIME WARRANTY
on the ancient, Jamie-made 1811 power supply
with the faulty switch:
 20140708_165010.jpg 
  10156   Tue Jul 8 18:20:15 2014 jamieOmnistructureElectronicsJamie 1811 power supply fixed! Placed in PD cabinet in Y arm, next
to the OTHER Jamie-made 1811 power supply
from 1998.
  
  10177   Thu Jul 10 17:33:26 2014 jamieOmnistructureComputer Scripts / Programsubuntu12 software installed, gds 2.16.3.2Rana wanted the latest GDS installed (for
newest DTT), so I made an ubuntu 12 install
directory into which I installed
  
  10426   Fri Aug 22 18:00:08 2014 jamieOmnistructureCDSubuntu12 awgstream installedI installed awgstream-2.16.14 in /ligo/apps/ubuntu12. 
As with all the ubuntu12 "packages",
you need to source the ubuntu12 ligoapps
  
  10478   Tue Sep 9 14:25:46 2014 jamieUpdateLSCFiguring out where to do DARM->AS55

    

       
            
  
  10623   Fri Oct 17 15:17:31 2014 jamieUpdateCDSDaqd "fixed"?I very tentatively declare that this particular
daqd crapfest is "resolved" after
Jenne rebooted fb and daqd has been running
  
  10624   Fri Oct 17 16:54:11 2014 jamieUpdateCDSDaqd "fixed"?

    

       
            
  
  10628   Tue Oct 21 17:44:28 2014 jamieOmnistructureComputer Scripts / Programsnew version of cdsutils (351) installedI just installed cdsutils r351 at /ligo/apps/linux-x86_64/cdsutils. 
It should be available on all workstations.
It includes a bunch of bug fixes
  
  10854   Mon Jan 5 20:17:26 2015 jamieConfigurationCDSGDS upgraded to 2.16.14I upgraded the GDS and ROOT installations
in /ligo/apps/ubuntu12
the control room workstations:
 2015-01-05-200025_1694x996_scrot.png 
  10878   Thu Jan 8 09:24:40 2015 jamieUpdateComputer Scripts / ProgramsELOG 3.0


Quote:


  
  10906   Thu Jan 15 18:10:19 2015 jamieUpdateComputer Scripts / ProgramsInstalled kerberos on Rossa


  
  11077   Thu Feb 26 13:55:59 2015 jamieUpdateComputer Scripts / ProgramsFB IO loadWe should use "ionice" to throttle the rsync.
 Use something like "ionice -c 3 rsync ..."
to set the priority such that the rsync process
  
  11409   Tue Jul 14 11:57:27 2015 jamieSummaryCDSCDS upgrade: left running in semi-stable configuration


  
  11410   Tue Jul 14 13:55:28 2015 jamieUpdateCDSrunning test on daqd, please leave undisturbedI'm running a test with daqd right
now, so please do not disturb for the moment.

I'm
temporarily writing frames into a tempfs,
  
  11413   Tue Jul 14 17:06:00 2015 jamieUpdateCDSrunning test on daqd, please leave undisturbedI have reverted daqd to the previous configuration,
so that it's writing frames to disk. 
It's still showing instability.
  
  11420   Thu Jul 16 11:18:37 2015 jamieUpdateGeneralStarting IFO recovery, DAC troubles


  
  11426   Sat Jul 18 14:55:33 2015 jamieUpdateGeneralall front ends back up and runningAfter some surgery yesterday the front
ends are all back up and running:


Eric found that one of
 cds-good.png 
  11428   Sat Jul 18 16:03:00 2015 jamieUpdateCDSEPICS freezes persistI notice that the periodic EPICS freezes
persist.  They last for 5-10 seconds. 
MEDM completely freezes up, but then it comes
  
  11429   Sat Jul 18 16:59:01 2015 jamieUpdateCDSunloaded, turned off loading of, symmetricom kernel module on fbfb has been loading a 'symmetricom'
kernel module, presumably because it was
once being used to help with timing. 
  
  11627   Mon Sep 21 15:22:19 2015 jamieUpdateDAQworking on new fb replacementI've been putting together a new machine
that Rolf got for us as a replacement for
fb.
  
  11636   Tue Sep 22 17:30:55 2015 jamieUpdateDAQattempts at getting new fb workingToday I've been trying to get the new
frame builder, tentatively 'fb1',
to work.  It's not fully
  
  11645   Fri Sep 25 17:51:11 2015 jamieUpdateDAQfb replacement work updateBrief update about the fb replacement status.

The new hardware for fb is in the
rack, temporarily sitting on top of megatron,
  
  11653   Wed Sep 30 13:59:49 2015 jamieUpdateDAQattempts at getting new fb workingI got Steve to get us a new Myrinet fiber
network adapter card for fb1:


Myrinet 10G-PCIE-8B-S


I
  
  11655   Thu Oct 1 19:49:52 2015 jamieUpdateDAQmore failed attempts at getting new fb workingSummary

I've not really
been able to make additional progress with
the new 'fb1' DAQ.  It's
  
  11656   Thu Oct 1 20:24:02 2015 jamieUpdateDAQmore failed attempts at getting new fb workingI just realized that when running fb1,
if a single mx_stream dies they all die.
  
  11657   Thu Oct 1 20:26:21 2015 jamieUpdateDAQSwapping between fb and fb1Swapping between fb and fb1 as DAQ is very
straightforward, now that they are both on
the DAQ network:
  
  11661   Sun Oct 4 12:07:11 2015 jamieConfigurationCDSCSD network tests in progressI'm about to start conducting some
tests on the CDS network.  Things will
probably be offline for a bit.  Will
  
  11662   Sun Oct 4 13:53:30 2015 jamieUpdateLSCSENSMAT oscillator used for EPICS testsI've taken over one of the SENSMAT
oscillators for a test of the EPICS system.

These are the channels I've
  
  11663   Sun Oct 4 14:23:42 2015 jamieConfigurationCDSCSD network test completeI've finished, for now, the CDS network
tests that I was conducting.  Everything
should be back to normal.
  
  11664   Sun Oct 4 14:28:03 2015 jamieUpdateDAQmore failed attempts at getting new fb workingI tried to look at fb1 again today, but
still haven't made any progress.

The one thing I did notice, though,
  
  11665   Sun Oct 4 14:32:49 2015 jamieConfigurationCDSCSD network test completeHere's an example of the glitches we've
been seeing, as seen in the StripTool trace
of the front end oscillator:
 45.png 
  11859   Mon Dec 7 11:25:10 2015 jamieUpdateCDSdaqd is mad


  
  11868   Wed Dec 9 19:01:45 2015 jamieUpdateCDSback to fb1I spent this afternoon trying to debug
fb1, with very little to show for it. 
We're back to running from fb.
  
  12152   Tue Jun 7 11:12:47 2016 jamieUpdateCDSDAQD UPGRADE WORK UNDERWAYI
am re-starting work on the daqd upgrade again
now.  Expect the daqd
  
  12155   Tue Jun 7 20:49:50 2016 jamieUpdateCDSDAQD work ongoingSummary: new daqd code
running overnight test on fb1.  Stability
issues persist.
  
  12156   Wed Jun 8 08:34:55 2016 jamieUpdateCDSDAQD work ongoing38 restarts overnight.  Problem definitely
not fixed.  I'll be reverting back
to old daqd and fb this morning.  Then
  
ELOG V3.1.3-