40m QIL Cryo_Lab CTN SUS_Lab TCS_Lab OMC_Lab CRIME_Lab FEA ENG_Labs OptContFac Mariner WBEEShop
  40m Log, Page 50 of 344  Not logged in ELOG logo
ID Date Author Type Categoryup Subject Text Attachments
  11314   Tue May 19 18:38:33 2015 ranaUpdateCDSMXstream restart script working (beta)Good catch; that was some seriously bad
programming on my part. I had some undeclared
variable garbage going on. I fixed it and
  
  11340   Mon Jun 1 10:26:53 2015 ericqUpdateCDSRCG Upgrade ImminentWe
are planning on upgrading the 40 CDS system
to the latest version of the LIGO RCG software,
  
  11342   Mon Jun 1 20:05:36 2015 ranaUpdateCDSRCG Upgrade Imminent

  
  11347   Mon Jun 8 15:51:31 2015 ericqUpdateCDSRCG DiagnosticsI've started making some model changes
for RCG diagnostic tests. 

I put some blocks down in C1TST
 newTST.png 
  11358   Mon Jun 15 11:54:44 2015 ericqUpdateCDSParts not in SVNI ran the following command to find which
models/parts are not under version control,
or have modifications not commited:
  
  11365   Fri Jun 19 03:00:56 2015 ericqUpdateCDSLibrary Model Parts examinedAll simulink diagrams being used at the
40m are now under version control. I have
compiled, installed, and restarted all current
  
  11380   Fri Jun 26 23:18:52 2015 Eve ChaseUpdateCDSSummary Page UpdatesMotivation:

My SURF project largely focuses
on updating and improving the 40m summary
  
  11384   Tue Jun 30 11:33:00 2015 JamieSummaryCDSprepping for CDS upgradeThis is going to be a big one.  We're
at version 2.5 and we're going to go
to 2.9.3.
  
  11390   Wed Jul 1 19:16:21 2015 JamieSummaryCDSCDS upgrade in progressThe CDS upgrade is now underway

Here's
what's happened so far:


Installed and linked in
  
  11393   Tue Jul 7 18:27:54 2015 JamieSummaryCDSCDS upgrade: progress!After a couple of days of struggle, I made
some progress on the CDS upgrade today:

 2.9-RTS-OK.pngC1X04_GDS_TP.png 
  11394   Tue Jul 7 23:26:19 2015 KojiUpdateCDSAttempt to list CDS issuesAs Jamie succeded to realize somewhat workable
condition of the 40m CDS, I tried to list
the obvious CDS issues so that we can attack
 burt.log.zip 
  11396   Wed Jul 8 20:37:02 2015 JamieSummaryCDSCDS upgrade: one step forward, two steps backAfter determining yesterday that all the
daqd issues were coming from the frame writing,
I started to dig into it more today. 
  
  11397   Wed Jul 8 21:02:02 2015 JamieSummaryCDSCDS upgrade: another step forward, so we're back to where we started (plus a bit?)Koji did a bit of googling to determine
that 'Wrong Network' status message
could be explained by the fb myrinet 
  
  11398   Thu Jul 9 13:26:47 2015 JamieSummaryCDSCDS upgrade: new mx 1.2.16 installedI rebuilt/installed mx 1.2.16 to use "ether-mode",
instead of the default MX-10G:


controls@fb
  
  11400   Thu Jul 9 16:50:13 2015 JamieSummaryCDSCDS upgrade: if all else fails try throwing metal at the problemI roped Rolf into coming over and adding
his eyes to the problem.  After much
discussion we couldn't come up with any
  
  11402   Mon Jul 13 01:11:14 2015 JamieSummaryCDSCDS upgrade: current assessmentdaqd is still behaving unstably. 
It's still unclear what the issue is.

The current failures look like
  
  11404   Mon Jul 13 18:12:50 2015 JamieSummaryCDSCDS upgrade: left running in semi-stable configurationI have been watching daqd all day and I
don't feel particularly closer to understanding
what the issues are.  However, things
  
  11406   Tue Jul 14 09:08:37 2015 JamieSummaryCDSCDS upgrade: left running in semi-stable configurationOvernight daqd restarted itself only about
twice an hour, which is an improvement:


controls@fb /opt/rtcds/caltech/c1/target/fb
  
  11408   Tue Jul 14 10:28:02 2015 ericqSummaryCDSCDS upgrade: left running in semi-stable configurationThere remains a pattern to some of the
restarts, the following times are all
reported as restart times. (There are others
  
  11409   Tue Jul 14 11:57:27 2015 jamieSummaryCDSCDS upgrade: left running in semi-stable configuration


  
  11410   Tue Jul 14 13:55:28 2015 jamieUpdateCDSrunning test on daqd, please leave undisturbedI'm running a test with daqd right
now, so please do not disturb for the moment.

I'm
temporarily writing frames into a tempfs,
  
  11412   Tue Jul 14 16:51:01 2015 JamieSummaryCDSCDS upgrade: problem is not disk accessI think I have now determined once and
for all that the daqd problems are NOT due
to disk IO contention.
  
  11413   Tue Jul 14 17:06:00 2015 jamieUpdateCDSrunning test on daqd, please leave undisturbedI have reverted daqd to the previous configuration,
so that it's writing frames to disk. 
It's still showing instability.
  
  11415   Wed Jul 15 13:19:14 2015 JamieSummaryCDSCDS upgrade: reducing mx end-points as last ditch effortI tried one last thing, suggested by Keith
and Gerrit.  I tried reducing the number
of mx end-points on fb to zero, which should
  
  11417   Wed Jul 15 18:19:12 2015 JamieSummaryCDSCDS upgrade: tentative stabilty?Keith Thorne provided his eyes on the situation
today and had some suggestions that might
have helped things
  
  11427   Sat Jul 18 15:37:19 2015 JamieSummaryCDSCDS upgrade: current statusSo it appears we have found a semi-stable
configuration for the DAQ system post upgrade:

 cds-good.pngsus-damped.png 
  11428   Sat Jul 18 16:03:00 2015 jamieUpdateCDSEPICS freezes persistI notice that the periodic EPICS freezes
persist.  They last for 5-10 seconds. 
MEDM completely freezes up, but then it comes
  
  11429   Sat Jul 18 16:59:01 2015 jamieUpdateCDSunloaded, turned off loading of, symmetricom kernel module on fbfb has been loading a 'symmetricom'
kernel module, presumably because it was
once being used to help with timing. 
  
  11435   Wed Jul 22 14:10:04 2015 ericqUpdateCDSRCG DiagnosticsNow that we've seemed to landed on
a working configuration, I've re-ran
the tests first described in ELOG
 filterShapes.pngCDS_diag_codes.zip 
  11461   Wed Jul 29 21:40:39 2015 KojiSummaryCDSStatus of the frame data syncingThe trend data hasn't been
synced with LDAS since Jul 27 5AM local.

40m:
  
  11465   Thu Jul 30 11:47:54 2015 KojiSummaryCDSStatus of the frame data syncingToday it was synced at 5AM but
that was all.

40m:
  
  11479   Wed Aug 5 10:56:07 2015 ericqUpdateCDSMany models crashed Last night around 1AM, many of the the
frontend models crashed due to an ADC timeout.
(But none of the IOPs, and all the c1lsc
 crashes.png 
  11551   Tue Sep 1 02:44:44 2015 KojiSummaryCDSc1oaf, c1mcs modified for the IMC angular FF[Koji, Ignacio]

In order to allow us to work on
the IMC angular FF, we made the signal paths
 c1oaf_screenshot1.pngc1oaf_screenshot2.pngc1mcs_screenshot.pngOAF_MEDM1.pngOAF_MEDM2.png 
  11564   Thu Sep 3 02:12:08 2015 ranaUpdateCDSSimulink Webview updatedBack in 2011, JoeB wrote
some entries on how to automatically
update the Simulink webview stuff.
  
  11565   Thu Sep 3 02:30:46 2015 ranaUpdateCDSc1cal time reduced by deleting LSC sensing matrixI experimented with removing somethings
here and there to reduce the c1cal runtime.
Eventually I deleted the LSC Sensing Matrix
  
  11567   Thu Sep 3 13:25:40 2015 ranaUpdateCDSSimulink Webview updatedadded the cron script for this to megatron
to run at 8:44 AM each morning. Here's
the new MegaCron attached :-()-
 crontab_150903.rtf 
  11570   Fri Sep 4 00:58:29 2015 ranaUpdateCDSsoldering the Generic Pentek interface boardQ and Ignacio were taking a second look
at the Pentek interface board which we're
using to acquire the POP QPD, ALS trans,
  
  11573   Fri Sep 4 08:00:49 2015 IgnacioUpdateCDSRC low pass circuit (1s stage) of Pentek boardHere is the
transfer function and cutoff frequency (pole)
of the first stage low pass circuit of the
 circuit.pdfcircuit.png 
  11574   Fri Sep 4 09:23:32 2015 IgnacioUpdateCDSModified Pentek schematicAttached is the modifed Pentek whitening
board schematic. It includes the yet to be
installed 1nF capacitors  and comments. 
 schematic.pdf 
  11579   Fri Sep 4 20:42:14 2015 gautam, ranaUpdateCDSCheckout of the Wenzel dividersSome years ago I bought some dividers from
Wenzel. For each arm, we have x256 and a
x64 divider. Wired in series, that means
 TEK00000.PNGTEK00001.PNGTEK00002.PNG 
  11647   Tue Sep 29 03:14:04 2015 gautamUpdateCDSFrequency divider boxEarlier today, the front panels for the
1U chassis I obtained to house the Wenzel
dividers + RF amplifiers arrived, which meant
 IMG_0014.JPGIMG_0015.JPG 
  11661   Sun Oct 4 12:07:11 2015 jamieConfigurationCDSCSD network tests in progressI'm about to start conducting some
tests on the CDS network.  Things will
probably be offline for a bit.  Will
  
  11663   Sun Oct 4 14:23:42 2015 jamieConfigurationCDSCSD network test completeI've finished, for now, the CDS network
tests that I was conducting.  Everything
should be back to normal.
  
  11665   Sun Oct 4 14:32:49 2015 jamieConfigurationCDSCSD network test completeHere's an example of the glitches we've
been seeing, as seen in the StripTool trace
of the front end oscillator:
 45.png 
  11683   Fri Oct 9 19:54:58 2015 gautamUpdateCDSFrequency divider box - installation in 1X2 rackThe new ZKL-1R5 RF amplifier that Steve
ordered arrived yesterday. I installed this
in the frequency divider box and did a quick
 IMG_0027.JPGtime_seris_25MHz.pdf 
  11684   Mon Oct 12 17:04:02 2015 gautamUpdateCDSFrequency divider box - further testsI carried out some more tests on the digital
frequency counting system today, mainly to
see if the actual performance mirrors the
 calibration.pdfsystematics.pdf 
  11687   Tue Oct 13 17:04:54 2015 ericqUpdateCDSCDS thingsAfter some discussion at last week's
40m meeting, I increased the frequency of
daqd trying to write out minute trends from
  
  11690   Wed Oct 14 17:40:50 2015 gautamUpdateCDSFrequency divider box - further testsSummary:

I carried out some further diagnostics
and found some ways in which I could optimize
 time_series_input_signals.pdfcalibration_20151012.pdfsystematics_20151012.pdf 
  11699   Mon Oct 19 16:16:01 2015 ericqUpdateCDSC1ALS crashesGautam was working on his digital frequency
counter stuff when the c1als model crashed.
I had trouble bringing it back until I realized
  
  11704   Tue Oct 20 17:36:01 2015 gautamUpdateCDSFrequency counting with moving averageI'm working on setting up a moving-average
in the custom C code block that counts the
zero crossings to see if this approach is
  
ELOG V3.1.3-