40m QIL Cryo_Lab CTN SUS_Lab TCS_Lab OMC_Lab CRIME_Lab FEA ENG_Labs OptContFac Mariner WBEEShop
  40m Log, Page 329 of 335  Not logged in ELOG logo
ID Date Author Typedown Category Subject
  10132   Mon Jul 7 09:46:00 2014 SteveConfigurationSUSall sus damping restored

All suspension damping restored. There had to be an earth quake.

  10134   Mon Jul 7 11:02:22 2014 manasaConfigurationGeneralIFO status post earthquake


All suspension damping restored. There had to be an earth quake.

PMC was relocked.

MC did not need any fixing to its alignment. I had to lock it manually and autolocker is set running now. So that should take care of things

The arms were aligned and ASS'd for IR PDH.

Green light PDH locks to the arms alright.

  10137   Mon Jul 7 13:56:13 2014 AkhilConfigurationElectronicsSetup Used for Characterization of Frequency Counter

When I was trying to plot PSD of the measurements, I still couldn't get better resolution. There still seems to be a problem with timing and synchronization of the R Pi with the FC even after addition of the external trigger circuit. Now, I am looking to debug this issue. Attached are the plots showing missing data points and data from the FC at uneven spacing(zoomed in plot).


  10163   Wed Jul 9 12:01:43 2014 AkhilConfigurationElectronicsSetup Plan for placing the Frequency Counter inside the lab

Today, me and Manasa went inside the lab to figure out a place for the place for the FC. The whole setup will be placed in a chassis box . The chassis in figure(setupforFC.pdf) will be placed in the highlighted(red) box in the figure(setup.png). All the cables will be routed to the computers from behind the box and the RF cables from the beat box will be routed from the front end of the box. The two raspberry Pi boxes will be placed inside the box and the Frequency counters will be mounted as shown so that the frequency count can be seen from outside. 

  10178   Thu Jul 10 17:53:19 2014 AkhilConfigurationComputer Scripts / ProgramsEPICS installed on Raspberry Pi

 I finished the installation of EPICS base on Raspberry Pi (domenica:  /opt/epics). I tested it by creating a test SoftIoc (controls@domenica~/freqCountIOC/simple.db) and was able to read from the channel on Chiara.

Now  I am looking into how to call my C code that talks to Raspberry Pi through a  .db script and write  it into the assigned channel. 

For installation I had to make these declarations in the environment (~/.bash_aliases):




export EPICS_EXT=${EPICS_ROOT}/extensions
if [ "" = "${LD_LIBRARY_PATH}" ]; then


  10366   Mon Aug 11 23:50:38 2014 ranaConfigurationWikiDokuWikis are back up



It looks like auth is broken on the AIC wiki (though working fine on ATF and Cryo). I did some poking around but can't see how anything we did could have broken it.

I went into local.php and changed $conf['useacl'] = 1; to $conf['useacl'] = 0; and it looks like the auth issue goes away (I've changed it back). This isn't a fix (we want to use access control), but it gives us a clue as to where the problem is.

 There was still some residual permissions issue. This is now bypassed and so the ACL is ON and all seems to be back the way it was. I've tested that I can login and edit the wiki.

Some useless knowledge follows here. Please ignore.

After some hours of reading unhelpful DokuWiki blogs, I just put the backup wiki into the local disk on NODUS and then made a soft link to point to that from /users/public_html/wiki/. So this implies that the new NFS setup on chiara is different enough that it doesn't allow read/write access to the apache user on the NODUS/Solaris machine.

  10392   Thu Aug 14 19:33:00 2014 JenneConfigurationIOOMoved MC2 spot

Last night, and again just now, I used the ./MC2_spot_[direction] scripts to center the MC2 spot on the trans QPD.  The MCWFS handled overall alignment to correct for the fact that the ratios in the script aren't perfect.  When I was finished, I ran the MC WFS relief script from the WFS screen.  Last night, and again today, things had drifted until the yaw spot was more than 0.5 counts off.

  10418   Thu Aug 21 02:42:17 2014 rana, ericqConfigurationGreen LockingGain changes on Green Y PDH

[rana, ericq]

We spent time trying to relieve the Yend green PDH of it troubles. 

We realized that the mixer in the PDH setup (mini circuits ZAD-8+), wants 7dBm of LO to properly function. However, we use one function generators output, through a splitter, to give signals to the laser PZT and the mixer LO. 

We don't want 7dBm of power hitting the laser PZT, though. The summing node that adds the servo output to the sideband signal was supposedly designed to do some of this attenuation. Rana measured that 10Vpp out of the function generator resulted in 20mVpp on the fast input to the NPRO, after the summing node. Hence, the 0.09V setting was only resulting in something like 0.2mV hitting the PZT. The PZT has something like 30 rad/V PM response, meaning we only had ~0.006 rad of modulation. 

Now, the function generator is set to 2 Vpp, meaning 4 mVpp hitting the PZT, meaning ~0.12 radians of modulation. The mixer is now getting +7dBm on its LO, and the PDH traces look much cleaner. However, the PDH error signal is now something like 100mVpp, which is much bigger than the PDH board is designed for, so there is now a 10dB attenuator between the reflection PD DC block and the RF input to the mixer. 

Here are screenshots of the Inmon channel (which has a gain of ~20) showing a sweep through some PDH signal, and the error signal while in green lock. Huge 60Hz harmonics are still observed. 



Regarding these 60Hz issues, we need to make sure that we remove all situations where long BNCs are chained together with barrel connectors, or Ts are touching other ones. We also should glue or affix the pomona summing box to the shelf, so that its not just laying on the floor.

The concrete next step is to go fiddle with things, and see if we can get the 60Hz noise to go away, then measure the PDH loop and noises again. Hopefully, this should make the ALS much more reliable. 

  10420   Thu Aug 21 19:04:52 2014 ericqConfigurationGreen LockingGain changes on Green Y PDH

I found that the barrel of one the BNC to BNC connectors used for getting the output of the PDH servo box to the laser controller was touching the ETMY chamber. When I held it away, all of the 60Hz harmonics disappeared from the mixer output spectrum; this was pretty repeatable. This inspired me to replace the refl PD and PZT signal cables (which were 2 and 3 cables stitched together, respectively) with 20' long BNCs. I also cleaned up a lot of the routing of signal and power cables in the little rack, and moved the big T->DC Block->Attenuator combo off of the panel mount, because I didn't like how it was wiggling. It and the summing pomona box are sitting on top of the PDH box and function generator, instead of hanging freely.

All of the 60Hz harmonics were banished afterwards, and the green locked happily. 

This required me touching the Y end table, to remove the old cable and its cable ties, and putting the new one in. I don't think I did anything immediately apparently bad; the green and IR transmissions both are within nominal ranges. 

I haven't had luck measuring the CLG yet, which I wanted to do to get and set the UGF before measuring the noises. However, here is a scope trace of the in-lock error signal, which compares quite favorably to the trace posted in the previous post; the scope indicates that the signal has 1/3 of the RMS that it did before I replaced the cables. 


I hope to measure up the current status after I get back from dinner. 


  10430   Tue Aug 26 23:16:49 2014 ericqConfigurationGreen LockingGain changes on Green Y PDH

 Yesterday I measured the spectra and OLTF of the Y-Arm green PDH, after the LO touch-up and 60Hz hunt from last week. I also went to lower frequencies with the SR785, but forgot to take some of the background spectra down there, so I don't have the full breakdown plots yet. Nevertheless, here is the improvement in the PDH error signal:


I also measured the OLTF (SR785 injection at the error signal, Auto level ref 5mV at channel 2, 10mV/s source ramping, 50mV max output)


As you can see, we have tons of phase margin. Flipping the local boost switch had no visible effect on the OLTF; we should change it to something that puts this surplus of phase to good use, and squash the error signal even more. Putting an integrator at 5kHz should still leave about 45 degrees phase margin at 10k. I've started making a LISO model of the PDH board from the DCC drawing, and then I'll inspect the boards individually to make sure I catch the homegrown modifications. 

Data, and code used to generate the plots is attached. 

  10445   Wed Sep 3 14:07:18 2014 ranaConfigurationGeneralnetgpibdata is working again now


I gave the IPs to the bridges. According lines of /etc/hosts in linux1 were updated. WET54G1 WET54G2

 I was going through some old Koji elogs to check them for correctness (as I do weekly). I noticed that back in Dec 2013, he made the above illegal modification of IP numbers. was actually the IP for farfalla. Maybe that's why they were conflicting and farfalla not working and Q observing/imagining wireless GPIB dropouts?

I used the Wiki instructions to update the 2 bind9 files with a new number for farfalla ( which was previously the number for the long dead op240m. Farfalla is restarted and sort of working. 

  10660   Sat Nov 1 02:13:11 2014 KojiConfigurationLSCLSC settings

I'm leaving the iFO now. It is left with the IR arm mode.

I pretty much messed up LSC configurations for my DRMI locking. If one needs to recover the previous setting, use burtrestore.
I have all records of my LSC settings, so you don't need to preserve it. (Of course we can always use the hourly snapshots
to come back this DRMI setting)


  10661   Sat Nov 1 16:06:32 2014 KojiConfigurationLSCDRMI locked

Continued from ELOG 10659

DRMI locking

Following Jenne's elog entry in Aug 2013 (9049), DRMI was configured and locked. The lock was stable, indefinite, and repeatitive.

- DRMI Configuration

Demod phases has not been changed from PRMI

REFL11: WTN 0dB PHASE 21deg, REFL11I x0.1 -> PRCL
REFL55: WTN 21dB PHASE 25deg, REFL55Q x1 -> MICH, REFL55I x1 -> SRCL

AS110 phase was adjusted to maximize Q during the lock: +1deg (AS110Q_ERR was +4400 ~ +5500)

PRCL: GAIN -0.05 FM4/5 ON, Triggered FM 2/3/6/9, Servo trigger: POP22I 20up 10down, No Normaization.
MICH: GAIN +1 FM4/5 ON, Triggered FM 2/3/6/9, Servo trigger: POP22I 20up 10down, No Normaization.

SRCL: GAIN +2 FM4/5 ON, Triggered FM2/3/6/8/9, Servo trigger: AS110Q up 500 down 5, No Normaization.
(FM8 was set to be x2.5 flat gain such that the gain is increased after the lock)

MICH actuation is still BS+PRM and does not include SRCL decoupling yet.
This should be fixed ASAP.

DRMI Calibration

Let's use these entries 

SRM: http://nodus.ligo.caltech.edu:8080/40m/10664
SRM = (19.0 +/- 0.7) x 10 -9/ f2

PRM: http://nodus.ligo.caltech.edu:8080/40m/8255
PRM:  (19.6 +/- 0.3) x 10 -9 / f2 m/counts

BS/ITMs http://nodus.ligo.caltech.edu:8080/40m/8242
BS     = (20.7 +/- 0.1)    x 10 -9 / f2 m/counts
ITMX = (4.70 +/- 0.02)  x 10 -9/ f2
ITMY = (4.66 +/- 0.02) x 10 -9/ f2

- PRCL Calibration

Lock-in oscillator module 675.13Hz 100 -> +1 PRM

Measurement bandwidth 0.1Hz -> Signal power BW 0.471232 (FLATTOP window)

C1:SUS-PRM_LSC_IN1: 97.45 cnt/rtHz => 4.19 pm/rtHz

REFL11I: 12.55   cnt/rtHz => 3.00e12 cnt/m
REFL11Q:  0.197  cnt/rtHz => 4.70e10 cnt/m
=> 0.90 deg rotated! (GOOD)

REFL33I:  1.63   cnt/rtHz => 3.89e11 cnt/m
REFL33Q:  0.196  cnt/rtHz => 4.68e10 cnt/m
=> 8.32 deg rotated!

REFL55I:  0.0495 cnt/rtHz => 1.18e10 cnt/m
REFL55Q:  0.548  cnt/rtHz => 1.31e11 cnt/m => 84.8 deg rotated! (WHAT!)

REFL165I: 1.20   cnt/rtHz => 2.86e11 cnt/m
REFL165Q: 0.458  cnt/rtHz => 1.09e11 cnt/m
=> 20.9 deg rotated!

- MICH Calibration

Lock-in oscillator module 675.13Hz 100 -> -1 ITMX +1 ITMY

Measurement bandwidth 0.1Hz -> Signal power BW 0.471232 (FLATTOP window)

C1:SUS-ITMX_LSC_IN1: 121.79 cnt/rtHz => 1.26pm/rtHz
C1:SUS-ITMY_LSC_IN1: 121.79 cnt/rtHz => 1.25pm/rtHz

AS55Q:   12.45   cnt/rtHz => 4.96e12 cnt/m (STRONG)

REFL11I:  0.0703 cnt/rtHz => 2.80e10 cnt/m
REFL11Q:  0.0142 cnt/rtHz => 5.66e09 cnt/m
=> 78.5 deg rotated! (WHAT!)

REFL33I:  0.0473 cnt/rtHz => 1.88e10 cnt/m
REFL33Q:  0.0291 cnt/rtHz => 1.16e10 cnt/m => 58.4 deg rotated!

REFL55I:  0.00668cnt/rtHz => 2.66e09 cnt/m
REFL55Q:  0.0261 cnt/rtHz => 1.04e10 cnt/m => 14.4 deg rotated! (OK)

REFL165I: 0.0233 cnt/rtHz => 9.28e09 cnt/m
REFL165Q: 0.0512 cnt/rtHz => 2.04e10 cnt/m => 24.5 deg rotated! (GOOD)

- SRCL Calibration

Lock-in oscillator module 675.13Hz 100 -> SRM

Measurement bandwidth 0.1Hz -> Signal power BW 0.471232 (FLATTOP window)

C1:SUS-SRM_LSC_IN1: 121.77 cnt/rtHz => 5.08pm/rtHz

AS55I:    0.256   cnt/rtHz => 5.05e10 cnt/m
AS55Q:    0.3498  cnt/rtHz => 6.90e10 cnt/m

REFL11I:  0.00624 cnt/rtHz => 1.23e09 cnt/m
REFL11Q:  0.00204 cnt/rtHz => 4.02e08 cnt/m

REFL33I:  0.00835 cnt/rtHz => 1.65e09 cnt/m
REFL33Q:  0.0659  cnt/rtHz => 1.30e10 cnt/m

REFL55I:  0.0201  cnt/rtHz => 3.97e09 cnt/m
REFL55Q:  0.01505 cnt/rtHz => 2.97e09 cnt/m

REFL165I: 0.0238  cnt/rtHz => 4.69e09 cnt/m
REFL165Q: 0.0247  cnt/rtHz => 4.87e09 cnt/m

DRMI Openloop measurements
Servo filter TF measurements

The UGFs were ~250Hz for PRCL and ~100Hz for MICH, and ~250Hz for SRCL, respectively.
MICH showed (presumably) crosscoupling related peak ~350Hz. SRCL had small deviation from the model.
This may also be related to the cross couplig.

The OLTF was modelled by the servo and violin filters TF from foton, estimated TF of the AA/AI filters, and the constant time delay.

Displacement spectra measurement


The OLTF compensation was not actually succesfull at 300Hz, but otherwise the situation is very similar to the one with PRMI.


Again the servo compensation at 300Hz was not successful. If we believe that AS55Q is the best MICH sensor, the out-of-loop
noise level of MICH was quite similar to the one in PRMI. We should try to use AS55Q for DRMI MICH for investigation purpose
to see which REFL signal has the best MICH quality. REFL165 seems to be iproved in the signal amplitude. Can we use this
for locking now?


It is in fact difficult to tell what is the correct out-of-loop noise level. AS55I has too much contamination from MICH and is not indicating
useful info. This measurement should be tried once the sensor diagonalization is done.

REFL55I is not seeing anything real abobe 30Hz. We should be able to reduce the UGF and the servo gain.

The absolute motion level of SRCL is something similar to PRCL, rather than MICH.


  10690   Sat Nov 8 16:01:32 2014 ericqConfigurationLSCDRMI sensing

Here are some preliminary results from the sensing sweeps I did the other night. 


  • The analog AS55I signal chain is almost certainly busted in some way. This would also explain the odd looking error signals in SRX, and was actually hypothesized by Koji when discussing the SRX oddness. 
  • I used the same mirror calibration numbers from Koji's recent Elogs to turn these into counts/m.
  • MICH was excited via differential ITM motion.  I also performed a TF with BS driven MICH, with the compensating PRM output matrix in place, and it looks different, but I haven't looked too deeply into it yet. 
  • The angles plotted are in regard to the analog I and Q signals (i.e., I took TFs to I_ERR and Q_ERR and then unrotated by the digital rotation angle); this is why I suspect AS55I is broken, as all of the signals are entirely in the analog Q.
  • The amplitudes seem to be roughly consistent with Koji's recent observations. 
  • I still need to cut out the violin-filter-corrupted data points to quote the sensing elements with error bars...





xml files, and DttData matlab script used to generate these plots is attached. 

  10693   Mon Nov 10 18:23:10 2014 ericqConfigurationLSCDRMI sensing

ARG, I accidentally permuted the digital demod angles. This significantly weakens the argument for believing AS55I is broken... In fact, Jenne and I did some investigations this afternoon that showed that the channel is indeed working. SRX error signal strangeness remains unexplained, however. 

Also, I have yet to compensate for the gain of the violin filters; the actuator calibration numbers I used were for the SUS-LSC FMs, not the LSC FMs where I was injecting. New measurements will be taken soon, as well, since REFL165 is hopefully improved. 

Corrected plots are below. 




  10842   Wed Dec 24 08:25:05 2014 ranaConfigurationIOOnotes on MC locking

 I've updated the scripts for the MC auto locking. Due to some permissions issues or general SVN messiness, most of the scripts in there were not saved anywhere and so I've overwritten what we had before. 

After all of the electronics changes from Monday/Tuesday, the lock acquisition had to be changed a lot. The MC seems to catch on the HOM more often. So I lowered a bunch of the gains so that its less likely to hold the HOM locks.

A very nice feature of the Autolocker running on megatron is that the whole 'mcup' sequence now runs very fast and as soon as it catches the TEM00, it gets to the final state in less than 2 seconds.

I've also increased the amplitude of the MC2 tickle from 100 to 300 counts to move it through more fringes and to break the HOM locks more often. Using the 2009 MC2 Calibration of 6 nm/count, this is 1.8 microns-peak @ 0.03 Hz, which seems like a reasonable excitation.

Using this the MC has relocked several times, so its a good start. We'll have to work on tuning the settings to make things a little spicier as we move ahead.


That directory is still in a conflicted state and I leave it to Eric/Diego to figure out what's going on in there. Seems like more fallout from the nodus upgrade:

controls@chiara|MC > svn up

svn: REPORT of '/svn/!svn/vcc/default': Could not read chunk size: Secure connection truncated (https://nodus.ligo.caltech.edu:30889)

  10854   Mon Jan 5 20:17:26 2015 jamieConfigurationCDSGDS upgraded to 2.16.14

I upgraded the GDS and ROOT installations in /ligo/apps/ubuntu12 the control room workstations:

  • GDS 2.16.14
  • ROOT 5.34.18 (dependency of GDS)

My cursory tests indicate that they seem to be working:


Now that the control room environment has become somewhat uniform at Ubuntu 12, I modified the /ligo/cdscfg/workstationrc.sh file to source the ubuntu12 configuration:

controls@nodus|apps > cat /ligo/cdscfg/workstationrc.sh
source /ligo/apps/ligoapps-user-env.sh
source /ligo/apps/ubuntu12/ligoapps-user-env.sh
source /opt/rtcds/rtcds-user-env.sh
controls@nodus|apps > 

This should make all the newer versions available everywhere on login.

  10859   Tue Jan 6 17:41:20 2015 JenneConfigurationCDSDTT doesn't do envelopes??

[Jenne, Diego]

We are working on trying out the UGF servos, and wanted to take loop measurements with and without the servo to prove that it is working as expected.  However, it seems like new DTT is not following the envelopes that we are giving it. 

If we uncheck the "user" box, then it uses the amplitude that is given on the excitation tab.  But, if we check user and select envelope, the amplitude will always be whatever number is the first amplitude requested in the envelope.  If we change the first amplitude in the envelope, DTT will use that number for the new amplitude, so it is reading that file, but not doing the whole envelope thing correctly.

Thoughts?  Is this a bug in new DTT, or a pebkac issue?

  10897   Tue Jan 13 18:47:20 2015 ChrisConfigurationComputer Scripts / Programsinstafoton setup

To use instafoton, right click an MEDM screen, open the Execute menu, and choose "Foton".  Then click on the EPICS channel of a filter module as displayed on the screen.

Here's how it was set up:

  • Install instafoton.py in /opt/rtcds/caltech/c1/scripts; edit paths to localize for the 40m
  • Add instafoton to the MEDM_EXEC_LIST environment variable, newly defined in /ligo/cdscfg/workstationrc.sh:
    export MEDM_EXEC_LIST="Edit this screen;medm &A &:Probe;probe &P &:Foton (Pick filter PV);/opt/rtcds/caltech/c1/scripts/instafoton.py &P &"
  10940   Mon Jan 26 17:43:52 2015 ericqConfigurationIOOMC Autolocker update

The MC autolocker hasn't been so snappy recently, and has been especially fussy today. Previously, the mcup script was triggered immediately once the transmission was above a certain threshold. However, this could waste time if it was just an errant flash. Hence, I've added a 0.5 second delay and a second threshold check before mcup is triggered. 

After breaking the lock 5ish times, it does seem to come back quicker.

  10945   Tue Jan 27 17:58:21 2015 JenneConfigurationTreasureWelcome, Donatella!

Welcome to your new abode, Donatella!

  10951   Wed Jan 28 17:39:17 2015 KojiConfigurationIOOX Trans Table less crazy but not enough yet

The X-end IR Trans path was cleaned up.

I have been investigating the Xarm ASS issue. The Xarm ASS sensors behaved not so straight forward.
I went to the X-end table and found some suspect of clipping and large misalignmnet in the IR trans path.
Facing with the usual chaos of the end table, I decided to clean-up the IR trans path.

The optical layout is now slightly better. But the table is, in general, still dirty with bunch of stray optics,
loose cables and fibers. We need more effort to make the table maintained in a professional manner.

- Removed unnecessary snaking optical path. Now the beam from the 1064/532 separator is divided by a 50-50 BS before the QPD without
any other steering mirrors. This means the spot size on the QPD was changed as well as the alignment. The spot on the QPD was aligned
with the arm aligned with the current (=not modified) ASS. This should be the right procedure as the spot must be centered on the end mirror
with the current ASS.

- After the 50-50 BS there is an HR steering mirror for the Thorlab PD.

- A VIS rejection filter was placed before the 50-50 BS. The reflection from the filter is blocked with a razor blade dump.

Important note to everyone including Steve:
The transmission of the VIS rejection filter at 1064nm is SUPER angular sensitive.
A slight tilt causes significant reduction of 1064nm light. Be careful.

- As we don't need double VIS filter, I removed the filter on the QPD.

- X-End QPD was inspected. There seemed large (+/-10%) gain difference between the segments.
They were corrected so that the values are matched when the beam is only on one segment.
The corrections were applied at C1:SUS-ETMX_QPDx_GAIN (x=1, 2, 3, or 4).

I decided to put "-20dB" filters on C1:SUS-ETMi_QPD_SUM and C1:SUS-ETMi_TRY (i = X or Y)
in order to make their gain to be reasonable (like 0.123 instead 0.000123 which is unreadable).
Jenne's normalization script reads relative values and the current gains instead of the absolute values.
Therefore the script is not affected.

  10958   Thu Jan 29 17:20:58 2015 manasaConfigurationIOOX Trans Table less crazy but not enough yet

[Koji, Manasa]

We cleared up some optics and optomechanics at the X end table that are not being used and moved them to the SP table. [Ed by KA: They seemed to be leftover of the other projects. I blame them]

  10993   Tue Feb 10 02:55:29 2015 JenneConfigurationModern ControlQuacky filters

I discovered that somehow my Wiener filters that show up in Foton are not the same as what I have in Matlab-land. 

I have plotted each of my 3 filters that I'm working with right now (T-240 X, Y and Z for PRCL Pitch) at several stages in the filter creation process.  Each plot has:

  • Blue trace is the Wiener filter that I want, after the vectfit process.
  • Green trace is the frequency response of the SOS filters that are created by autoquack (really, quack_to_rule_them_all, which is called by autoquack).  The only thing that happens in matlab after this is formatting the coefficients into a string for writing to foton.
  • Red trace is the exported text file from foton.

It's not just a DC gain issue - there's a frequency dependent difference between these filters.  Why?? 

It's not frequency warping from changing between analog and digital filters.  The sample rate for the OAF model is 2048Hz, so the effect is small down at low frequencies.  Also, the green trace is already discretized, so if it were freq warping, we'd see it in the green as well as red, which clearly we don't.

Has anyone seen this before?  I'm emailing my seismic friends who deal in quack more than I do (BLantz and JKissel, in particular) to see if they have any thoughts.

Also, while I'm asking questions, can autoquack clear filters?  Right now I'm overwriting old filters with zpk([],[],1)'s, which isn't quite the same.  (I need this because the Wiener code needs more than one filter module to fit all of the poles I need, and it decides for itself how many FMs it needs by comparing the length of the poles vector with 20.  If one iteration needs 4 filter modules, but the next iteration only wants 3, I don't want to leave in a bogus 4th filter. 

Here are the plots:

(The giant peak at ~35Hz in the Z-axis fiilter is what tipped me off that something funny was going on)

  11116   Sat Mar 7 22:01:12 2015 JenneConfigurationLSCCARM and DARM on RF signals!!!!!!!!!!!!!!!!!!!!

[Jenne, with Matt and Fujimi as witnesses]

It might be about time to throw that champagne in the fridge.  Nice. Not quite close enough to talk about popping it open, but we'll want it chilled just in case... yeslaugh

I still haven't logged yesterday's work, and I'm still working now, so no details, but I just handed both CARM and DARM over to non-normalized RF signals, and had the arms stable at powers of about 105.  I was workinig on the ETM alignment, and the power was increasing, so I think that's where the extra power will come from. I was lowering the DARM gain as I improved the alignment, because the optical gain was increasing so much.  I probably just didn't do that fast enough for the last aligning, which is why I lost lock.

Anyhow, here's a plot, because I'm excited:

  11117   Sun Mar 8 00:05:37 2015 KojiConfigurationLSCCARM and DARM on RF signals!!!!!!!!!!!!!!!!!!!!

Exciting! How long was it?

  11118   Sun Mar 8 01:27:01 2015 JenneConfigurationLSCCARM and DARM on RF signals!!!!!!!!!!!!!!!!!!!!

I have in my notebook that at 9:49pm CARM was no longer using ALS as an error signal, and at 9:50pm, DARM was no longer using ALS as an error signal.  It looks like I was locked for 3+ minutes after getting to RF-only signals.

The increase in power near the end of the lock stretch was me trying to improve the dark port contrast by touching the ETMX alignment.  DARM was definitely oscillating as I improved the dark port contrast, so I was trying to hand-lower the gain as I worked on the alignment.

  11145   Thu Mar 19 14:37:17 2015 manasaConfigurationIOOIMC relocked

The autolocker was struggling to lock the IMC. I disabled the autolocker and locked the IMC manually. It seems happy right now. 

With PMC trans at 0.717 counts, the IMC trans sum is ~15230.


The MC autolocker hasn't been so snappy recently, and has been especially fussy today. Previously, the mcup script was triggered immediately once the transmission was above a certain threshold. However, this could waste time if it was just an errant flash. Hence, I've added a 0.5 second delay and a second threshold check before mcup is triggered. 

After breaking the lock 5ish times, it does seem to come back quicker.


  11343   Tue Jun 2 21:22:07 2015 rana, kojiConfigurationIOOAOM inserted in beam and aligned

We spent an hour today to put the AOM back in the beam before the PMC and verified that the diffraction is working.

  1. The fuse holder was missing from the rack. We inserted a 5A fuse. We expect that the quiesscent draw is < 0.5 A. The power is from the +24V Sorensen supply.
  2. The alignment was tricky, but we optimized it as well as we could in translation and the RZ direction. Its a fixed mount still.
  3. We noticed that according to the datasheet, the polarization is wrong! It wants S-Pol light and we're giving it P-Pol. How come no one noticed this? We expect that the efficiency is reduced because of this. We (Steve) need to brainstorm what kind of mount we can use there to mount it at 90 deg to the plane of the table.
  4. The lens after the AOM has f = +400 mm. The distance from the AOM to the lens is ~800-900 mm so its not so terrible. However, if someone were to put the AOM halfway between the turning mirrors there, the beam diffraction would be canceled.
  5. The AOM input impedance seems to be 50 Ohm as advertised. The previous Koji entry claim of 25 Ohm is mysterious. We checked the Ohmage by sending a signal into the AM input of the AOM using the DS345 which as a 50 Ohm output. 1 Vpp from the DS345 made 1 Vpp on the input of the AM input as measured by Oscope connected by T with high impedance setting.
  6. With 0.5 V offset and a 1 Vpp signal, we get ~20-25% modulation of the power.sad
  7. We have left it running with a 4444.4 Hz modulation and a small amplitude. This is to see if we can use this to measure the cavity poles of the MC and the arms.
  8. We noticed some hash on the Teed input monitor. It was backstreaming of the RF drive. Whoever uses this thing in an ISS feedback ought to make sure to put an RF choke between the servo and this AOM driver.

We also removed a 50/50 pickoff mirror which was used to take one of the NPRO -> EOM polarizer reject beams and send it across the table into a floppy dump. Its now hitting a closer floppy dump. Let's stop using these crappy anodized aluminum flappers anywhere, Steve.

We also noticed that the PMC REFL path uses a W1 from CVI to send the PMC reflection to the REFL RFPD. The dim beam from the AR coated surface is being used rather than the bright beam from the uncoated surface. Ooops. Steve, can you please order another W1 for 1064 from CVI, but get it with a 2-3 deg wedge angle? This one has a wedge which is too small.

  11399   Thu Jul 9 16:39:03 2015 KojiConfigurationGeneralHow to set up your own summary page environment on the LDG cluster

Here is the summary of my investigation how to set up my own "summary page" environment on the LDG (LIGO Data Grid) cluster.

Here all albert.einstein must be replaced with your own LIGO.ORG user name.

1. Obtain LDAS cluster account

Run the following from any of the terminal and use your LIGO.ORG credential
ssh albert.einstein@ssh.ligo.org
You will be suggested to visit a particular web site. Fill the form on the web site and wait for the approval e-mails.

2. Use LDG SSH login portal

Once you received the approval of the account, you should be able to log in to the system. Type the following command again from your local terminal
ssh albert.einstein@ssh.ligo.org
You are asked to select the site and machines. Select 2- CIT and b. ldas-pcdev1, c. ldas-pcdev2, or d. ldas-pcdev3.

3. Setup bash environment

Setting up the python library path is very important for the proper processing.

Here is my setup for .bash_profile

# .bash_profile
# Get the aliases and functions
if [ -f ~/.bashrc ]; then
    . ~/.bashrc

if [ -f ~/.profile ]; then
        . ~/.profile

# User specific environment and startup programs
export PATH

# So that ssh will work, take care with X logins - see .xsession
[[ -z $SSH_AGENT_PID && -z $DISPLAY ]] &&
  exec -l ssh-agent $SHELL -c "bash --login"

and .bashrc

# .bashrc

# Source global definitions
if [ -f /etc/bashrc ]; then
    . /etc/bashrc

# Set Python environment (based on gpwy-env script)

# clean path environment variable of duplicate entries
cleanpath() {
    if [[ -z "$1" ]]; then
    # map to local variable
    local badpath=$(eval echo \$$1)
    # remove duplicates
    badpath="$(echo "${badpath}" | awk -v RS=':' -v ORS=":" '!a[$1]++')"
    # remove trailing colon
    # reset variable and export
    eval $1=${badpath}
    eval export $1

# set PATH
cleanpath PATH
cleanpath PYTHONPATH


The order of cleanpath and PYTHONPATH= is important as we want to use the local library installation before anything kicks in.

4. Install required Python libraries

Run the following lines with this order so that they are installed in your "~/local"

# PIP installation
wget https://bootstrap.pypa.io/get-pip.py
python get-pip.py --user
# numpy, scipy, distribute, matplotlib, astropy, importlib installation
pip install numpy --upgrade --user
pip install scipy --upgrade --user
pip install distribute --upgrade --user
pip install matplotlib --user --upgrade
pip install astropy --upgrade --user
pip install importlib --user --upgrade

# We need to use dev branch of gwpy to run gwsumm propery
cp -r /home/detchar/opt/gwpysoft/lib/python2.6/site-packages/gwpy* ~/.local/lib/python2.6/site-packages/

# gwsumm installation
pip install --user git+https://github.com/gwpy/gwsumm

5. Setup summary pages for the 40m

Copy summary page setting from Max's directory.

cp -r ~max.isi/summary ~/

And make temporary directory for the summary pages.

mkdir /usr1/albert.einstein/summary

6. Modify typos in gw_summary_custon

Use your own editor to fix typos

emacs ~/summary/bin/gw_daily_summary_custom

replace max.isi to albert.einstein
change summary40m -> summary

Now the installation is done. From here, the description is for the routine procedure.

7. Run your summary page code

Run Kerberos authentication
kinit albert.einstein@LIGO.ORG

Run a summary page code for a specific date (e.g. for Jul 1st, 2015)
bash ${HOME}/summary/bin/gw_daily_summary_custom --day 20150701

The result can be checked under


Rerun a code for a specific page. This requires the page structure already exists.
The red texts should be modified depending on what ini file you want to run for what day.

/home/albert.einstein/.local/bin/gw_summary day --on-segdb-error warn --verbose  --output-dir . --multi-process 20 --no-html  --ifo C1 --archive C1EVE 20150630  --config-file /mnt/qfs2/albert.einstein/public_html/summary/etc/defaults.ini,/mnt/qfs2/albert.einstein/public_html/summary/etc/c1eve.ini

This command can actually be found in

8. Some useful command

To check which python library is used
python -c 'import gwpy; print gwpy.__file__'

To list installed python libraries and versions
pip list

This should return the list like the following.

astropy (1.0.3)
gwpy (0.1b1.dev121)
gwsumm (0.0.0.dev854)
matplotlib (1.4.3)
numpy (1.9.2)
scipy (0.15.1)



  11405   Mon Jul 13 18:27:27 2015 EveConfigurationGeneralHow to set up your own summary page environment on the LDG cluster

I'd like to build off of Koji's instructions with a few useful tips I discovered while setting up my own summary page environment.

To only make a specified selection of tabs for the summary pages, copy only the corresponding .ini files into /home/albert.einstein/summary/config and run the gw_daily_summary_custom following Koji's instructions below. When asked for nodus's password either hit "enter" three times without providing the password or comment out this section of the code to stop the summary page creation process from taking current data files from nodus. This is especially helpful when the 40m is down (like it is now).

After running the summary page code, the pages can be viewed at https://ldas-jobs.ligo.caltech.edu/~albert.einstein/summary/day/YYYYMMDD/ and corresponding error logs can be found at ~/public_html/summary/logs/gw_summary_pipe_local-687496-0.err.

  11431   Mon Jul 20 16:45:15 2015 Max IsiConfigurationGeneralSummary page c1sus.ini error corrected

Bad syntax errors in the c1sus.ini config file were causing the summary pages to crash: a plot type had not been indicated for plots 5 and 6, so I've made these "timeseries."
In the future, please remember to always specify a plot type, e.g.:




       C1:SUS-ITMY_SUSPIT_INMON.mean timeseries

By the way, the pages will continue to be unavailable while I transfer them to the new shared account.

  11530   Tue Aug 25 16:33:31 2015 Ignacio, SteveConfigurationPEMSeismometer enclosure copper foil progress

Steve ordered about two weeks ago a roll of 0.5 mm thick copper foil to be used for the inside of the seismometer cans. The foil was then waterjet cut by someone in Burbank to the right dimensions (in two pieces, a side and a bottom for each of the three cans).

Today, we glued the copper foil (sides only) inside the three seismometer cans. We used HYSOL EE4215/HD3561(Data Sheet) as our glue. It is a "high impact, low viscocity, room temperature cure casting" that offers "improved thermal conductivity and increased resistance to heat and thermal shock." According to Steve, this is used in electronic boards to glue components when you want it to be thermal conductive.

We are going to finish this off tomorrow by gluing the bottom foil to the cans. The step after this involves soldering the side to the bottow and where the side connects. We have realized that the thermal conductivity of the solder that we are using is only ~50. This is 8 times smaller than that of copper and wil probably limit how good a temperature gradient we will have.

Some action shots,

  11561   Thu Sep 3 00:14:09 2015 ranaConfigurationIOOIMC fast gain change for lock acq

The IMC often was making that scratchy noise when first catching lock and sometimes breaking. Thinking of the crappy crossover sit that EQ showed in his latest plots, I decided that it didn't make sense to acquire lock with an unstable PZT/EOM crossover, so I have changed mcdown to acquire with +13 dB Fast Gain and its much fast now and no longer makes that sound.

I also changed the caput command from 'caput -l' to 'caput -c -l' to see if the async 'wait for callback' feature will insure that the commands get sent. I witnessed the mcdown not actually writing all of its commands once or twice tonight. With the MC Boost left on its never going to lock.

mcdown has been committed to SVN. Please, if you have recently edit mcup and Autolock, commit them to the SVN or else I will delete them and do an svn up.

  11576   Fri Sep 4 10:25:19 2015 SteveConfigurationIOOAOM stage is ready

New stage can hold the correct polarization.

DRAWING CORRECTION:  Post block height was lowered to be 1.88" from 2.0"

  11581   Mon Sep 7 18:25:16 2015 ranaConfigurationIOOAOM stage is ready

The new stage missed the right height by ~2 mm. sad

Even if I completely bottom out the (New Focus 9071) 4-axis stage, its not short enough. So I removed the AOM from the beam and re-aligned into the PMC.

Steve, please get the aluminum piece remachined to go down by 2.5 mm so we can have some height adjustment room.


New stage can cheeky hold the correct polarization.

Also, the turning mirror mount just after the EOM and before the AOM is a U-100 and we want it to be a Suprema for stability - let's not forget to swap that after Steve gets the mount fixed.

  11661   Sun Oct 4 12:07:11 2015 jamieConfigurationCDSCSD network tests in progress

I'm about to start conducting some tests on the CDS network.  Things will probably be offline for a bit.  Will post when things are back to normal.

  11663   Sun Oct 4 14:23:42 2015 jamieConfigurationCDSCSD network test complete

I've finished, for now, the CDS network tests that I was conducting.  Everything should be back to normal.

What I did:

I wanted to see if I could make the EPICS glitches we've been seeing go away if I unplugged everything from the CDS martian switch in 1X6 except for:

  • fb
  • fb1
  • chiara
  • all the front end machines

What I unplugged were things like megatron, nodus, the slow computers, etc.  The control room workstations were still connected, so that I could monitor.

I then used StripTool to plot the output of a front end oscillator that I had set up to generate a 0.1 Hz sine wave (see elog 11662).  The slow sine wave makes it easy to see the glitches, which show up as flatlines in the trace.

More tests are needed, but there was evidence that unplugging all the extra stuff from the switch did make the EPICS glitches go away.  During the duration of the test I did not see any EPICS glitches.  Once I plugged everything back in, I started to see them again.  However, I'm currently not seeing many glitches (with everything plugged back in) so I'm not sure what that means.  I think more tests are needed.  If unplugging everything did help, we still need to figure out which machine is the culprit.

  11665   Sun Oct 4 14:32:49 2015 jamieConfigurationCDSCSD network test complete

Here's an example of the glitches we've been seeing, as seen in the StripTool trace of the front end oscillator:

You can clearly see the glitch at around T = -18.  Obviously during non-glitch times the sine wave is nice and cleanish (there are still the very small discretisation from the EPICS sample times).

  11754   Wed Nov 11 22:50:39 2015 KojiConfigurationCDSSlow machine time&date

I was gazing at the log file for Autolocker script (/opt/rtcds/caltech/c1/scripts/MC/logs/AutoLocker.log )
and found quite old time stamps. e.g.

Old : C1:IOO-MC_VCO_GAIN             1991-08-08 14:36:28.889032 -3
New : C1:IOO-MC_VCO_GAIN             1991-08-08 14:36:36.705699 18
Old : C1:PSL-FSS_FASTGAIN            1991-08-09 19:05:39.972376 14
New : C1:PSL-FSS_FASTGAIN            1991-08-09 19:05:44.939043 18

It was found that the date/time setting of some of the slow machines (at least c1psl and c1iool0) is not correct.
I could not figure out how to fix it.

Question: Is this anything critical?

Another thing: While I was in c1iool0 I frequently saw the message like

c1iool0 > 0xc461f0 (CA event): Events lost, discard count was 514

Is this anything related to EPICS Freeze?

controls@nodus|~ > telnet c1psl.martian
Connected to c1psl.martian.
Escape character is '^]'.
c1psl > date
Aug 09, 1991 19:13:26.439024274
value = 32 = 0x20 = ' '
c1psl >
telnet> q
Connection closed.

controls@nodus|~ > telnet c1iool0.martian
Connected to c1iool0.martian.
Escape character is '^]'.

c1iool0 > date
Aug 08, 1991 14:44:39.755679528
value = 32 = 0x20 = ' '
c1iool0 > 0xc461f0 (CA event): Events lost, discard count was 514
Change MC VCO gain to -3.
0xc461f0 (CA event): Events lost, discard count was 423
Change MC VCO gain to 18.
Change boost gain to 1.
Change boost gain to 2.


  11773   Tue Nov 17 15:49:23 2015 KojiConfigurationIOOMC Autolocker modified

/opt/rtcds/caltech/c1/scripts/MC/AutoLockMC.csh  was modified last night.

1. Autolocker sometimes forget to turn off the MC2Tickle. I added the following lines to make sure to turn it off.

    echo autolockMCmain: MC locked, nothing for me to do >> ${lfnam}
    echo just in case turn off MC2 tickle >> ${lfnam}

2. During the lock acquisition, Autolocker frequently stuck on a weak mode. So the following lines were added
so that the Autolocker toggles the servo switch while waiting for the lock.

    echo autolockMCmain: Mon=$mclockstatus, Waiting for MC to lock .. >> ${lfnam}
    # Turn off MC Servo Input button
    ezcawrite C1:IOO-MC_SW1 1
    date >> ${lfnam}
    sleep 0.5;
    # Turn on MC Servo Input button
    ezcawrite C1:IOO-MC_SW1 0
    sleep 0.5;

  11791   Thu Nov 19 17:06:57 2015 KojiConfigurationCDSDisabled auto-launching RT processes upon FE booting

We want to startup the RT processes one by one on boot of FE machines.

Therefore /diskless/root/etc/rc.local on FB was modified as follows. The last sudo line was commented out.

for sys in $(/etc/rt.sh); do
    #sudo -u controls sh -c ". /opt/rtapps/rtapps-user-env.sh && /opt/rtcds/cal\

    # NOTE: we need epics stuff AND iniChk.pl in PATH
    # we use -i here so that the .bashrc is sourced, which should also
    # source rtapps and rtcds user env (for epics and scripts paths)

    # commented out Nov 19, 2015, KA
    # see ELOG 11791 http://nodus.ligo.caltech.edu:8080/40m/11791
    # sudo -u controls -i /opt/rtcds/caltech/c1/scripts/start${sys}

  11905   Mon Jan 4 14:45:41 2016 rana, eq, kojiConfigurationComputer Scripts / Programsnodus pwd change

We changed the password for controls on nodus this afternoon. We also zeroed out the authorized_keys file and then added back in the couple that we want in there for automatic backups / detchar.

Also did the recommended Ubuntu updates on there. Everything seems to be going OK so far. We think nothing on the interferometer side cares about the nodus password.

We also decided to dis-allow personal laptops on the new Martian router (to be installed soon).

  12158   Wed Jun 8 13:50:39 2016 jamieConfigurationCDSSpectracom IRIG-B card installed on fb1

[EDIT: corrected name of installed card]

We just installed a Spectracom TSyc-PCIe timing card on fb1.  The hope is that this will help with the GPS timeing syncronization issues we've been seeing in the new daqd on fb1, hopefully elliminating some of the potential failure channels.

The driver, called "symmetricom" in the advLigoRTS source (name of product from competing vendor), was built/installed (from DCC T1500227):

controls@fb1:~/rtscore/tests/advLigoRTS-40m 0$ cd src/drv/symmetricom/
controls@fb1:~/rtscore/tests/advLigoRTS-40m/src/drv/symmetricom 0$ ls
Makefile  stest.c  symmetricom.c  symmetricom.h
controls@fb1:~/rtscore/tests/advLigoRTS-40m/src/drv/symmetricom 0$ make
make -C /lib/modules/3.2.0-4-amd64/build SUBDIRS=/home/controls/rtscore/tests/advLigoRTS-40m/src/drv/symmetricom modules
make[1]: Entering directory `/usr/src/linux-headers-3.2.0-4-amd64'
  CC [M]  /home/controls/rtscore/tests/advLigoRTS-40m/src/drv/symmetricom/symmetricom.o
/home/controls/rtscore/tests/advLigoRTS-40m/src/drv/symmetricom/symmetricom.c:59:9: warning: initialization from incompatible pointer type [enabled by default]
/home/controls/rtscore/tests/advLigoRTS-40m/src/drv/symmetricom/symmetricom.c:59:9: warning: (near initialization for ‘symmetricom_fops.unlocked_ioctl’) [enabled by default]
/home/controls/rtscore/tests/advLigoRTS-40m/src/drv/symmetricom/symmetricom.c: In function ‘get_cur_time’:
/home/controls/rtscore/tests/advLigoRTS-40m/src/drv/symmetricom/symmetricom.c:89:2: warning: ISO C90 forbids mixed declarations and code [-Wdeclaration-after-statement]
/home/controls/rtscore/tests/advLigoRTS-40m/src/drv/symmetricom/symmetricom.c: In function ‘symmetricom_init’:
/home/controls/rtscore/tests/advLigoRTS-40m/src/drv/symmetricom/symmetricom.c:188:2: warning: ISO C90 forbids mixed declarations and code [-Wdeclaration-after-statement]
/home/controls/rtscore/tests/advLigoRTS-40m/src/drv/symmetricom/symmetricom.c:222:3: warning: label ‘out_remove_proc_entry’ defined but not used [-Wunused-label]
/home/controls/rtscore/tests/advLigoRTS-40m/src/drv/symmetricom/symmetricom.c:158:22: warning: unused variable ‘pci_io_addr’ [-Wunused-variable]
/home/controls/rtscore/tests/advLigoRTS-40m/src/drv/symmetricom/symmetricom.c:156:6: warning: unused variable ‘i’ [-Wunused-variable]
  Building modules, stage 2.
  MODPOST 1 modules
  CC      /home/controls/rtscore/tests/advLigoRTS-40m/src/drv/symmetricom/symmetricom.mod.o
  LD [M]  /home/controls/rtscore/tests/advLigoRTS-40m/src/drv/symmetricom/symmetricom.ko
make[1]: Leaving directory `/usr/src/linux-headers-3.2.0-4-amd64'
controls@fb1:~/rtscore/tests/advLigoRTS-40m/src/drv/symmetricom 0$ sudo make install
#remove all old versions of the driver
find /lib/modules/3.2.0-4-amd64 -name symmetricom.ko -exec rm -f {} \; || true
find /lib/modules/3.2.0-4-amd64 -name symmetricom.ko.gz -exec rm -f {} \; || true
# Install new driver
install -D -m 644 symmetricom.ko /lib/modules/3.2.0-4-amd64/extra/symmetricom.ko
/sbin/depmod -a || true
/sbin/modprobe symmetricom
if [ -e /dev/symmetricom ] ; then \
        rm -f /dev/symmetricom ; \
mknod /dev/symmetricom c `grep symmetricom /proc/devices|awk '{print $1}'` 0
chown controls /dev/symmetricom
controls@fb1:~/rtscore/tests/advLigoRTS-40m/src/drv/symmetricom 0$ ls /dev/symmetricom
controls@fb1:~/rtscore/tests/advLigoRTS-40m/src/drv/symmetricom 0$ ls -al /dev/symmetricom
crw-r--r-- 1 controls root 250, 0 Jun  8 13:42 /dev/symmetricom
controls@fb1:~/rtscore/tests/advLigoRTS-40m/src/drv/symmetricom 0$ 
  12161   Thu Jun 9 13:28:07 2016 jamieConfigurationCDSSpectracom IRIG-B card installed on fb1

Something is wrong with the timing we're getting out of the symmetricom driver, associated with the new spectracom card.

controls@fb1:~/rtscore/tests/advLigoRTS-40m/src/drv/symmetricom 127$ lalapps_tconvert 
controls@fb1:~/rtscore/tests/advLigoRTS-40m/src/drv/symmetricom 0$ cat /proc/gps 
controls@fb1:~/rtscore/tests/advLigoRTS-40m/src/drv/symmetricom 0$ 

The GPS time is way off, and it's counting up at something like 900 seconds/second.  Something is misconfigured, but I haven't figured out what yet.

The timing distribution module we're using is spitting out what appears to be an IRIG B122 signal (amplitude moduled 1 kHz carrier), which I think is what we expect.  This is being fed into the "AM IRIG input" connector on the card.

Not sure why the driver is spinning so fast, though, with the wrong baseline time.  Reboot of the machine didn't help.

  12166   Fri Jun 10 12:09:01 2016 jamieConfigurationCDSIRIG-B debugging

Looks like we might have a problem with the IRIG-B output of the GPS receiver.

Rolf came over this morning to help debug the strange symmetricom driver behavior on fb1 with the new Spectracom card.  We restarted the machine againt and this time when we loaded the drive rit was clocking at a normal rate (second/second).  However, the overall GPS time was still wrong, showing a time in October from this year.

The IRIG-B122 output is supposed to encode the time of year via amplitude modulation of a 1kHz carrier.  The current time of year is:

controls@fb1:~ 0$ TZ=utc date +'%j day, %T'
162 day, 18:57:35
controls@fb1:~ 0$ 

The absolute year is not encoded, though, so the symmetricon driver has the year offset hard coded into the driver (yuck), to which it adds the time of year from the IRIG-B signal to get the correct GPS time.

However, loading the symmetricom module shows the following:

[ 1601.607403] Spectracom GPS card on bus 1; device 0
[ 1601.607408] TSYNC PIC BASE 0 address = fb500000
[ 1601.607429] Remapped 0xffffc90017012000
[ 1606.606164] TSYNC NOT receiving YEAR info, defaulting to by year patch
[ 1606.606168] date = 299 days 18:28:1161455320
[ 1606.606169] bcd time = 1161455320 sec  959 milliseconds 398 microseconds  959398630 nanosec
[ 1606.606171] Board sync = 1
[ 1606.616076] TSYNC NOT receiving YEAR info, defaulting to by year patch
[ 1606.616079] date = 299 days 18:28:1161455320
[ 1606.616080] bcd time = 1161455320 sec  969 milliseconds 331 microseconds  969331350 nanosec
[ 1606.616081] Board sync = 1
controls@fb1:~ 0$ 

Apparently the symmetricom driver thinks it's the 299nth day of the year, which of course corresponds to some time in october, which jives with the GPS time the driver is spitting out.

Rolf then noticed that the timing module in the VME crate in the adjacent rack, which also receives an IRIG-B signal from the distribution box, was also showing day 299 on it's front panel display. We checked and confirmed that the symmetricom card and the VME timing module both agree on the wrong time of year, strongly suggesting that the GPS receiver is outputing bogus data on it's IRIG-B output, even though it's showing the correct time on it's front panel.  We played around with setting in the GPS receiver to no avail.  Finally we rebooted the GPS receiver, but it seemed to come up with the same bogus IRIG-B output (again both symmetricom driver and VME timing module agree on the wrong day).

So maybe our GPS receiver is busted?  Not sure what to try now.


  12167   Fri Jun 10 12:21:54 2016 jamieConfigurationCDSGPS receiver not resetting properly

The GPS receiver (EndRun Technologies box in 1Y5? (rack closest to door)) seems to not coming back up properly after the reboot.  The front pannel says that it's "LKD", but the "sync" LED is flashing instead of solid, and the time of year displayed on the front panel is showing day 6.  The fb1 symmetricom driver and VME timing module are still both seeing day 299, though.  So something may definitely be screwy with the GPS receiver.

  12182   Wed Jun 15 10:19:10 2016 SteveConfigurationCDSGPS antennas... debugging

Visual inspection of rooftop GPS antennae:

The 2 GPS antennas are located on the north west corner of CES roof. Their condition looks well weathered. I'd be surprised if they work.

The BNC connector of the 1553 head is inside of the conduit so it is more likely to have a better connection than the other one.

I have not had a chance to look into the "GPS Time Server" unit.

  12200   Mon Jun 20 11:11:20 2016 SteveConfigurationCDSGPS receiver not resetting properly

I called https://www.endruntechnologies.com/pdf/USM3014-0000-000.pdf  and they said it's very likely just needs a software update. They will email Jamie the details.


The GPS receiver (EndRun Technologies box in 1Y5? (rack closest to door)) seems to not coming back up properly after the reboot.  The front pannel says that it's "LKD", but the "sync" LED is flashing instead of solid, and the time of year displayed on the front panel is showing day 6.  The fb1 symmetricom driver and VME timing module are still both seeing day 299, though.  So something may definitely be screwy with the GPS receiver.


  12201   Mon Jun 20 11:19:41 2016 jamieConfigurationCDSGPS receiver not resetting properly

I called https://www.endruntechnologies.com/pdf/USM3014-0000-000.pdf  and they said it's very likely just needs a software update. They will email Jamie the details.

I got the email from them.  There was apparently a bug that manifested on February 14 2016.  I'll try to software update today.


ELOG V3.1.3-