40m QIL Cryo_Lab CTN SUS_Lab TCS_Lab OMC_Lab CRIME_Lab FEA ENG_Labs OptContFac Mariner WBEEShop
  40m Log, Page 181 of 344  Not logged in ELOG logo
ID Dateup Author Type Category Subject
  9052   Thu Aug 22 13:03:40 2013 JenneUpdateLSCDRMI Locked for 1+ minute!!!!!!

Quote:

  Very nice!!  I was wondering, shouldn't the driving matrix be such that MICH pushes on SRM as well?

 Hmmm, yes, that's a very good point.  I think you're right, and I'll give that a try today.

  9053   Thu Aug 22 13:20:54 2013 KojiUpdateLSCDRMI Locked for 1+ minute!!!!!!

Don't go for a hacky solution. We want to climb a staircase step by step.
Prepare an independent 110MHz demod ports.

Quote:

To-do:  Set up the AS OSA.  Also, perhaps temporarily borrow the 110 demod board from POP.  We were triggering on POP22 tonight, and that seemed to work okay. 

 

  9054   Thu Aug 22 20:25:28 2013 MasayukiSummaryGreen LockingY-arm PDH OLTF measurement

[Manasa, Masayuki]
We measured the the openloop transfer function of the PDH green lock of the y-arm.The measurement setup was same as yesterday's measurement.elog 9047

In this measurement, the servo gain was 7 and the source amplitude for the excitation was 1 mV. As you can see in below figure, the measured UGF was 15 kHz and the phase margin was 45 degree.

attatchment1 - OLTF with servo gain of 7

OLTF_PDH_Glock_yarm_7.png

  9055   Thu Aug 22 21:16:47 2013 ManasaUpdateGreen LockingGTRY normalized

The Y arm green transmission has been measuring in counts all along. I modified the gain in the ALS-TRY filter module to normalise the transmission.

Transmission has been normalised with GTRY = 1 corresponding to 600 counts. 

  9056   Thu Aug 22 22:05:36 2013 ranaUpdateGreen LockingGTRY normalized

Meh. 600 counts is too weak.  You should fix the electronics so that the maximized green laser transmission gives more like ~10000 counts.

  9057   Fri Aug 23 01:52:34 2013 JenneUpdateSUSViolin filters moved to LSC, from SUS

[Rana, Jenne]

We were meditating a little bit on what may be the story behind the PRM violin filter situation.  We locked the PRMI, and turned on and off the violin filters.  We noticed, very bizarrely, that when the violin filters were ON, the servos would oscillate.  Weird.  Also, probably because the oscillation was causing us to hit the limit we have in the MICH servo, we rung up a 3rd harmonic of one of the violin modes, which was at 1955 Hz. 

We took a transfer function of the PRCL servo, saw that the UGF was 300 Hz, and lowered it to ~180 Hz.  After later investigations, that high-ish UGF probably wasn't a problem.  Anyhow, we then took MICH servo transfer functions, and saw some very weird stuff. 

At frequencies where we had violin filter notches, we were seeing peaks in the transfer function, which came close to touching, or crossed the 0dB line!  We suspect that this may have something to do with the balancing of the drives to the optics, since we have PRCL driving PRM, but MICH driving BS and PRM.  What we did was move the violin filter notches into the LSC model.  There were already SUS filter banks in the LSC model (right side of the LSC screen).  In preparation for the DRMI, I have put the BS violin notches into the BS, PRM and SRM filter banks, as well as the PRM and SRM filters into all 3 banks.  Right now for PRMI, I have the BS and PRM notches (as well as the Vio3 notch) turned on in both BS and PRM.  All of the violin-related filters are turned off in the LSC filter bank inside the SUS models.  When we did this, the servo oscillations no longer are excited when we turn on the notches, and when we take a new transfer function, there are no longer weird peaks at the notch frequencies.  More meditation needs to be done.

Also, for the violin3 filter, Rana noted that at 1955 Hz, after we confirmed that the REFL 55 phase was set correctly (and we're using REFL 55 I&Q for PRMI locking), the I-phase had a response of 0.36, while the Q-phase had a response of 0.20.  I should be able to think about these numbers, and decide if the vio3 is for the BS or the PRM violin mode.

 MICHloopNotches_23Aug2013.pdf

the above series of Bode plots shows the MICH Open Loop Gain as the REFL55 phase is adjusted (PURPLE, ORANGE) with the notches in the SUS and then (RED) as the notches are moved to the LSC and made the same for all optics.

In other news, I have the parts that Jamie ordered to make a new 110 demod board, so that's one of my daytime activities now, so we can have both POP110 and AS110.

  9058   Fri Aug 23 14:19:28 2013 ranaUpdateSUSViolin filters moved to LSC, from SUS

  Just to rephrase somewhat:

  • We balance the BS & PRM actuators in the LSC Output matrix so that there is no MICH signal going into REFL_I @ 100 Hz.
  • REFL Phase is adjusted by driving PRM and minimizing Q/I to within ~1 deg (Q/I ratio of ~2%)
  • The REFL_I sensing matrix element is ~50x bigger than REFL_Q (in W/m)
  • When we turn ON the violin mode notch in the BS SUS, it changes the MICH drive into a purely PRCL drive at that frequency !!!
  • So, putting notches into the SUS screens is bad since it imbalances the drives.
  9059   Fri Aug 23 21:01:38 2013 Alex ColeHowToElectronicsAutomated Photodetector Frequency Response System

 This post describes how to use the Automated Photodetector Frequency Response System.

On the mechanical side, turn on:

-the diode laser (in rack 1Y1)

-the RF Switch (in rack 1Y1)

-the reference PD (under the POY table)

-the AG4395A Network Analyzer

The NA’s RF output should go to the laser’s modulation input, the reference PD’s output should go to the NA’s R input, and the RF Switch Chassis’s output (which is the combination of the two switches’ COM channels using a splitter) should go to the NA’s A input.

Once this is done, navigate into /users/alex.cole and run PDFR.sh. This script collects data for each photodetector under consideration by switching using a python script and communicating with the NA via GPIB. It then sends all the data to RF.m, which fits the functions, plots the latest data against canonical data, and saves the plots to file.

The fitting function, fit.m, also outputs peak frequency to the command line. This function uses PD name data (e.g. ‘REFL33’) to choose an interval with minimal noise to fit.

The main script prompts the user to press enter after each NA sweep to make sure that measurements don’t get interrupted/put out of order by RF switching.

Once you're done, you should turn off the laser, NA, RF Switch, and reference PD.

Troubleshooting

Sometimes, the NA throws up and doesn’t feel like running a particular sweep. If this happens, it’s a good idea to keep the matlab script from trying to analyze this PD’s data. Do this by opening up RF.m and commenting out the calls to ‘fit’ and ‘canonical’ for that PD.

If fit.m complains about a particular set of data, it is often the case that the N/P ratio (where N is order of approximation and P is number of points in the interval) is too high. You can fix this by reducing N or making the PD’s frequency range (chosen in the fnew_idx line) larger.

Choosing a single PD

If you only want to grab the transfer function for one PD, first look up which switch input it belongs to. This information is contained in /users/alex.cole/switchList. To turn the switch to a particular input, type something like:

python rf.py “ch7”

This command uses TCP/IP to tell the switch to look at channel 7. Switch input numbers range from 1 to 16, though not all of them are in use.

Once the switch is looking at the correct input, you can run a sweep and download the data by typing /opt/rtcds/caltech/c1/scripts/general/netgpibdata/NWAG4395A -s 1000000 -e 500000000 -c 499000000 -f [filestem for output] -d [path of directory for output] -i 192.168.113.108 -g 10 -x 15. 

  9060   Sat Aug 24 00:11:07 2013 KojiUpdateLSCDRMI Locked with improved lock streatches

Friday night locking

Much more stable DRMI lock was achieved, partly thanks to the Friday-night quiet seismic,
and partly because of the improved servo gain and LF boosts


55MHz thru-put

I wanted to confirm the enhancement of the 110MHz signal at the AS port.

As the AS110 PD is placed in the CCD path, there is nothing visible with PRMI.
The Thorlabs PD was moved to the main AS path. Now the AS110 PD is receiving 50% of the power.
 

With PRMI 110MHz peak was -30dBm (As it was fluctuating, anything more precise number did not make sense)
When the DRMI was locked, the peak was enhanced to 0dBm.

The 2f signal comes from the beat between the sidebands.
Thus the amplitude of the intensity is proportional to the power of the sidebands (assuming the +1 and -1 order sidebands have the same amplitude)
-30dBm -> 0dBm means 31.6 times amplitude of the intensity. Therefore the amplitude transmission of the sidebands is 5.6 times more. (Is this true?)

According to the wiki, the AS port thru-put (i.e. power transmission) for the 55MHz sideband is 0.0026 and 0.43 for PRMI and DRMI respectively.
This corresponds to the amplitude difference of ~13. So we still have only half of the sidebands leaking out from the IFO. This could be attributed
to both the smaller PR gain and SR gain.


Locking setup

Same as the one Jenne used the other day. Later I engaged several additional triggers.
The following is the trigger setting I used

MICH: Delay 2 sec, FM1/FM2/FM3/FM6/FM7

PRCL: Delay 0.5 sec, FM2/FM3/FM6

SRCL: Delay 5 sec, FM1/FM2/FM3/FM6

SRCL FM1 was modified from +3dB to +6dB


Lock stability

Once lock is acquired, it lasts tens of minutes. (see the attached striptool chart.)
Even the lock is lost, it reacquires quickly.

The videos to show the lock acquisition and the in-lock stability are attached below.
The AS port beam is very round. It is not so shaky, but some yaw motion is visible.
The mode at the AS port is defined by the SRM, putting a QPD at the AS port would help to
stabilize the spot.


IFO state upon leaving

I left the 40m with the arms aligned, PRM and SRM slightly misaligned, and LSC setting is for the DRMI locking.


TO DO

- AS110I/Q for triggering

- PRCL/MICH/SRCL normalization

- We should resurrect the IFO config scripts.

- Remove BS->SRCL actuation coupling

- Handing off to 3f signals (preparation for the full lock)

- Improve ALS stability

- SRM ASC: AS QPD for SRM control


Lock Acquisition Video
UL (REFL) / UR (POP)
LL (AS) / LR (PRM Face)

 
In-lock video
UL (REFL) / UR (POP)
LL (AS) / LR (PRM Face)

 

Attachment 1: Screenshot-Untitled_Window.png
Screenshot-Untitled_Window.png
  9061   Sun Aug 25 06:07:11 2013 ranaUpdateLSCDRMI Locked with improved lock streatches

 We're ready for using the auto configure.

We can put our scripts for the MICH, PRMI, and DRMI into the IFO CONFIGURE screens for now and then it should be easy to get them into the Guardian once Jamie has the bugs worked out.

This screen can also be used to setup and start the dither alignment for each configuration (once we have one working for DRMI / SRM).

Also, now that the notches/bandstop filters for the violin modes have been move from the SUS into the LSC, we should fix the triggering to engage them a few seconds after the boosts.

  9062   Mon Aug 26 18:55:18 2013 JenneConfigurationElectronicsputting together a 110 MHz LSC demod board for AS

I have modified one of the spare demod boards that was sitting above the electronics bench (the one which was unlabeled - the others say 33MHz, 55MHz and 165MHz) to be the new AS110 demod board.  In place of the T1 coil, and the C3 and C6 resistors, I have put the commercial splitter PSCQ-2-120+.  In place of U5 (the low pass for the PD input) I have put an SCLF-135+. 

In order to figure out how to make the pinout of the PSCQ match up with the available pads from T1, I first pulled the "AS11" board (it's not something that we use, so it would be less of a tragedy if something happened while I had the board pulled).  However, while the PCB layout is the same, the splitter for the low frequencies (PSCQ-2-51W) has a different pinout than the one I need for the 110MHz.  So, I put AS11 back, and pulled the POP110 board. (After I noted the pinout on POP110, I reinstalled that board.  To get it out, I had to unplug the I and Q outs of POP22, but I have also replugged those in).

For my new AS110 demod board, I copied the pin connections on POP110.  I have made a little diagram, so you can see what pins went where.  The top 2 rectangles are the "before" installation cartoon, and the bottom is the "as installed" cartoon.

AS110_demod_board_modifications.pdf

The one thing that must be noted is that, because of the pinout of the splitter and the constraints of the board layout, the +0 degrees (I-phase) output of the splitter is connected to the Q channel for the rest of the demod board.  This means that the +90 degrees (Q-phase) output of the splitter is connected to the I channel for the rest of the demod board.  This is not noted for POP110, but is true for both:  The I and Q channels of the 110 MHz demod boards are switched.  In practice, we can handle this with our digital phase rotation.

Daytime tomorrow, I will test my new board as Suresh did in elog 4736.  Before we get to use AS110, we need (a) some LO juice from the RF distribution box, and (b) a spot to plug the board in, in the LSC rack.  Meditating on how those are going to happen are also tasks for daytime tomorrow.

  9063   Mon Aug 26 18:59:08 2013 MasayukiUpdateLSCLSCoffset script updated

I made scripts/LSC/LSCoffsets2.py which is the script to zero the dark offset of all the LSC PD.  The list of PDs is same as the list in scripts/LSC/LSCoffsets. New script average all outputs of PDs parallelly, so we can zero the offsets much faster.

You can define the averaging time, and you can choose the channel for getting the dark offset from INMON or OUT16. You should know that if you use OUT16 channel, the effect of the unwhite filter is not taken into account.

Example usage (at scripts/LSC):

   ./LSCoffsets2.py -d 20 --out16

you can find the help by calling this script with option -h or --help

  9064   Mon Aug 26 19:13:38 2013 KojiUpdateLSCLSCoffset script updated

What do you mean???

What is the effect of the anti-whitening filter?

Quote:

You should know that if you use OUT16 channel, the effect of the unwhite filter is not taken into account.

 

  9065   Mon Aug 26 19:31:22 2013 manasaUpdateSUSPRM, ITMY watch dogs

PRM and ITMY were found with their watchdogs shutdown this afternoon (cause unknown). I re-engaged them.

  9066   Mon Aug 26 19:54:15 2013 manasaUpdateCDSc1als model modified

I had made changes to the c1als model a couple of weeks ago. I had removed all the beat_coarse channels that had existed from pre-phase tracker era.

Also, I forgot to elog about it then. This dawned on me only when I found that c1als isn't working the way it should right now.

mistake-cartoon.gif

  9067   Mon Aug 26 20:13:17 2013 ranaConfigurationElectronicsputting together a 110 MHz LSC demod board for AS

Quote:

I have modified one of the spare demod boards that was sitting above the electronics bench (the one which was unlabeled - the others say 33MHz, 55MHz and 165MHz) to be the new AS110 demod board.  In place of the T1 coil, and the C3 and C6 resistors, I have put the commercial splitter PSCQ-2-120+.  In place of U5 (the low pass for the PD input) I have put an SCLF-135+.

OK, but what kind of filter should we be actually using? i.e. what purpose the 135 MHz low pass serve in contrast to a PHP-100+ ?

  9068   Tue Aug 27 02:18:28 2013 JenneUpdateLSCPRMI, DRMI sensing matrices

I have made a measurement of the PRMI and the DRMI sensing matrices. 

Keiko pointed out to me in an email a little while ago that I wasn't zeroing elements in the oscillator drive matrix after using them, so I was effectively driving all the degrees of freedom at once, which is why some of the recent sensing matrices looked a little bullshitty.  Anyhow, I put in a few lines to zero that row of the LSC  output matrix, so that we don't do that any more. 

PRMI sensing matrix:

SensMatMeas_26Aug2013_withErrorBars.png

DRMI sensing matrix, first-ever measurement, after the optic flipping / recent locking success:

SensMatMeas_26Aug2013_DRMI_firstEverMeasurement.png

Note that we don't have any error bars in the DRMI case, since the IFO fell out of lock during the error bar measurements.  So, we got the "real" data from the degrees of freedom, but not extra data for making error bars.  Also, the MICH / SRCL coupling hasn't been balanced out in the output matrix yet, but since the notches are engaged in the degrees of freedom during this measurement, that shouldn't be a significant effect.

To get the DRMI sensing matrix measured, I added the SRM's actuator calibration to SensMatDefinitions.py (data from elog 5637).  I also created a new file runDRMI_sens, to be the equivalent of runPRMI_sens.  In the new runDRMI_sens, I reduced the actuation from the oscillator by a factor of 10.  I had several attempts at higher oscillator amplitudes that kept kicking the IFO out of lock.

The DRMI was pretty good, but I wasn't getting ~10s of minutes like Koji was on Friday.  I also wasn't able to engage all of the FM triggers that he was.  The 10-30 Hz seismic BLRMS is a little higher than a usual night, but other than that, seismic looks pretty quiet.

My settings for the night:

LSC input matrix:  +0.1*REFL55Q = MICH, -0.125*REFL11I = PRCL, +1.00*REFL55I = SRCL.

Filter settings:  MICH, PRCL, SRCL all had FM4,5 always on.  MICH had FM2,3 triggered.  PRCL had FM2,3,6 triggered.  SRCL had FM2 triggered.  In particular, engaging FM 6 for MICH or SRCL made some loud low-ish frequency oscillation.  Engaging anything other than FM2 for SRCL kicked the IFO out of lock. 

Gains:  MICH = -0.800, PRCL = +0.050, SRCL = -0.100

Triggering:  All triggered on POP22I, upper = 50, lower = 10 (lower = 25 for SRCL).

FM trigger thresholds: MICH on = 35, off = 2, delay = 2 sec.  PRCL on = 35, off = 2, delay = 0.5 seconds.  SRCL on = 80, off = 25, delay = 5 sec.

Power normalization:  None, for any degree of freedom.

LSC Output matrix:  MICH = -0.267 for PRM, +0.50 for BS.  PRCL = +1.0 for PRM.  SRCL = +1.0 for SRM. 

LSC SUS filters:  BS, PRM, SRM all had FM1,2,3,6 engaged for the BS, PRM and SRM violin filters, as well as the 3rd order harmonic for one of them.

Other notes: 

I tried locking the SRMI, so that I could do the same kind of actuator calibration that Koji did for the PRMI in elog 8816, but was unsuccessful.  I checked optickle, and found that for REFL 55 I&Q locking, MICH and SRCL keep the same signs for SRMI as DRMI.  Also, for both, the optical response is a factor of ~15 lower for SRMI than DRMI, so the gains should be higher by a factor of 15 for both MICH and SRCL.  I think my big problem here is that I don't have anything to trigger on.  There isn't any signal to speak of in the POP PDs, with the PRM misaligned.  Hopefully we'll have AS110 shortly, and that will help.

I updated the IFO Configure restore scripts to our latest versions of locking.  I have also tested them, and restoring the Michelson, PRMI and DRMI all seem to work. (MICH restores to locking with AS55Q.  PRMI restores to locking with REFL165 I&Q.  DRMI restores to the settings noted above in this entry.)  The X and Y arm restores have been working, and I have been using them (semi-)regularly since I announced them in elog 8433 back in April.  Still to-do though:  Add PRCL ASC to the PRMI up script, and make the dither options work for at least the arms and PRM.  (Just need to point the drop down menu options to the new ASS scripts.)

 

 

  9069   Tue Aug 27 15:31:48 2013 JenneConfigurationElectronicsputting together a 110 MHz LSC demod board for AS

Quote:

Quote:

I have modified one of the spare demod boards that was sitting above the electronics bench (the one which was unlabeled - the others say 33MHz, 55MHz and 165MHz) to be the new AS110 demod board.  In place of the T1 coil, and the C3 and C6 resistors, I have put the commercial splitter PSCQ-2-120+.  In place of U5 (the low pass for the PD input) I have put an SCLF-135+.

OK, but what kind of filter should we be actually using? i.e. what purpose the 135 MHz low pass serve in contrast to a PHP-100+ ?

 Hmmm. Indeed. This is just cutting off higher frequency stuff, but anything from other lower sidebands still gets through.  I should actually stick in the SXBP-100's, which will band pass from 87-117 MHz.  These have an insertion loss at 100 MHz of 1.64 dB. 

Jamie ordered 2 of these, so I can put one in each of AS110 and POP110. 

  9070   Tue Aug 27 15:44:08 2013 manasaUpdateCDSIssues with ALS fixed

I figured out the problem with ALS from yesterday. While the model was just fine, the medm screens were not checked if they were reading the correct channel names. 

The channel names of the ALS input matrix elements had changed when the coarse channels were deleted from the c1als model. So the error signals were not reaching the servo modules as expected. This is why I was not able to make sense as to what the ALS was doing. 

All is fixed now and should be back to normal

  9071   Tue Aug 27 17:32:52 2013 JenneConfigurationElectronicsputting together a 110 MHz LSC demod board for AS

I measured the phase split between the I and Q signals of my AS110 board.  To do so, I plugged the board into an empty slot next to the PD DC readout / whitening board in the LSC rack.  I borrowed the POP110 local oscillator, and used a Marconi to generate a "PD input".  (I'm roughly following what Suresh did in elog 4736).  Our 11MHz is currently 11.066134MHz, so I had the Marconi going at 110.662340 MHz (1kHz from 10*11MHz), and I had the Marconi source at -13dBm.  

I took a transfer function using the SR785 between the I and Q outs of the AS110 demod board, and got a magnitude misbalance of 0.809 dB, and a phase split of 110.5 degrees.  This isn't so close to 90 degrees, but this may be a problem with the splitter that we're using, as Suresh detailed in elog 4755.  In that elog, he measured a phase split of POP110 of 105 degrees, unless the power going into the splitter was pretty high.  As with POP110, since I expect that we'll usually only look at one channel (I, for instance), this isn't such a big deal for AS110. 

I have left, for now, the board in the empty slot.  It looks like (I'm going to go check) there are 3 open channels on the whitening board that has the PD DC signals.  So, the only thing left to figure out is how we want to get some local oscillator action for this new board.

EDIT: Yes, those channels are available.  Right now (as a remnant from testing the whitening filters waaaay back in the day) they are called C1:LSC-PDXXX I, Q, DC.  I'll use 2 of those for the AS110 I and Q. 

  9072   Tue Aug 27 18:21:35 2013 JenneConfigurationElectronics110 MHz LO options

As I see it, we have a few options for getting the 110 MHz LO to both the POP110 and AS110 demod boards.  

The current situation is described by Kiwamu in elog 5746.  The 55 MHz signal comes into the box, and is split 4 ways, with each path having 19.7 dBm.  One of these 4 is for 110.  It has a 2dB attenuator (giving us ~17.7 dBm), and then it goes to an MK-2 frequency multiplier.  I'm a little lost on why we're giving the MK-2 17 dBm, since it says that it can handle an input power between 1 - 15 dBm.  It has ~16 dB conversion loss, so the 110 output of the distribution board has (according to the drawing) 1.9 dBm.  The demod boards have a 10 dB attenuator as the first element on the LO path, so we're giving the ERA-5 -8 dBm. 

We can either amplify the 110 leaving the distribution box, split it, and then attenuate it to the appropriate level for the demod boards, or we can change the attenuators on the POP110 and AS110 demod boards. 

Since we seem to be over driving the 2x frequency multiplier, I think I should change the 2dB attenuator to a 5dB attenuator, so we're giving the 2x multiplier ~15 dBm.  The conversion loss of ~16 dB means we'll have -1 dBm of 110 MHz.  I want to amplify that by ~10 dB, to give 9 dBm.  Attenuate by 5 dB to get to 4 dBm, then split into 2, giving me 2 110 MHz spigots, each of ~1 dBm.  Since the demod boards expect between 0-2 dBm for the LO's, this should be just fine.

Thoughts, before I start scrounging parts, and pulling the RF distribution box?

  9073   Tue Aug 27 18:58:52 2013 KojiConfigurationElectronics110 MHz LO options

- Do we have an appropriate amplifier?

- True challenge could be to find a feedthrough for the new port. (or to find a space for the amplifier in the box)

- PDXXX channels is on the DC whitening filter module. There could be some modification on this module (like diabling the whitening gain selector).

- We don't have AS11 and AS165, and so far it is unlikely to use AS11. i.e. The feedthrough, the slot on the crate, the whitening, and the channels can be trasnsition from 11 to 110.

Quote:

I want to amplify that by ~10 dB, to give 9 dBm.  Attenuate by 5 dB to get to 4 dBm, then split into 2, giving me 2 110 MHz spigots, each of ~1 dBm. 

Thoughts, before I start scrounging parts, and pulling the RF distribution box?

 

  9074   Tue Aug 27 19:34:36 2013 JamieConfigurationCDSfront end IPC configuration

So the IPC situation on the front end network is not so great right now.  For various no-longer-valid reasons, c1lsc had no RFM card, all the IPC connections were routed through the c1rfm model on c1sus, and routed to c1lsc via dolphin PCIe as needed.  As things grew, c1rfm became overloaded.  Koji tried to fix the situation by breaking things out of c1rfm to make direct connections where we could.  This cleared up c1rfm a bit, but not c1mcs is overloading.

Reminder: PCIe (dolphin) is faster and higher bandwidth than RFM.  The more things we can put on PCIe the better.

Attached is a graph of my rough accounting of the intended direct IPC connections between the front ends.  By "intended direct" I mean what should be direct connections if we had all the appropriate hardware.  Right now the actual connection graph is more convoluted than this since things are passing through c1rfm.  I note this graph was NOT particularly easy to make, which is very unfortunate.  I had to manually look through every model and determine the ultimate source of every incoming IPC.  Kind of a pain in the butt.  It would be nice if there was a simple way to represent this.

Here are some various solutions to the problem as I see it:

a) put c1lsc on the RFM network

This would allow c1lsc to talk to c1ioo, c1iscex, and c1iscey without having to go through c1sus, thereby eliminating c1rfm altogether.  I'm not sure why we didn't just do this originally.

Requires:

  • One RFM card for c1lsc

b) put c1ioo on the PCIe network (and move c1sus's RFM card to c1lsc)

This is probably the most robust solution.

b1) There are roughly 8 IPCs going from c1ioo to c1sus, and 4 going the other way, and 3 IPCs from c1ioo to c1lsc.  If we put c1ioo on PCIe all of these now RFM connections would become direct PCIe connections, which would be a big win.

At this point only the end station front ends would be on RFM, and most of the connections to those come from c1lsc, so it would make sense to give c1lsc the RFM card, thereby eliminating a lot of stuff from c1rfm.

Requires:

  • dolphin card for c1ioo (do the old sun machines support these?  if they don't we could swap the old sun machine with a new spare aLIGO-approved supermicro machines, which we have spares of)
  • dolphin fibre to go to dolphin switch in 1X3 rack

b2) OR, we could move c1ioo to 1X4 with c1lsc and c1sus, and get a OneStop fibre cable to connect to its IO chassis.  We would still need a dolphin card, but we could use coper instead of fibre.  This is my preferred solution, since it moves c1ioo out of 1X1, where it's really in the way and making a lot of noise.  It would also be easier to manage all the machines if they're together in one rack.

Requires:

  • dolphin card for c1ioo
  • dolphin coper cable for c1ioo
  • OneStop fibre for c1ioo

c) put another cpu in c1sus

c1sus is (I believe) able to support another 6-core cpu.  If we added more cores to c1sus, we could break up c1rfm into c1rfm0, c1rfm1, etc.  This is a less elegant solution imho, but it would probably do the job.

Requires:

  • one new CPU for c1sus
Attachment 1: hosts.png
hosts.png
  9075   Tue Aug 27 19:50:06 2013 JamieConfigurationComputer Scripts / Programscdsutils checked out into /opt/rtcds

I have checked out the new cdsutils repository at:

/opt/rtcds/cdsutils/release

This is a new repository that is intended to hold all of our python libraries and command-line utilities for interacting with the IFO, things like:

  • get/write values EPICS channels
  • interact with filter module switches
  • average a test point for some amount of time
  • etc.

Basically everything that used to be ez* or tds*.

There's not much in there at the moment, but hopefully it will start to get filled in soon.

WARNING:

This code in here will be used by the sites to interact with the real aLIGO IFOs.  Please be careful as you develop things in here, and o so conscientiously.  If you do bad things here and it messes things up at the sites people will be angry.  Particularly me, since I have to support everything in here for Guardian use.

Usage

<cdsutils>/lib/cdsutils is the primary python library.  For each function you want to add, put it in a new file named after the function.  So for instance function "foo" should be in a file called <cdsutils>/lib/cdsutils/foo.py.

There is a command line utility at <cdsutils>/bin/cdsutils.  It will automatically find anything you add to the library and expose it as a sub command (e.g. "cdsutils foo")

We'll try to put together a wiki page describing development and usage of this soon.

  9076   Tue Aug 27 20:43:34 2013 KojiConfigurationCDSfront end IPC configuration

The reason we had the PCIe/RFM system was to test this mixed configuration in prior to the actual implementation at the sites.
Has this configuration been intesively tested at the site with practical configuration?

Quote:

Attached is a graph of my rough accounting of the intended direct IPC connections between the front ends. 

It's hard to believe that c1lsc -> c1sus only has 4 channels. We actuate ITMX/Y/BS/PRM/SRM for the length control.
In addition to these, we control the angles of ITMX/Y/BS/PRM (and SRM in future) via c1ass model on c1lsc.
So there should be at least 12 connections (and more as I ignored MCL).

I personally prefers to give the PCIe card to c1ioo and move the RFM card to c1lsc.
But in either cases, we want to quantitatively compare what the current configuration is (not omitting the bridging by c1rfm),
and what the future configuration will be including the addtional channels we want add in close future,

because RFM connections are really costly and moving the RFM card to c1lsc may newly cause the timeout of c1lsc
just instead of c1sus.

  9077   Wed Aug 28 00:41:23 2013 JenneUpdateCDSCDS svn commits not happening

svn status update. asx, als and ioo were found not committed. Not sure about who modified ioo last after Jenne.

//edit Manasa - edited the/ elog instead of replying //

  9078   Wed Aug 28 03:28:00 2013 JenneUpdateLSCPlaying with DRMI, some ASS automation prep

[Rana, Jenne]

We did lots of poking around with the DRMI tonight.  I should elog more in the morning, but the most important points are:

Locking settings same as elog 9068, except PRCL gain changed to 0.035, and the FMs that are triggered.  PRCL tonight had FM2,3,6 triggered.  MICH had FM1,2,3,7 triggered.  SRCL had FM1,2 triggered.  Engaging the MICH boosts helped make things more quiet, so that some of the SRC boosts could be enabled.  Still not as good of lock stretches as Koji got last Friday (elog 9060). 

REFL55 and REFL11 were still saturating (only during acquisition), after the optical path changes I did last week (elog 9043).  We reduced the REFL55 whitening slider from 15 dB to 6 dB (but forgot to compensate with digital gain), to keep the counts (as seen on DTT time series, binning off) to less than ~20,000 counts.  REFL11 is still saturating, and we're not sure why, since it's slider gain is 0 dB.  To be investigated.

I was prepping the ASS to be more conveniently put into a wrapper script, which could be called from the IFO Configure screen.  This involved adding PRCL to the burt .req and .snap files, as well as modifying the scripts a little bit to include PRCL as an option.  I ended up changing the script names from DITHER_Arm_ON.py and DITHER_Arm_OFF.py to DITHER_ASS_ON.py adn DITHER_ASS_OFF.py, since they are no longer restricted to being arms-only.  You must still provide an argument to the script, to tell it which degree of freedom you want to activate.  I also changed the save offsets scripts.  The way they were, the X and Y arms just had separate hard-coded scripts, with no convenient way to incorporate PRCL.  I merged them (including PRCL) into WRITE_ASS_OFFSETS.py, which you must now provide the DoF as an argument.  I tested these new scripts on all 3 of the DoFs, and made changes to the ASS screen, so it now calls only the new scripts.  It should now be easy to incorporate future ASS modifications.

Rana was in the middle of modifying the ASS model to include SRCL, and we also need to include MICH.  The ASS model is not compile-ready, so don't compile it!!  If you need to compile the ASS, please save what's there as a different name, and do an "svn up" to get the latest working version.


We suspected that there might be angular drive issues with the SRM (it was wiggling a lot). We checked the damping via step responses - all Qs were less than 10. Then we found that the INPUT button on the SRM PIT OL was OFF (why ???). After turning this back on it behaved better. We measured the loop shape and found that the UGF was 7 Hz; good. Need to work on some loop shaping for this guy. Its just 1/f out to 300 Hz right now. UGF should be made a little lower so that we can stably turn on the Bounce/Roll notches and a ~50 Hz low pass filter.

Most importantly, the F2A filters need to be measured and implemented. They are a few years old.

  9079   Wed Aug 28 05:21:58 2013 manasaUpdateCDSCDS svn commits not happening

I am responsible for missed svn commits with als and asx. I have committed them.

But I have not modified anything with ioo in the last few weeks.

 

  9080   Wed Aug 28 06:17:15 2013 manasaUpdateComputer Scripts / Programsalias for MATLAB2010

Although Matlab 2013 has not been causing any visible trouble so far, it takes a while to startup.

I have added alias 'ml10' to bash to start Matlab 2010 from the terminal for convenience.

  9081   Wed Aug 28 06:26:28 2013 manasaUpdateComputer Scripts / ProgramsASS req and snap files edited

[From yesterday] ASS for X arm was behaving slightly funny over the last couple of days. ASS could not correct the BS misalignment. Jenne pointed out that the LSC output matrix on the ASS medm screen set itself to zeroes whenever we ran the ASS_dither_ON script. I checked the burt request file: ASS_DITHER_ON.req  in /opt/rtcds/caltech/c1/scripts/ASS and found that the LSC output matrix channels were not added to it. I added these channels for both the X and Y arm. Following this, I also edited the corresponding snap file as well. This should now set the LSC matrix to the right values everytime we run the script.

  9082   Wed Aug 28 07:33:51 2013 manasaUpdateLSCMICH locking

I wanted to measure the OLTF of MICH.

What I did:
1. Ran LSC offsets script to zero all the offsets.

2. Restored the IFO configure settings for locking Michelson (locked on AS55Q).

3. MICH wouldn't lock on these settings.

4. The MICH servo was hitting its limits (10000 counts). I checked the filter module. After a little bit of looking into things, I disabled FM3 (0,0:5,5), FM4 (1:10) and FM7 (1:5). FM3 and FM7 were filter modules that were switched ON at the trigger. I set these to manual. Enabling any of the filters (FM3, FM4, FM7) caused MICH to lose lock.

5. MICH gain was changed from -20 to -30. MICH locked with ASDC suppressed to 0.01 counts. I looked at the power spectrum of C1:LSC-MICH_OUT on dtt. //edit: Manasa// The plot (uncalibrated) now shows MICH_OUT power spectrum with MICH PSL shutter closed, free-running MICH and loop-enabled MICH.

6. I then wanted to measure the OLTF of MICH using dtt. A channels were set to C1:LSC-MICH_IN1/C1:LSC-MICH_IN2 and excitation given through C1:LSC-MICH_EXC. But I have not been able to get any good coherence for the measurement as yet.

Attachment 1: MICH.pdf
MICH.pdf
  9083   Wed Aug 28 11:15:02 2013 SteveUpdateGreen LockingXend green layout corrections

Quote:

Quote:

 Shutter moved, no more clipping.

Pick-off mirror 2" replaced by 1" one. Laseroptik HR 532nm, incident angle 30-45 degrees, AR 532 nm

Green REFL PD moved to 4" close to pick-off mirror. Pd being close to pick-off does not separate multiple reflections on it. I'll replace Laseroptic mirror with Al one. It is not easy to find.

 Hole cut into side wall for doubler oven cable to exit.

 

 

 Beam trap for Pd refl is in place. Cabeling is ti·died up.

 Laseroptic 1" mirror is replaced by Al 1" mirror. Problem remains the same. This diffraction patter has to be coming from the Faraday.

  Atm1, good separation when Pd is far 

  Atm2, bad separation when Pd is close 

 The extra high post 3.375"  for PZT is ready. We also have 2 more 2" green Laseroptik mirrors. I'm ready to swap them in.

The  75 mm  focal length  lens  was placed in front of the green REFL PD yesterday.

  9084   Wed Aug 28 11:23:41 2013 SteveUpdateVACcrane repair sheduled

Quote:

 1, Vacuum envelope grounds must be connected all times!  After door removal reconnect both cables immediately.

 2, The crane folding had a new issue of getting cut as picture shows.

 3, Too much oplev light is scattered. This picture was taken just before we put on the heavy door.

 4, We were unprepared to hold the smaller side chamber door 29" od of the IOC

 5, Silicon bronze 1/2-13 nuts for chamber doors will be replaced. They are not smooth turning.

 

 Fred Goldbar of KoneCranes will come 7:30am Wednesday, September 4 to look at this issue.

It is changed to Thursday morning.

  9085   Wed Aug 28 15:41:42 2013 SteveUpdateVACRGA scan at day 23

 Valve configuration: Vacuum Normal

pd76-m-d23

 

Attachment 1: pd75md23.png
pd75md23.png
  9086   Wed Aug 28 19:47:28 2013 jamieConfigurationCDSfront end IPC configuration

Quote:

It's hard to believe that c1lsc -> c1sus only has 4 channels. We actuate ITMX/Y/BS/PRM/SRM for the length control.
In addition to these, we control the angles of ITMX/Y/BS/PRM (and SRM in future) via c1ass model on c1lsc.
So there should be at least 12 connections (and more as I ignored MCL).

Koji was correct that I missed some connections from c1lsc to c1sus.  I corrected the graph in the original post.

Also, I should have noted, that that graph doesn't actually include everything that we now have.  I left out all the simplant stuff, which adds extra connections between c1lsc and c1sus, mostly because the sus simplant is being run on c1lsc only because there was no space on c1sus.  That should be corrected, either by moving c1rfm to c1lsc, or by adding a new core to c1sus.

I also spoke to Rolf today and about the possibility of getting a OneStop fiber and dolphin card for c1ioo.  The dolphin card and cable we should be able to order no problem.  As for the OneStop, we might have to borrow a new fiber-supporting card from India, then send our current card to OneStop for fiber-supporting modifications.  It sounds kind of tricky.  I'll post more as I figure things out.

Rolf also said that in newer versions of the RCG, the RFM direct memory access (DMA) has improved in performance considerably, which reduces considerably the model run-time delay involved in using the RFM.  In other words, the long awaited RCG upgrade might alleviate some of our IPC woes.

We need to upgrade the RCG to the latest release (2.7)

  9087   Wed Aug 28 23:09:55 2013 jamieConfigurationCDScode to generate host IPC graph
Attachment 1: hosts.png
hosts.png
Attachment 2: 40m-ipcs-graph.py
#!/usr/bin/env python

# ipc connections: (from, to, number)
ipcs = [
    ('c1scx', 'c1lsc', 1),
    ('c1scy', 'c1lsc', 1),
    ('c1oaf', 'c1lsc', 8),

    ('c1scx', 'c1ass', 1),
    ('c1scy', 'c1ass', 1),
... 96 more lines ...
  9088   Thu Aug 29 17:25:50 2013 JamieUpdateSUSSUS medm screen upgrade

Rana asked me to look at the SUS MEDM screen upgrade situation, and provide an upgrade prescription.  Unfortunately there not really a simple prescription that can be used, since our configuration diverges quite a bit from what's at the sites.  But here's what I can say:

It looks like we already have the beginnings of an upgrade in place, so I say we just run with that.  The new screens are in:

/opt/rtcds/userapps/release/sus/c1/medm/new

The primary screen is:

/opt/rtcds/userapps/release/sus/c1/medm/new/OVERVIEW.adl

This seems to be a copy of the site ASC_TIPTILT screens.  (In fact I think I remember putting this here).  I went ahead and did some ground work to make it easier to get these new screens into place.

  • I cleaned up all the channel name prefixes so that at least the channel prefixes will resolve to our SUS channels.
  • I made a link from the sitemap with some of the correct macros to fill some things in appropriately: "IFO SUS/NEW ETMX"
  • I fixed the names to the sub-screens, so that it correctly opens the correct sub-screens (although the macros seem to not be passed correctly)

At this point someone needs to just go through and fix all the channel names to match ours, and tweak the screen to our needs (there's no side OSEM, for instance).  The subscreens need to be cleaned up as well.

sed replace string

If there is a specific string you want to replace every instance of in the screen, you can do that easily from the command line like this:

sed -i 's/OLD/NEW/g'  

This will replace every instance of the string OLD with the string new in the file path/to/file.  Be careful: this will replace EVERY instance of OLD.  If OLD matches things you don't want, they will be replaced as well.

This construction is actually "regular expressions", so if you want to get fancy you can match against more complicated strings.  But just be careful.

If you leave out the "-i" the string-replaced text will go to stdout, instead of being replaced in the file "in place", so you can check it first.

query replace in emacs

If you want more fine-grained control of text replace, so that you can see what's being replaced, try using "query-replace" in emacs:

M-x query-replace

You can then type in the original string, followed by the replacement string.  When it starts to run it will highlight the string that will be replaced.  Hit "space" to accept or "n" to skip and go to the next.

 

 

  9089   Fri Aug 30 01:01:28 2013 rana, nicSummaryComputer Scripts / ProgramsaLIGO Noise Budget code installed and running

Chris Wipf has been developing a new Noise Budget code that allows us to use our existing Simulink models to handle all of the noise transfer functions. This is mainly by being clever about avoiding the numerical pitfalls that we encounter when doing linearization of Simulink models (e.g. linmod or linmod2).

Screen_Shot_2013-08-30_at_1.00.02_AM.png

In this model, the optical plant is done with analytic TFs using the formulae from the Sigg Frequency Response doc. The big Orange block has just the DAC and some simple pendulum TFs. The upper section contains the simulated digital system: input matrix, digital filter TFs, and output matrix. The digital filters are just based on my memory of iLIGO. The CARM path is made to be fast to approximate the high gain of the Common Mode servo. Without this high gain the PRC optical plant is unstable due to the right half plane zeros. This simple model is used just so that we could see the NB work on a multi-loop system. For the next steps of getting it to work for the 40m, we will use the Optickle TFs instead of analytic functions and also load the digital filters directly from the FOTON files. For the LLO DRMI, we'll add some simplified version of the SUS Simulink models for triples and quads.

 

Yesterday, Nic and I took my old iLIGO IFOmodel.mdl Simulink model and added the new NB hooks that allowed us to use the new code. The screenshot below is from a run of this code:

1) Figure 1 shows the DARM Noise budget. So far we have included shot noise in DARM, CARM, MICH, & PRC. Radiation pressure noise on the ITMs and ETMs. Coating thermal noise on all mirrors.

2) Figure 2 shows the breakdown of how each of the shot noises at each port couple to the DARM readout. The RED trace is the AS port DC readout shot noise. The GREEN trace is the MICH shot noise feeding through the MICH loop and being mostly cancelled by the scalar MICHdamp feedforward path.

3) Figure 3 shows that we've set the coating thermal noise to be equal on all 4 TMs.

4) Figure 78754 is a set of Bode plots of the open loop gains of the 4 LSC loops (inferred from the closed loop TF). Also plotted is the residual MICH2DARM TF (with the MICHdamp cancellation path ON).

5) Figure 9911123 are the step responses of the LSC loops: step inserted at the error point and response measured just after the excitation point.

The editor window on the left shows how simple the NB code is to use once the Simulink model has had all the hooks added to it.

Attachment 1: NBplots.png
NBplots.png
  9090   Fri Aug 30 08:08:29 2013 steveUpdatesafetyfire horns-flashers tested OK

 

 We had fire alarm tests  and evacuation drills at 1:30pm yesterday. All flashers and horns are functioning unbearably loud and bright including clean assembly room.

  9091   Fri Aug 30 11:00:46 2013 ManasaUpdateGeneralSeries of earthquakes

There has been a series of earthquakes since the big 7.0 in Alaska this morning.

None of the watchdogs were tripped when I came in. But I could not retrieve any info about the suspensions from fast channels because c1sus was not talking to the fb and that required an mxstream restart to fix it.

MC is trying to lock itself, but the seismic doesn't seem to get quiet. So MC is not all that happy.

 Screenshot-Earthquakes_-_Mozilla_Firefox.png

SUSnSEIS.png

  9092   Fri Aug 30 14:31:57 2013 SteveUpdateGeneralcleaning up

I cleaned up around MC2 and 1Y1 area this morning.

ETMY NPRO moved from the side to the center of the low shelf. Thorlab catalog " as spacer " removed after lunch.

The Lightwave Controller values: LT 40.4C,  LTEC +0.1V,  T 41.041C,  Pwr 239 mW,  Adj 0,  DC 1.82A,  DPM  0.0V,  Neon OFF,  Ldon OFF,  Display 5,  DT 21.0C,  Dtec +1.0V

 

Attachment 1: MC2areaCP.jpg
MC2areaCP.jpg
Attachment 2: 1Y1areaCleanedUp.jpg
1Y1areaCleanedUp.jpg
Attachment 3: ETMY_NPROmoved.jpg
ETMY_NPROmoved.jpg
  9093   Mon Sep 2 03:51:14 2013 ranaHowToGeneralHow To Coil Cables

 http://youtu.be/pEd7ru24Vx0

  9094   Mon Sep 2 15:22:57 2013 JenneUpdatePSLPMC relocked

 The PMC was locked on an LG 10 mode (or something like it), for at least the last 8 hours.  I relocked it on the regular 00 mode, and it's fine now.  

Also, in CDS news, I did an mxstream restart (the RCG upgrade is supposed to make this not an issue anymore...), and did a "diag reset" afterwards, and all of the IPC errors except for one in the LSC model have gone away (OAF is still not running....on my to-do list, but not super high priority).

  9095   Mon Sep 2 16:46:32 2013 JenneUpdateElectronicsRF distribution box is on the bench

I have pulled the RF distribution box out of the rack, so I can look at it, and modify it to have 2 110 MHz spigots. I'm going to make the mods as in elog 9072.

Before I pulled the distribution box, I turned off the RF Generation Box, so don't be surprised that the MC will not lock.  I have terminated the cables that bring the 11 and 55 MHz signals from the generation box to the distribution box, so if someone does turn on the generation box, there won't be bad reflections.

To get the box out, in addition to unplugging all of the cables that go to the distribution box, I had to disconnect 2 of the ADC ribbon cables from the top row of RFPD demod / whitening / ADC boards, since they were in the way.  Everything is labeled, so it should be easy to put back together.

Note to Future Jenne:  Past Jenne put the screws needed for those ADC cables and to hold the box in the rack, in the plastic box that is on the floor in front of the LSC rack. 

Also, I measured the 110 MHz port before I pulled the board, so I would know what my "before" looked like.  I was using the 300MHz 'scope's measurement functions, so these are in volts, not dBm.  Amplitude = 1.33V, RMS = 456 mV, freq = 109.4-111.9 MHz

  9096   Mon Sep 2 18:06:21 2013 JenneUpdateElectronicsRF distribution box: 110 MHz LO options

After scrounging for parts, and opening up the box, I have modified my proposal to the following:

RF_distribution_box_proposed_modifications.pdf

Note that the freq multiplier is supposed to take, at maximum, 15 dBm.  The reason I put the 5 dB attenuator, then an amplifier, then another attenuator is that I don't know of / can't find easily a 10 dB amplifier with the usual case type on the MiniCircuits site.  (If anyone knows of one off the top of their head, that would be handy.  Then I'd remove the attenuator between the multiplier and the amplifier, and make the 10 dB attenuator a 5 dB.)

Anyhow, the ZFL-500HLN can only output 16 dBm of power, and I don't think I have space for another ZHL-2 (which can output up to 26 dBm) inside the box, so I put an attenuator before, as well as after, the amplifier. 

I think I have space inside the box for all the bits and pieces I'll need, although to do things correctly, I need to drill holes in the teflon mounting plate to mount the amplifier and splitter.

0902131751.jpg

I also think that I have space on the front panel to put another isolated SMA feedthrough.

0902131751a.jpg

I have, on my desk, all the parts (except for mounting screws, and cables between things) to make these modifications to the distribution box. 

  9097   Tue Sep 3 10:54:33 2013 SteveHowToGeneralHow To Coil Cables

Quote:

 http://youtu.be/pEd7ru24Vx0

 B grade Nobel is awarded.

                                  If cables could dream?

This skill should be  mandatory for LIGOX graduates.

  9098   Tue Sep 3 14:23:21 2013 SteveUpdatePEM earthquakes

 ~Vancuver, Canada earthquakes: magnitude 6,  5  and more shaking

 

Attachment 1: EQm6&5.png
EQm6&5.png
  9099   Tue Sep 3 21:08:13 2013 JenneUpdateElectronicsRF distribution box: 110 MHz LO options

The RF distribution box is still on the bench, so again, don't be surprised that the MC doesn't lock.

I have completed my modifications as proposed in elog 9096, but I want to do a couple of quickie tests in the morning before I declare it ready for service.

  9100   Tue Sep 3 21:10:36 2013 JenneConfigurationElectronicsputting together a 110 MHz LSC demod board for AS

Quote:

 

 I should actually stick in the SXBP-100's, which will band pass from 87-117 MHz.

 I have removed the 135 MHz low pass from my new AS110 demod board, but these SXBPs have different feet than the SCLFs, so I want to confirm with Koji or someone that I can solder them in the same way, before I get carried away and destroy anything.  I should be able to finish this up tomorrow, plug in the demod board and the distribution box, and try out AS110 triggering, etc, tomorrow night.

  9101   Wed Sep 4 16:06:40 2013 JenneUpdateElectronicsRF distribution box: Reinstalled

I have reinstalled the RF distribution box, as well put in the AS110 demod board.  I plugged everything back in, and turned it all on.

The switch on the distribution box may be starting to fail.  When I was turning the box on, I could depress the button, and see the blue glow, but it wouldn't catch, so when I removed my finger, the glow went away.  I was afraid that I'd have to pull the box, but after a few more button toggles, I got it to stay on.  I'm leaving it for now, but we should remember that this may be a problem.

I will look at the phases of all the PDs, but none should need changing except POP 110.  Every other PD has the exact same cables as before.

ELOG V3.1.3-