EQ  M4.3 @longbeach
2021-09-18 02:58:34 (UTC) / 07:58:34 (PDT)
https://earthquake.usgs.gov/earthquakes/eventpage/ci39812319/executive

• All SUS Watchdogs tripped, but the SUSs looked OK except for the stuck ITMX.
• Damped the SUSs (except ITMX)
• IMC automatically locked
• Turned off the damping of ITMX and shook it only with the pitch bias -> Easily unstuck -> damping recovered -> realignment of the ITMX probably necessary.
• Done.

  It looks like we may lost 1 (or 3 )  magnets? Do not panic, it's not for sure

After shaking ITMX by the alignment bias in yaw, it came back.

As ETMX seems to be largely misaligned yaw (and did not come back with the alignment impact),
the condition of the magnets are not clear. Only the side OSEM is responding nicely.

I tried to take some photos through the window of ETMX's chamber, to see if I could see any magnets.  What we have learned is that Jenne is still not the world's best photographer.  I was holding the camera at ~max zoom inside the beam tube between the table and the window, so that's my excuse for the photos being fuzzy.  The only thing that I can really conclude is that the magnets look like they are still there, but Jamie thinks they may be stuck on the PDs/LEDs (now looking at the photos myself, I agree, especially with UL and LR). 

It looks like the best thing to do at this point, since Koji already tried jerking ETMX around in yaw a little bit, is just wait and open the door, to see what's going on in there.  I posted the photos on Picasa:

https://picasaweb.google.com/foteee/ETMX_MaybeStuck_ThroughWindow_27Aug2012

I propose that, if the magnets are broken, we pull the ETM out of the camber and fix it up in the cleanroom while we pump back down.  This would restrict us from doing any Xarm work, but will force me to focus on DRMI, and we can put the ETM back when we vent to install the tip tilts.

There was a EQ in Ridgecrest (approximately 200 km north of Caltech). It was around 6:20 PM local time.

All the suspensions tripped. I have recovered them (after some struggle with the weird profusion of multiple conflicting scripts/ directories that have appeared in the recent past...)

ETMY is still giving me some trouble. Maybe because of the HUGE bias on that within the fast CDS system, it had some trouble damping. Also the 'reenable watchdog' script in one of the many scripts directories seems to do a bad job. It re-enables optics, btu doesn't make sure that the beams are on the optical lever QPD, and so the OL servo can smash the optic around. This is not good.

Also what's up with the bashrc.d/ in some workstations and not others? Was there something wrong with the .bashrc files we had for the past 15 years? I will revert them unless someone puts in an elog with some justification for this "upgrade".

This new SUS screen is coming along well, but some of the fields are white. Are they omitted or is there something non-functional in the CDS? Also, the PD variances should not be in the line between the servo outputs and the coil. It may mislead people into thinking that the variances are of the coils. Instead, they should be placed elsewhere as we had it in the old screens.

This earthquake tripped all suspensions and ITMX got stuck. The watchdogs were restored and the stuck optic was released. The IFO was re-aligned, POX/POY and PRMI on carrier locking all work okay.

An earthquake around 330 UTC (=730pm yesterday eve) tripped ITMX, ITMY and ETMX watchdogs. ITMX got stuck. I released the stuck optic and re-enabled the local damping loops just now.

Sus damping restored.

No damage. ITMY is glitching, so it has not been damped.

Summary:

In continuation to the previous test conducted on the ET-3040 PD,  I performed a similar test on the ET-3010 model. This model requires a fiber couple input for proper testing, but I tested it in free space without a fiber couple as the laser power was only 1.00 mW and there was not much danger of scattering of the laser beam. The Data Sheet can be found here

Procedure:

The schematic(attached below) and the procedure are the same as the previous time. The pump current was set to 19.5 mA giving us a laser beam of power 1.00mW at the fiber couple output. The measured voltage for the reference detector was 1.8V. For the DUT, the voltage is amplified using a low noise amplifier(model SR-560) with a gain of 100. Without any laser incidence on the DUT, the multimeter reads 120.6 mV. After alligning the laser with the DUT, the multimeter reads 348.5 mV, i.e. the voltage for the DUT is 227.9/100 ~ 2.28 mV. The DC transimpedance of the reference detector is 10kOhm and its responsivity to 1064 nm is around 0.75 A/W. Using this we calculate the power at the reference detector to be 0.24 mW. The DC transimpedance for the DUT is 50Ohm and the responsivity is around 0.85 A/W. Using this we calculate the power at the DUT to be 0.054 mW. After this we connect the the laser input to the Netwrok Analyzer(AG4395A) and give an RF signal with -10dBm and frequency modulation from 100 kHz to 500 MHz.The RF output from the Analyzer is coupled to the Reference Channel(CHR) of the analyzer via a 20dB directional coupler. The AC output of the reference detector is given at Channel A(CHA) and the output from the DUT is given to Channel B(CHB). We got plots of the ratios between the reference detector, DUT and the coupled refernce for the Transfer Function and the Phase. I stored the data under the directory.../scripts/general/netgpibdata/data. The Bode Plot has been attached below and seeing it we observe that the cut-off frequency for the ET-3010 model is atleast over 500 MHz(stated as >1.5 GHz in the data sheet).

Result:

The bandwidth of the ET-3010 PD is atleast 500MHz, stated in the data sheet as >1.5GHz.

Precaution:

The ET-3010 PD has an internal power supply of 6V. Don't leave the PD connected to any instrument after the experimentation is done or else the batteries will get drained if there is any photocurrent on the PDs.

To Do:

Caliberate the vertical axis in the Bode Plot with transimpedance(Ohms) for the two PDs. Automate the procedure by making a Python script for taking multiple set of readings from the Netwrok Analyzer and aslo plot the error bands.

This plot shows the Transmission for 532 and 1064 nm as a function of the thickness of the SiO2 layer.

i.e. the thickness is constrained so that the optical thickness of the SiO2 and Ta2O5 pair is always 1/2 of a wavelength.

The top layer of the mirror is also fixed in this plot to be 1/2 wave.

This plot shows the result for 17 pairs. For 16 pairs, we are unable to get as low as 15 ppm for the 1064 nm transmission.

This is a plot of the R and T of the existing ETM's HR coating. I have only used 1/4 wave layers (in addition to the standard 1/2 wave SiO2 cap on the top) to get the required T.

The spec is a T = 15 ppm +/- 5 ppm. The calculation gives 8 ppm which is close enough. The calculated reflectivity for 532 nm is 3%. If the ITM reflectivity is similar, the signal for the 532 nm locking of the arm would look like a Michelson using the existing optics.

 We used to do violin mode and test mass body mode notches in the SUS-LSC filter modules. Now we want them balanced in the LSC and triggered by the LSC, so they're in the filter modules which go from the the LSC output matrix to the SUS.

Today, we were getting ETM violin mode ringups while doing ALS hunt and so we moved the bandstops into the LSC. I also changed the bandstop from a wide one which missed the ETMX mode to a double bandstop which gets both the ETMX and the ETMY mode. See attached image of the Bode mag.

I have modified/compiled/installed/restarted c1scx and c1scy models to include arm transmission QPDs in angular controls.

For initial test I have wired normalized QPD pitch and yaw outputs to ASC input of ETMs. This was done to keep the signals inside the model.

QPD signals are summed with ASS dither lines and control. So do not forget to turn off QPD output before turning on dither alignment.

Medm screens were made and put to medm/c1sc{x,y}/master directory. Access from sitemap is QPDs -> ETM{ X,Y} QPD

Attached is a photo of the set up of the ETM Y table showing the AUX read out set up. 

Currently, the flip mount sends the AUX to the PDA255. Terra inserted a razor blade so the PDA255 will witness more HOMs. The laser is also sent to the regular PD and the CCD.

[Jenne, Suresh]

Selection of ETMs

Of the four ETMs (5,6,7 and 8) that are with us Koji gave us two (nos. 5 and 7) for use in the current assembly.  This decision is based on the Radius of Curvature (RoC) measurements from the manufacturer (Advanced Thin Films).   As per their measurements the four ETMs are divided into two pairs such that each pair has nearly equal RoC. In the current case, RoCs are listed below:

The discrepancy between the measurements from these two companies leaves us in some doubt as to the actual radius of curvature.  However we based our current decision on the measurement of Advanced Thin Films. 

Assembly of ETMs

We drag wiped both the ETMs (5 and 7) and placed them in the Small Optic Gluing Fixture.  The optics are positioned with the High Reflectace side facing downwards and with the arrow-mark on the Wire Standoff side (big clamp).  We then used the microscope to position the Guide Rod and the Wire Standoff in the tangential direction on the ETMs (step 4 of the procedure specified in E010171-00-D)

We will continue with the rest of the assembly tomorrow.

I have fixed the binary whitening switching for the ETMs (ETMX and ETMY).  See below for a description of what some of the issues were.

The ETMX whitening/no-whitening response (same measurements performed in my previous post on checking vertex sus whitening switching) looks as it should.  The ETMY response seems to indicate that the switching is happening, but the measurements are very noise.  I had to up the averaging significantly to get anything sensible.  There's something else going on with ETMY.  I'll follow up on that in another post.

response

ETMX
ul : 3.28258088774 = 10.3243087313 db
ll : 3.31203559803 = 10.4018999194 db
sd : 3.27932572306 = 10.3156911129 db
lr : 3.28189942386 = 10.3225053532 db
ur : 3.31351020008 = 10.4057662366 db

ETMY
ul : 2.9802607099  =  9.4850851468 db
ll : 1.46693103911 =  3.3281939600 db
sd : 2.19178266285 =  6.8159497462 db
lr : 2.2716636118  =  7.1268804285 db
ur : 3.42348315519 = 10.6893639064 db

End rack cable diagrams inconsistent with binary channel mapping

One of the big problems was that the most up-to-date end rack cable diagrams (that I can find) are inconsistent with the actual binary mapping. The diagram says that:

• BO adapter chassis output A (ch 1-16)   --> CAB_1X4_26 --> cross-connect 1X4-B7 (carrying QPD whitening switching signals)
• BO adapter chassis output B (ch 17-32) --> CAB_1X4_27 --> cross-connect 1X4-A6 (carrying OSEM whitening switching signals)

In fact, the binary outputs are switched, such that output A carries the OSEM signals, and output B carries the QPD whitening signals.

I SWITCHED THE CABLES AT THE BINARY OUTPUT ADAPTER CHASSIS so that:

• BO adapter chassis output A (ch 1-16)   --> CAB_1X4_27 --> cross-connect 1X4-A6 (carrying OSEM whitening switching signals)
• BO adapter chassis output B (ch 17-32) --> CAB_1X4_26 --> cross-connect 1X4-B7 (carrying QPD whitening switching signals)

The rest of the wiring remains the same.

I made the same transformation for ETMY as well.

To facilitate this investigation, I've DQed the 4 face coil outputs for the two ETMs. EX is currently running with 5 times the series resistance of EY, so it'll be a nice consistency check. Compilation, installation etc went smooth. But when restarting the c1scx model, there was a weird issue - the foton file, C1SCX.txt, got completely wiped (all filter coefficients were empty, even though the filter module names themselves existed). I just copied the chiara backup version, restarted the model, and all was well again.

This corresponds to 8 additional channels, recorded at 16k as float 32 numbers, so in the worst case (neglecting any clever compression algorithms), we are using disk space at a rate of ~4 MB/s more. Seems okay, but anyway, I will remove these DQ channels in a few days, once we're happy we have enough info to inform the coil driver design.

spoke too soon - there was an RFM error for the TRX channel, and restarting that model on c1sus took down all the vertex FEs. Anyways, now, things are back to normal I think. The remaining red light in c1lsc is from the DNN model not running - I forgot to remove those channels, this would've been a good chance! Anyways, given that there is an MLTI in construction, I'm removing these channels from the c1lsc model, so the next time we restart, the changes will be propagated.

For whatever reason, my usual locking scripts aren't able to get me to the PRFPMI locked state - some EPICS channel value must not have been set correctly after the model reboot 😞. I'll debug in the coming days.

Fun times lie ahead for getting the new BHD FEs installed I guess 🤡 ....

This plot shows ETM oplev and OSEM trend for 10 hours on day before yesterday as almost the same as plot shown this entry. I reported the 10-30minites fluctuations were seen, but I noticed it comes from not suspension but from oplev power fluctuation.

After Kiwamu fixed the ETM OSEM touch yesterday afternoon, still the same trend was seen, so we had thought what we fixed was not enough. This morning I looked at the yesterday's and day before yesterday's trend and noticed the simila trend both the pit and yaw in ETM oplev but not on the OSEM trend. Kiwamu suggested me to put the oplev sum on the same plot. It was!

So, ETMX is not bad, but in fact, still alignment fluctuation exist on the cavity. ITM?

Summary

When PRMI + 2arms are locked yesterday, we heard the noise from suspension violin mode. For attenuation of that noise, we should design the resonant filter at that frequency and put into the ALS servo. I tried to measure the violin mode of ETMs SUS.

What I did

 1.The arms were locked by IR PDH. I used awggui to excite the suspention. I injected the Normal waveform, 10 Hz of bandwidth wave into C1:SUS-ETMs_ULCOIL_EXC. I put cheby filter in the FIlter of awggui. The order of that filter was 4, that has same bandwidth as that of injection wave and ripple was 4dB. I increase the injection gain with some ramp time(5sec). I swept from 600 Hz to 700 Hz. During that injection I saw the PDH error signal (POX11I and POY11I) in order to find resonance peak of violin mode.
 In ETMX resonances were easily found. That were at 631 Hz and 691 Hz. the 631 Hz peak was seen ALS error signal yesterday. On the other hand, I couldn't find ETMY violin mode. No peaks appeared any frequency.

2. For find the ETMY violin mode, I used dtt swept sine measurement. The excitation channel was C1:SUS-ETMs_ULCOIL_EXC. I measured the TF from excitation channel to POX11I and POY11I error signal. The measurement range was above 400 Hz and below 1000Hz,. The number of point is 600. I attached that result.
In ETMX curve, the coherence become bad near the resonant frequency of violin mode and also the TF is large. Although ETMX violin modes are obvious, ETMY violin modes are not visible. At 660 Hz, 780 Hz, 900 Hz the coherence is not good. That is because 60 Hz comb noise.

Discussion

 I attached the spectrum of the POX and POY error signal. Black and red curve is measured different time. I didn't inject any signal in both measurement, but the violin mode excitation has huge difference. Also there are peaks at beat frequency between violin mode and bounce mode(16 Hz), yaw motion(3 Hz). In ALS in-loop noise or XARM in-loop measurement, sometimes this region had big spikes. That was because of this resonance. And also that resonance peak couples to POY11I.

 I will measure the Q and design the resonant filter for ALS.

[Suresh, Jenne]

ETMU05 : Gluing Side magnets back on to the optic.

The following steps taken in this process:

1) The two magnet+dumbell units which had come loose from the optic needed to be cleaned.  A lint free wipe was placed on the table top and a few cc of acetone was poured on to it.  The free end of the dumbbell was then scrubbed on this wipe till the surface regained its shine.  The dumbell was held at its narrow part with a forceps to avoid any strain on the magnet-dumbbell joint.

2) The optic was then removed from its gluing fixture (by loosening only one of the three retaining screws) and placed in an Al ring. The glue left behind by the side magnets was scrubbed off with a optical tissue wetted with Acetone. 

3) The optic was returned to the gluing fixture.  The position of the optic was checked by inserting the brass portion of the gripper and making sure that the face magnets are centered in it [Jenne doubled checked to be sure we got everything right].

4) The side magnets were glued on and the optic in the fixture has been placed in the foil-house.

If all goes well we will be able to balance the ETMU05 and give it to Bob for baking.

ETMU07 : It is still in the oven and we need to ask Bob to take out. It will be available for installation in the 40m tomorrow.  

The ETMU05 has been removed from the suspension and put into the little foil house. 

Before removing it I checked the position and pitch of the optic with reference to the table top. 

The height:

     Using the traveling microscope I checked the height of the scribe lines from the table top.  They are at equal heights, centered on 5.5 inches, correct to about a quarter of the width of the scribe line.

The pitch

    The retro-reflection of the He-Ne laser beam is correct to within one diameter of the beam at a distance of about 1.5m.  This is the reflection from the rear, AR coated, surface.  The reflection from the front, HR coated, surface was down by about two diameters.

Jenne has checked with Bob and agreed on a date for baking the optic.

[Suresh, Jenne]

We Finished!!!

ETMU05 (ETMY) had its wire winched to the correct height, was balanced, and had the standoff glued.  Since it's kind of like final exam week at Caltech, Suresh had his suspension exam today, and did most of this work himself, with me hanging around and watching. 

As you can see in my almost entirely green table, all that is left to do with the whole suspensions project is bake the optic (hopefully Bob has time / space this week), and then stick it in the chamber!  Hooray!!! (Can you tell I'm excited to not spend too much more time in the cleanroom?)

The table:

[Jenne, Suresh]

Suresh and I glued the intact-from-the-first-round magnets to ETMU05.  I accidentally got too much glue on one of the dumbbells (the glue was connecting the dumbbell to the gripper - bad news if we let that dry), and while I was cleaning it, the magnet broke off.  So I used one of the ones that Suresh had re-glued last night, and he is putting that one back together after some cleaning. 

To set the fixture, Suresh had the great idea of using small pieces of foil underneath the teflon pads to set the height of the optic in the fixture.  The optic still rests on the teflon pads, but with the foil we have finer control over how the optic sits.  Neat.  Since both ETMs are the same, we shouldn't have to do any more adjustment for the other ETM.

The updated Status Table:

[Jenne, Koji]

We removed ETMU07 from the suspension tower, after confirming that the balance was still good.  Bob put it in the oven to bake over the weekend.  The spring plungers and our spare magnets are all in there as well. 

I tried to remove the grippers from ETMU05, and when I did, both side dumbbells came off of the optic.  Unfortunately, I was working on getting channels into the DAQ, so I did not clean and reglue ETMU05 today.  However Joe told me that we don't have any ETMY controls as yet, and we're not going to do Yarm locking (probably) in the next week or so, so this doesn't really set any schedules back. 

The cleaning of ETMU05 will be tricky.  Getting the residual glue off of the optic will be fine, but for the dumbbells, we'd like to clean the glue off of the end of the dumbbells using a lint free wipe soaked in acetone, but we don't want to get any acetone in the magnet-to-dumbbell joint, and we don't want to break the magnet-to-dumbbell joint.  So we'll have to be very careful when doing this cleaning. 

The Status Table:

[Koji, Jenne]

ETMU07 had its wire winched to the correct height, was balanced, standoff glued.  Can be ready for going into the oven tomorrow, if an oven is available.  (One of Bob's ovens has a leak, so he's down an oven, which puts everything behind schedule.  We may not be able to get anything into the oven until Monday).

ETMU05 had magnets glued to the optic.  Hopefully tomorrow we will winch the wire and balance the optic, and glue the standoff, and be ready to go into the oven on Monday.

The spring plungers were sonicated, but have not yet been baked.  I told Daphen that we'd like the optics baked first, so that we can get ETMX in the chamber ASAP, and then the spring plungers as soon as possible so that we can install ETMY and put the OSEMs in.

The updated status table:

[Suresh, Jenne]

A story about minor disasters, and crises averted:

Once upon a time, in a cleanroom not so far away..... there lived an optic.  To preserve anonymity, we shall call him "ETMU05".  This optic had a rough day.  When removing the grippers from the magnet-to-optic fixture, 4 out of 6 magnets broke off the dumbbells (the dumbbells were still securely glued to the optic...these had come out of the same batch that had problems last week, same problem).  The remaining 2, LL and LR, were sadly of the same polarity.  This is bad, because it means that the "humans" taking care of "ETMU05" didn't check the polarity of the face magnets properly, and ensure that they were laid out in an every-other pattern (LL and UR having the same polarity, and LR and UL having the opposite).  So, the humans removed all magnets and dumbbells from ETMU05.  All remaining glue was carefully scrubbed off the surfaces of ETMU05 using lens paper and acetone, and the magnets and dumbbells were sonicated in acetone, scrubbed with a lint-free wipe, sonicated again, and then scrubbed again to remove the glue.  ETMU05 had a nice cleansing, and was drag wiped on both the AR and HR surfaces with acetone and iso.  ETMU05 is now on vacation in a nice little foil hut.

His friend, (let's call him ETMU07) had a set of magnets (with polarities carefully confirmed) glued to him.  The cleaned magnets and dumbbells removed from ETMU05 were reglued to their dumbbells, and should be dry by tomorrow. 

.....And then they lived happily ever after.  The End.

The revised schedule / status table:

We have done some work at ETMX today. We installed the baffle and placed two mirrors on the table.

The baffle position/orientation still needs to be checked more thoroughly to make sure that the beam will pass through the center of the baffle hole.

One of the two mirrors will stay on the table as pickoff. The other is only temporarily installed for alignment purposes. Later today we will shoot a laser into the chamber that will reflect off one of these mirrors towards the center of ITMX, then go back to the pickoff mirror next to ETMX and hopefully make it through the viewport.

To place the pickoff mirror, we had to move the "cable rack" next to ETMX a few inches towards the back of the table.

I must say that I am not at all happy with the baffle situation.  It is currently completely blocking our camera view of the ETMX face.  Here's a video capture of the ETMX face camera:

The circle is the baffle hole, through which we can see just the bottom edge of the test mass.  I don't think whatever benefit the baffle gives out weights the benefit of being able to see the spot on the mirror.

This afternoon we will try to adjust the baffle, and maybe the camera view mirror, to see if we can get a better shot of the center of the TM.  If we can see the beam spot through the hole we can probably live with it.  If not, I think we should remove the baffle.

The baffle has been moved away from ETMX towards the edge of the table (in fact, it is a little beyond the edge). It is also rotated so that its long edge is horizontal. In this way it was possible to center the baffle hole with respect to the optical axis, but also make it possible that the camera looks over the baffle.

We have tried to get an alignment beam from view port -> ETMX pick-off ->ITMX-> back to EX. This work was pretty much unsuccessful though. We could see the green laser scattering around ITMX, but there was no good way to know when the beam hit ITMX. So tomorrow we will find a better way to check where the beam is hitting at ITMX and finish the alignment of the scattering pick-off mirror.

Time domain control using LQR technique is now applied to ETMX sus position. The plan was to do it for oplevs, I'll do it after the vent.

The cost function for state space variables was determined by TF  900 / (s + 30)^2. There was no penulty imposed for velocity, only for position. We can try that configuration as well.

The temperature of the east and south ends  are normal, they are about the same.

Our janitor dropped one 48" long  fluorescent tube on the top cover of ETMX-isct. This accident made glasses fly all over the place.

He cleaned up nicely, but please beware of small glass pieces around ETMX chamber.

We did not clean up on the table in order to reserve oplev and green ITMX pointing alignment.

Plot below shows that the alignment was not effected.

I looked at what are the situations that make ETMX lose alignment.

This is not occur all that often this morning; less than 10 times in may be the last 4 hours of poking the X arm. I found that the bad behavior of ETMX also exists in certain other cases apart from the case when we enable LSC.

(I) Even the MISALIGN and RESTORE scripts for the suspensions make the suspension behave bad. The RESTORE script while in the process of  bringing back the suspension to the place where it was, kicks it to some place else sometimes (even with LSC disabled)

(II) The suspension also gets kicked while realigning ETMX manually using sliders at 10^-3 (pace of 2-3 steps at a time).

I am suspecting something wrong right at the coil inputs and gains of the suspension.

Also, I recollect that  we haven't done a check on the X arm LSC limiters and filters ramping times like it was done for the Y arm ( Elog 9877 ). We should do this check to be sure that we are not seeing a mixed puddle of problems from 2 sources.

The ETMX  Sorrenson power supply -15V was running at -13.9V

 Jenne and Steve

Sony CCD in place needs alignment and ND filter

[Jenne, Yuta]

We made ETMXT camera working.
We connected the camera to video mux, placed 10% pick off mirror in front of TRX PD, lead the beam go to ETMXT camera.
Transmission to the TRY PD was 23.8 uW, but now, it's 21.3 uW (2.3 uW goes to the camera).
So, we changed C1:LSC-TRX_GAIN from -0.00181818 to -0.00203158 (=-0.00181818*23.8/21.3).

There is a channel for power normalization, C1:LSC-TRX_POW_NORM, but is 1 and it looks like we are using this gain for the normalization. Situation of TRY is the same as TRX.

Here's the new end table layout, for the transmitted IR stuff.

We looked at the spectra of POX and POY during IR lock, and Q saw a peak at 1285 in POX only.  We're actuating on the ETMs, so it must be an ETMX violin mode, although it doesn't match the others that are in the table.

Anyhow, I added it to FM9.  While I was doing that, I realized that yesterday I had forgotten to put back the 3rd order ETM violin notch, so that is also in FM9.

I modified the Binary Input DB9 connector. The coil drivers are now operating with the Run/Acq LED off. As per 17656 they should have a flat TF now.

{Mayank, Yehonathan}

In order for the ETMX watchdog to keep working while we take the Acromag chassie out we are going to replace the PD_MONs in the variance calculation channels with fast OSEM PD channels/

We made a backup to the c1auxex db file called ETMXauxbak.db in the c1auxex folder.

Now, we are struggling with adding channels to the db file. Once we figure this out we will try to read the fast SENS_IN1 channels.

In the meanwhile this is a broadview (and maybe naive) plan for the coil driver upgrade:

-1. Take out 2 new coil drivers and replace their output resistance with appropriate resistors (What should they be?)

0. Test the new coil driver on the bench.

1. Once a temporary fast-channel-based watchdog is setup and tested, Acromag chassie is taken out to the EE bench.

2. Replace the old DB37 feedthroughs with DB9s according to the ETMY plan. Check if there are extra channels that exist in c1auxex but not in c1auxey that need to be preserved.

3. Wire the acromag units to the DB9s. Add optical isolators and wire the EnableMon and Enable fast channels through them.

4. Change the powering of the Acromag chassie so that we can operate it with a single Sorensen.

5. Add 5 EnableMon channels. We will probably need anothe BIO Acromag as there is only 1 in current chassie according to the old wiring table.

5. Bench-test the Acromag chassie channels.

6. Add 5 new EnableMon channels to the db file.

7. Install Acromag chassie, coil drivers, SatAmps and HV drivers and the connect labeled db9 cables between them.

8. Test the new coil drivers online.

Anything else?

Thanks. This makes the plan clear.

- Please follow the attached rack plan for 1X9

- The immediate aim is the recovery of the suspension operation without acromag. Focus on it for now, and then move on to the Acromag modification.

-----

> Take out 2 new coil drivers and replace their output resistance with appropriate resistors (What should they be?)

We are supposed to have the coil drivers with the output Rs already replaced. But it is a great idea to check if they are really done or not.

> Test the new coil driver on the bench.

I hope this is not necessary, as the coil drivers / sat amps were already tested before...

> Change the powering of the Acromag chassis so that we can operate it with a single Sorensen.

Good idea. If we ended up having an unnecessary Sorensen, we can remove it and add it to the stock.

I've been observing this for a few days: ETMX's DC alignment seems to drift by so much that the previously well aligned X arm cavity is now totally misaligned.

The wall StripTool trace shows that both the X and Y arms were locked with arm transmissions around 1 till c1psl conked out - so in the attached plot, around 1400 UTC, the arm cavity was well aligned. So the sudden jump in the OSEM sensor signals is the time at which LSC control to the ETM was triggered OFF. But as seen in the attached plot, after the lockloss, the Oplev signals seem to show that the mirror alignment drifted by >50urad. This level of drift isn't consistent with the OSEM sensor signals - of course, the Oplev calibration could be off, but the tension in values is almost an order of magnitude. The misalignment seems real - the other Oplev spots have stuck around near the (0,0) points where I recentered them last night, only ETMX seems to have undergone misalignment.

Need to think about what's happening here. Note that this kind of "drift" behaviour seems to be distinct from the infamous ETMX "glitching" problem that was supposed to have been fixed in the 2016 vent.

I should've put in the SUSPIT and SUSYAW channels in the previous screenshot. I re-aligned ETMX till I could see IR flashes in the arm, and also was able to lock the green beam on a TEM00 mode with reasonable transmission. As I suspected, this brought the Oplev spot back near the center of it's QPD. But the answer to the question "How much did I move the ETM by" still varies by ~1 order of magnitude, depending on if you believe the OSEM SUSPIT and SUSYAW signals, or the Oplev error signals - I don't know which, if any, of these, are calibrated.

Best to just calibrate the ETM OL in the usual way. I bet the OSEM outputs have a cal uncertainty of ~50% since the input matrix changes as a function of the DC alignment. Still, a 30 urad pitch mis-alignment gives a (30e-6 rad)(40 m) ~ 1 mm beam spot shift. This would be enough to flash other modes, but it would still be easy to lock on a TEM00 like this. I also doubt that the OL calibration is valid outside of some region near zero - can easily check by moving the ETM bias sliders.

What we still don't know is if this is due to Johannes/Aaron working at the ETMX rack (bumping some of the flaky coil cables and/or bumping the blue beams which support the stack). Adding or substracting weight from the stack supports will give us an ETM mis alignment.

BLUE:   Output of filter bank during an FM9 turn off. This is the transient which goes to the DAC.
        The transients are mostly of the same magnitude as this.
RED:    This is the input of the filter module during another such transient.
GREEN:  Tried another switch; this time I filtered the time series in DTT by typing the SimDW into
        the Triggered Time Series filter field. This should be simulating what comes out of the
        output of the DW board - to convert to volts multiply by 15/32768.
PURPLE: Same kind of filtering as the GREEN, but with also a double 30 Hz highpass to remove the low
        frequency damping control signals. You can see that the total transient is only ~5 counts
        or ~1 mV at the coil driver output. This is comparable to the relative offset in the bypass
        and filter paths.

[Sasha, Masha, Liz, Eric]

A bunch of surfs in the lab just noticed that ETMX is going crazy (laser is shifting everywhere) due to a 4.5 EQ that just hit LA. The optic is already shut down according to the watchdogs.