Following the checklist, I did these:
@Steve & Chub, we are ready to vent tomorrow (Monday Nov 19).
I believe this completes the non-Chub portions of the pre-vent checklist, we will start letting air into the main volume ASAP tomorrow morning after crossing off the remaining items.
Main goal of this vent is to investigate the oddness of the YARM suspensions. I leave the PSL NPRO on overnight in the interest of data gathering, it's been running ~10 hrs now - I suspect it'll turn itself off before we are ready to vent in the AM.
As Q mentioned in elog 10527, (prompted by Koji's email this afternoon) we are prepping the IFO for vent. Here is a copy of the pre-vent checklist from the wiki, updated as we work:
1 & 2: Locked arms on IR, ran ASS. Unlocked IFO, aligned PRM for good POP flashes, aligned SRM for symmetric AS flashes. Aligned all oplevs. Used PZTs to align Xgreen to arm. Used knobs to align Ygreen to arm. With PS:L green shutter closed, Xgreen = 0.520, Ygreen = 0.680.
3: Moved MC servo output cable that goes to ADC from OUT2 (which we had been using for monitoring AO path signals) back to its usual OUT1 (which is MC_L). This is used in the spot position measurement script. Spots at: [2.32, -0.50, 1.97, -1.11, 0.26, -1.86] mm.
4: Done -Q
5: Removed a PD that was monitoring the light coming backwards through the Faraday that sits just after the laser, just in case (confirmed that beam dump behind PD was catching beam). Other port of PBS just had regular black hole dump. Adjusted half wave plate until we had ~90mW just before injection into the vacuum.
6: Completed. Locked MC manually at transmission of ~1150, but low power autolocker isn't working. This isn't a critical thing, and can be fixed at any point during the vent. -Q
7: Shutters closed. Ready for Steve to check nuts and begin venting! -Q
[Annalisa, Manasa, Jenne, Koji]
We are working on the vent preparation.
First of all, there was no light in the interferometer.
Obviously there were lots of IFO activity in the weekend. Some were elogged, some were not.
Annalisa took her responsibility to restore the alignment and the arms recovered their flashes.
The odd thing was that the ASS got instable after we turned down the TRY PD gain from +20dB to +10dB (0dB original).
We increased the TRY gain by factor of 10 (that's the "10dB" of this PDA520. See the spec sheet) to compensate this change.
This made the ASS instable. Anyway we reduced the gain of TRY PD to 0dB. This restored the ASS.
Jenne took some more data for the QPD spectrum calibration.
Link to the vent plan
I have just centered IPPOS, as well as PSL POS and PSL ANG (also called IOO POS and IOO ANG on the screens). Annalisa is working on placing mirrors to get the IPANG beam to its QPD, so that one will be centered later.
Green steering mirrors have been swapped with PZT mirrors at the X end table. We aligned the green to the X arm.
X arm green transmission +PSL green ~ 0.95
That's better than before the swap...woohooo
Centering of the oplev beams: done
Recording the OSEM values: done
There seems to be an unexplained oscillation in X arm cavity transmission for IR when the cavity is locked using the POX error signal.
Their origin is not related to the oplevs because the oscillation does not exist when LSC is OFF and the arms are controlled only by the oplevs and OSEMs.
Low power MC locking
- Rotated HWP right after the laser
- Put a knife edge beam dump at the output of the PBS after the HWP.
- Replaced the PO mirror for the MC refl by an HR mirror.
Input offset from 0 to 0.29
Servo Gain from 10 to 30
=> Transmission 0.84 (1.2W at the MC input) to 0.069 (100mW)
VCO Gain from 25 to 31
MC REFL: Unlocked 3.6 Locked 0.38-0.40
After everyone's work today (good teamwork everybody!!), we are a GO for the vent.
Steve, please check the jam nuts, and begin the vent when you get in. Thanks.
We are getting ready to vent.
[Koji, Manasa, Sujan]
Tomorrow we'll make final checks of the optics inside the chamber.
Then we will pump down the chamber.
[q, Jenne, Manasa]
I figured out that didn't change the initial guess for the fit routine in Gabriele's code. I also changed the fminsearch criteria to least squares fitting, instead of minimax. The consistency checks now look just as good as the previous time we did these kind of measurements, no disagreements bigger than 1.6mm.
Thus, the current estimate of the SRC length after yesterday's motions is 5402mm, where we desire 5399mm. So, we will try to move SRM 3mm closer to SR2, after confirming that we are not clipping the POY beam. After all that, we will level the table.
Rough summary of today's progress:
I didn't really see anything out of the ordinary on the ETMX suspension. Earthquake stops had clearance, OSEMS were secure, no visible glue degredation on face magnets. Inspection with green LED flashlight didn't reveal any obscene dirtieness on either face, just a few particles here and there. The top of the opic barrel unsurprisingly has a good amount of particulate. The wire grooves are way too small to resolve anything at this point, other than that they exist.
The suspension footprint is already marked, tomorrow we can move the suspension closer to the door to get an even closer look at it, before removing it from the chamber.
I'd suggest clamping and moving it to the flow bench so you can inspect with a bright light. Then remove the wire and inspect the standoff, but hurry up with getting it in the soak bath so you can start on the cleaning of the other ones.
I wonder if we're really sure that its a mechanical problem with ETMX.
Gautam tells me that the local damping was always ON when looking for the jumps. This means that the coil driver was still hooked up and we can't rule out glitches in the DAC or the coil driver.
The UL OSEM shows the biggest movement (10 microns). The LR shows the second most (6-7 microns). The others are 2x less. So its consistent with a voltage change on UL,
Is this consistent with a slip in one of the wire standoffs? I think no.
One glitch was seen to occur without a change in the output voltage monitors in ELOG 11744
I performed a visual inspection of ITMY in its natural habitat today. I did not get any great pictures from the HR side because it's located very towards the edge of the table towards the arm. Before that I checked the levelness of the table. East-west direction was fine, north-south was slightly off but still within the marks for 'level'.
The AR side had several speckles, a few of them located somewhat near the geometrical center of ITMY. The top of the barrel was worse of, as expected. The HR side was a little better, but there were a few pieces of dust? near near the center. Sample pictures are attached, I uploaded all the good ones to Picasa.
Clamps that mark the position of ITMY were already in place. I did not move the optic just yet, and we will have to move a cable block out of the way to bring ITMY near the opening for us to work on it. We will markt the position of that to preserve the weight distribution. Then we can probably take some better before/after pictures. Tomorrow I will be looking at ETMY.
It took a little time, but I relocked the IMC and realigned to the point where the PRC is flashing, visible on REFL and AS, and tiny flashes are visible in TRY.
With Koji's help, I've hacked together an arrangement that will allow us to monitor the output of the coil driver to the UL coil.
The arrangement consists of a short custom ribbon cable with female DB25 connectors on both ends - the particular wire sending the signal to the UL coil has a 100 ohm resistor wired in series, because the coil has resistance ~20ohm, and the output of the coil driver board has a series 200(?) ohm resistor, so by directly monitoring the voltage at this point, we may not see a glitch as it may register too small. Tangentially related: the schematic of the coil driver board suggests that the buffered output monitor has a gain of 0.5.
To monitor the voltage, I use the board to which the 4 Oplev signals are currently hooked up. Channel 7 on this particular board (corresponding to ADC channel 30 on c1scx) was conveniently wired up for some prior test, so I used this channel. Then, I modified the C1SCX model to add a testpoint to monitor the output of this ADC. Then, I turned OFF the input on the coil output filter for the UL Coil (i.e. C1:SUS-ETMX_ULCOIL_SW1) so that we can send a known, controlled signal to the UL Coil by means of awggui. Next, I added an excitation at 5 Hz, amplitude 20 counts (as the signal to the coil under normal conditions was approximately of this amplitude) to the excitation channel of the same filter module, which is the state I am leaving the setup in for the night. I have confirmed that I see this 5Hz oscillation on the monitor channel I set up. Oddly, the 0 crossings of the oscillations happen at approximately -1000 counts and not at 0 counts. I wonder where this offset is coming from? The two points I am monitoring the voltage across is shown in the attached photograph - the black clip is connected to the lead carrying the return signal from the coil.
I also wanted to set up a math block in the model itself that monitors, in addition to the raw ADC channel, a copy from which the known applied signal has been cancelled, as presumably a glitch would be more obvious in such a record. However, I was unable to access the excitation channel to the ULCOIL filter from within the SCX model. So I am just recording the raw output for tonight...
I've made a few changes to the monitoring setup in the hope we catch a glitch in the DAC output/ sus coil driver electronics. Summary of important changes:
It remains to see if we will actually be able to see the glitch in long stretches of data - it is unclear to me how big a glitch will be in terms of ADC counts.
The relevant channels are : C1:SCX-UL_DIFF_MON and C1:SCX-UL_DIFF_MON_EPICS (pardon the naming conventions as the setup is only temporary after all). Both these should be hovering around 0 in the absence of any glitching. The noise in the measured signal seems to be around 2 ADC counts. I am leaving this as is overnight, hopefully the ETMX coil drive signal chain obliges and gives us some conclusive evidence...
I have not committed any of the model changes to the SVN.
It may be advantageous to look at the coil output data from when the OSEM damping is on, to try and reproduce the real output signal amplitude that gets sent to the coils.
The amplitude of the applied signal (20) was indeed chosen to roughly match what goes to the coils normally when the OSEM damping is on.
There appears to be no evidence of a detectable glitch in the last 10 hours or so (see attachment #1 - of course this is a 16Hz channel and the full data is yet to be looked at)... I guess the verdict on this is still inconclusive.
Yesterday, I expanded the extent of the ETMX suspension coil driver investigation. I set up identical monitors for two more coils (so now we are monitoring the voltage sent to UL, UR and LL - I didn't set one up for LR because it is on a second DB25 connector). Furthermore, I increased the excitation amplitude from ~20 to ~2000 (each coil had an independent oscillator at slightly different frequency between 5Hz and 8.5 Hz), the logic being that during LSC actuation we send signals of approximately this amplitude to the coils and we wanted to see if a larger amplitude signal somehow makes the system more prone to glitches.
Over ~10 hours of observation, there is no clear evidence of any glitch. About 2 hours ago (~930am PDT Fri Jul 8), the watchdog tripped - but this was because even though I had increased the trip threshold to ~800 for the course of this investigation, megatron runs this script every 20 minutes or so that automatically reduces this threshold by 17 counts - so at some point, the threshold went lower than the coil voltage, causing the watchdog to trip. So this was not a glitch. The other break around 2am PDT earlier today was an FB crash.
Do we now go ahead and pull the suspension out, and proceed with the swap?
Move the suspension on the south clean bench and make more close inspection. We need to remove the OSEMs.
Then unmount the mirror. Bring it to the clean room and work on the bond removal.
Meanwhile, set up all suspension components inclusing the alignment test setup.
While ETMX is out, I'm leaving the larger amplitude excitations to the coils on over the weekend, in case any electronic glitch decides to rear its head over the weekend. The watchdog should be in no danger of tripping now that we have removed the ETM.
Unrelated to this work: while removing the ETMX suspension from the chamber, I also removed the large mirror that was placed inside to aid photo taking, so that there is no danger of an earthquake knocking it over and flooding the chamber with dust.
We attempted to move the ETMY suspension near the access port in preparation for the cleaning process. The plan was to move in the face restraints first to the point of almost making contact, then the ones underneath so the optic is sitting on them, followed by the top one facing down, and then bringing in the stops on the faces.
While moving in the stoppers I noticed that the far lower stopper on the HR side was barely touching the face of the optic in its resting position and was basically pushing it sideways when moved forward. It was just on the edge, so I tried to compensate minimally by moving the underneath stops a little further on the near side, trying to let it 'slide' over a little so the screw would have better contact. I must have been too generous with the adjustment, because while proceeding I noticed at some point that the stick magnets on one side of the optic were not attached anymore but laying inside the OSEMs. The side magnet was also missing, it is now sitting on the suspension jig base plate. The dumbbells all seem intact, but we'll test them before we reglue the magnets to the optic. This is extremely unfortunate, but hopefully won't take too long to fix. At the very least, as Koji put it, the cleaning will be easier with the optic out of the suspension. Still, what a bummer.
We moved ITMY from its original position to a place near the access point. We took the OSEMs off first, and noticed that the short flat head screw driver was still a little too long to properly reach the set screws for the lower OSEMs. We were able to gradually loosen them, though and thus remove the lower OSEMs as well. We had to move a cable tower out of the way, but used clamps to mark its position. After making sure the optic is held by its earthquake stops, we moved it to its cleaning location. All magnets are still attached.
On Monday I inspected ETMY, and found nothing really remarkable. There was only little dust on the HR side, and nothing visible in the center. The AR side has some visible dust, nothing too crazy, but some of it near the center.
I have obtained 2x100cc bottles of in-date first contact from Garilynn (use before date is 09/14/2016) for cleaning of our test-masses. They are presently wrapped in foil in the plastic box with all the other first contact supplies.
This elog is meant to review some of the important changes made during the vent this summer - please add to this if I've forgotten something important. I will be adding this to the wiki page for a more permanent record shortly.
Optics, OSEM and suspension status:
ITMX & ITMY
Summary of characterization tasks to be done:
[ericq, Manasa, Jenne]
Summary: We opened up the BS and both ITM chambers today, and put the light doors on. //Edit : Manasa Post-vent the MC was very much misaligned in yaw. Both the ITMs moved in pitch as inferred from the oplev; but there is still light on the oplev PDs//. We toiled with the PMC and mode cleaner for a while to get reasonable transmission and stability (at least for a period of time). We then tried to lock IR to the y-arm, to no avail.
Locking the PMC doesn't seem very robust with the low power level we have; adjusting the gain at all when it's locked throws it right out. The mode cleaner spot was visibly moving around on MC2 as well. We'll continue tomorrow.
Details about alignment efforts: Manasa and I tried for a while to try and align the y-arm for IR. Straight out of venting the green TM00 would lock to the y-arm with about .45, as compared to .8 before venting, so it didn't seem to drift too far. The x-arm would even flash any modes, however. For a while, IR was no where to be seen after the mode cleaner. Eventually, we used the tip tilts to bring the AS beam onto the camera, which exhibited fringes, so we knew we were hitting the ITMs somewhere. We wandered around with the ETM to see if any retroflection was happening, and saw the IR beam scatter off of the earthquake stop. We moved it to the side to see it hitting the OSEM holder, and moved down to the bottom OSEM holder to get an idea of where to put pitch to get roughly the center of the ITM, then undid the yaw motion.
There, we would see very infrequent, weak flashes. We weren't able to distinguish the mode shape though; however, the flashes were coincident with where the green would lock to a very yaw-misaligned fishbone mode, to the lower right of the optic's center. We figured that if we gradually fixed the green alignment with the mode shapes we could see and actually lock on, we could use the tip tilts to adjust the IR pointing and keep it coincident and eventually resonate more. However, this didn't really work out. The flashes were very infrequent, and at this point the PMC/MC were getting very touchy, and would cease to stay locked for more than a minute or two. At this point, we stopped for the day.
After turning the slow FSS threshold down, the mode cleaner stays locked enough to do other things. We were able to align the tip tilts to the y-arm such that we were able to get some flashes in what looks like a TM00-ish mode. (It was necessary to align the PRM such that there was some extra power circulating in the PRC to be able to see the IR flashes on the ITMY face camera) This is enough to convince us that we are at least near a reasonable alignment, even though we couldn't lock to the mode.
The x-arm was in a hairier situation; since the green beam wouldn't flash into any modes, we don't even know that a good cavity axis exists. So, I used the green input PZTs to shine the green beam directly on the earthquake stops on the ITMX cage, and then inferred the PZT coordinates that would place the green beam roughly on the center of ITMX. I moved the ETMX face camera such that it points at the ETMX baffle. I tried looking for the retroreflected green spot to no avail. Hopefully tomorrow, we can get ourselves to a reasonably aligned state, so we can begin measuring the macroscopic PRC length.
Steve, Jenne, Koji
09:30 25 torr
10:30 180 torr
11:00 230 torr
12:00 380 torr
13:00 520 torr
14:30 680 torr - Finish. It is already over pressured.
IMC was locked, MC2T ~ 1200cts after some alginment touch ups. The test mass oplevs indicate some drift, ~100urad. I didn't realign them.
The EY door removal will only be done tomorrow. I will take some free-swinging ETMY data today (suspension was kicked at 1241919438) to see if anything has changed (it shouldn't have). I need to think up a systematic debugging plan in the meantime.
Today so far:
Here's my quick brain dump of things to do before we can pump down (anyone see anything missing?):
POY has >2 inches of clearance from the SRM cage.
Distance reconstruction indicates an SRC length of 5399mm, which was exactly our target.
We have completed the above points; the ITMY table is still level.
Despite what the wiki says, the SRM LR OSEM open voltage is ~1.97V instead of ~1.64, so we shot for half of that.
The in-air steering of the SRM oplev return beam needs adjustment. I'll estimate the beam path length when I'm taking pictures and closing up.
Left to do:
Related In-Air work:
Everything is aligned, AS and POY make it out of vacuum unclipped, OSEM readings look good.
I set up the SRM oplev, centered all oplevs.
Tomorrow, we just have to take pictures of the ITMY chamber before we put the heavy doors on.
I closed the PSL shutter as we didn't want to burn the mirror surface when we are not working.
Photos have been taken of the ITMY chamber, and uploaded to picasa. Here's a slideshow:
I've been helping Steve vent this morning. The following things were done (from Steve's logbook):
(At this point, I took over the air canisters, while Steve made preparations around the lab.
With the 5th cylinder, we began approaching 1 atm, so we slowed the regulator down to 5psi. Around 750 torr, Steve opened VV1 to air.
According to Steve, we will be at atmospheric pressure at ~12:30pm.
I was poking around at the LSC rack to try and set up a temporary arrangement whereby I take the signals from the DAC differentially and route them to the D990694 differentially. The situation is complicated by the fact that, afaik, we don't have any break out boards for the DIN96 connectors on the back of all our Eurocrate cards (or indeed for many of the other funky connecters we have like IDE/IDC 10,50 etc etc). I've asked Steve to look into ordering a few of these. So I tried to put together a hacky solution with an expansion card and an IDC64 connector. I must have accidentally shorted a pair of DAC pins or something, because all models on the c1lsc FE crashed. On attempting to restart them (c1lsc was still ssh-able), the usual issue of all vertex FEs crashing happened. It required several iterations of me walking into the lab to hard-reboot FEs, but everything is back green now, and I see the AS beam on the camera so the input pointing of the TTs is roughly back where it was. Y arm TEM00 flashes are also seen. I'm not going to re-align the IFO tonight. Maybe I'll stick to using a function generator for the THD tests, probably routing non AI-ed signals directly is as bad as any timing asynchronicity between funcGen and DAQ system...
Around 5pm local time, the three vertex FEs crashed. AFAIK, no one was in the lab or working on anything CDS related, so this is worrying.
3 of the 4 remote controlled illuminators at the vertex are installed and can now be turned on via sitemap. There are a total of 15 controls for "Illum", but only the 3 labeled with MC, BS-PRM and ITMY-SRM are functional.
- I was investigating the SUS whitening issue.
- I could not find any suspension which can handle the input whitening switch correctly.
- I went to 1X5 rack and found that both of the two binary output boxes were turned off.
As far as I know they are pulling up the lines which are switched by the open collector outputs.
- I tried to turn on the switch. Immediately I noticed the power lamps did not work. So I need an isolated setup to investigate the situation.
- The cables are labelled. I will ask steve to remove the boxes from the rack.
I shut down damping to the Vertex optics and removed Binary IO Adapter chassy BO0 and BO1
About a week ago I discussed the BO0's power indicator lights with Kiwamu. They were not on or they were blinking on-off.
I put screws into ps connectors in the back, but it did not helped.