40m QIL Cryo_Lab CTN SUS_Lab TCS_Lab OMC_Lab CRIME_Lab FEA ENG_Labs OptContFac Mariner WBEEShop
  40m Log  Not logged in ELOG logo
Entry  Tue Apr 2 18:40:01 2019, gautam, Update, VAC, Vac failure vacFail.png
    Reply  Wed Apr 3 09:07:46 2019, gautam, Update, VAC, Vac failure vacFailOvernight.png
       Reply  Wed Apr 3 10:42:36 2019, gautam, Update, VAC, TP2 forepump replaced 
          Reply  Wed Apr 3 16:17:17 2019, Jon, Update, VAC, TP2 forepump replaced IMG_3180.jpg
             Reply  Wed Apr 3 18:35:54 2019, gautam, Update, VAC, PSL shutter re-opened 
                Reply  Fri Apr 5 01:10:18 2019, gautam, Update, VAC, TP3 forepump is also noisy 
             Reply  Tue Apr 16 22:06:51 2019, gautam, Update, VAC, Vac interlock tripped again Screenshot_from_2019-04-16_22-05-47.pngScreenshot_from_2019-04-16_22-06-02.png
                Reply  Wed Apr 17 18:12:06 2019, gautam, Update, VAC, Vac interlock tripped again Screenshot_from_2019-04-17_18-11-45.pngScreenshot_from_2019-04-17_18-21-30.png
Message ID: 14550     Entry time: Wed Apr 17 18:12:06 2019     In reply to: 14546
Author: gautam 
Type: Update 
Category: VAC 
Subject: Vac interlock tripped again 

After getting the go ahead from Chub and Jon, I restored the Vacuum state to "Vacuum normal", see Attachment #1. Steps:

  1. Interlock code modifications
    • Backed up /opt/target/python/interlocks/interlock_conditions.yaml to /opt/target/python/interlocks/interlock_conditions_UPS.yaml
    • The "power_loss" condition was removed for every valve and pump inside /opt/target/python/interlocks/interlock_conditions.yaml
    • The interlock service was restarted using sudo systemctl restart interlock.service
    • Looking at the status of the service, I saw that it was dying ~ every 1 second.
    • Traced this down to a problem in/opt/target/python/interlocks/interlock_conditions.yaml  when the "pump_managers" are initialized - the way this is coded up, doesn't play nice if there are no conditions specified in the yaml file. For now, I just commented this part out. The git diff  below:
  2. Restoring vacuum normal:
    • Spun up TP1, TP2 and TP3
    • Opened up foreline of TP1 to TP2, and then opened main volume to TP1
    • Opened up annulus foreline to TP3, and then opened the individual annular volumes to TP3.
controls@c1vac:/opt/target/python/interlocks$ git diff interlock.py
diff --git a/python/interlocks/interlock.py b/python/interlocks/interlock.py
index 28d3366..46a39fc 100755
--- a/python/interlocks/interlock.py
+++ b/python/interlocks/interlock.py
@@ -52,8 +52,8 @@ class Interlock(object):
         self.pumps = []
         for pump in interlocks['pumps']:
             pm = PumpManager(pump['name'])
-            for condition in pump['conditions']:
-                pm.register_condition(*condition)
+            #for condition in pump['conditions']:
+            #    pm.register_condition(*condition)
             self.pumps.append(pm)

So far the pressure is coming down smoothly, see Attachment #2. I'll keep an eye on it.

PSL shutter was opened at 645pm local time. IMC locked almost immediately.

Update 11pm: The pressure has reached 8.5e-6 torr without hiccup. 

Attachment 1: Screenshot_from_2019-04-17_18-11-45.png  30 kB  Uploaded Wed Apr 17 19:20:27 2019  | Hide | Hide all
Screenshot_from_2019-04-17_18-11-45.png
Attachment 2: Screenshot_from_2019-04-17_18-21-30.png  34 kB  Uploaded Wed Apr 17 19:21:41 2019  | Hide | Hide all
Screenshot_from_2019-04-17_18-21-30.png
ELOG V3.1.3-