ID |
Date |
Author |
Type |
Category |
Subject |
11116
|
Sat Mar 7 22:01:12 2015 |
Jenne | Configuration | LSC | CARM and DARM on RF signals!!!!!!!!!!!!!!!!!!!! |
[Jenne, with Matt and Fujimi as witnesses]
It might be about time to throw that champagne in the fridge. Nice. Not quite close enough to talk about popping it open, but we'll want it chilled just in case... 
I still haven't logged yesterday's work, and I'm still working now, so no details, but I just handed both CARM and DARM over to non-normalized RF signals, and had the arms stable at powers of about 105. I was workinig on the ETM alignment, and the power was increasing, so I think that's where the extra power will come from. I was lowering the DARM gain as I improved the alignment, because the optical gain was increasing so much. I probably just didn't do that fast enough for the last aligning, which is why I lost lock.
Anyhow, here's a plot, because I'm excited:

|
Attachment 1: ARM_POWERS_100.png
|
|
11117
|
Sun Mar 8 00:05:37 2015 |
Koji | Configuration | LSC | CARM and DARM on RF signals!!!!!!!!!!!!!!!!!!!! |
Exciting! How long was it? |
11118
|
Sun Mar 8 01:27:01 2015 |
Jenne | Configuration | LSC | CARM and DARM on RF signals!!!!!!!!!!!!!!!!!!!! |
I have in my notebook that at 9:49pm CARM was no longer using ALS as an error signal, and at 9:50pm, DARM was no longer using ALS as an error signal. It looks like I was locked for 3+ minutes after getting to RF-only signals.
The increase in power near the end of the lock stretch was me trying to improve the dark port contrast by touching the ETMX alignment. DARM was definitely oscillating as I improved the dark port contrast, so I was trying to hand-lower the gain as I worked on the alignment.

|
Attachment 1: RFlock3min.png
|
|
11145
|
Thu Mar 19 14:37:17 2015 |
manasa | Configuration | IOO | IMC relocked |
The autolocker was struggling to lock the IMC. I disabled the autolocker and locked the IMC manually. It seems happy right now.
With PMC trans at 0.717 counts, the IMC trans sum is ~15230.
Quote: |
The MC autolocker hasn't been so snappy recently, and has been especially fussy today. Previously, the mcup script was triggered immediately once the transmission was above a certain threshold. However, this could waste time if it was just an errant flash. Hence, I've added a 0.5 second delay and a second threshold check before mcup is triggered.
After breaking the lock 5ish times, it does seem to come back quicker.
|
|
11343
|
Tue Jun 2 21:22:07 2015 |
rana, koji | Configuration | IOO | AOM inserted in beam and aligned |
We spent an hour today to put the AOM back in the beam before the PMC and verified that the diffraction is working.
- The fuse holder was missing from the rack. We inserted a 5A fuse. We expect that the quiesscent draw is < 0.5 A. The power is from the +24V Sorensen supply.
- The alignment was tricky, but we optimized it as well as we could in translation and the RZ direction. Its a fixed mount still.
- We noticed that according to the datasheet, the polarization is wrong! It wants S-Pol light and we're giving it P-Pol. How come no one noticed this? We expect that the efficiency is reduced because of this. We (Steve) need to brainstorm what kind of mount we can use there to mount it at 90 deg to the plane of the table.
- The lens after the AOM has f = +400 mm. The distance from the AOM to the lens is ~800-900 mm so its not so terrible. However, if someone were to put the AOM halfway between the turning mirrors there, the beam diffraction would be canceled.
- The AOM input impedance seems to be 50 Ohm as advertised. The previous Koji entry claim of 25 Ohm is mysterious. We checked the Ohmage by sending a signal into the AM input of the AOM using the DS345 which as a 50 Ohm output. 1 Vpp from the DS345 made 1 Vpp on the input of the AM input as measured by Oscope connected by T with high impedance setting.
- With 0.5 V offset and a 1 Vpp signal, we get ~20-25% modulation of the power.

- We have left it running with a 4444.4 Hz modulation and a small amplitude. This is to see if we can use this to measure the cavity poles of the MC and the arms.
- We noticed some hash on the Teed input monitor. It was backstreaming of the RF drive. Whoever uses this thing in an ISS feedback ought to make sure to put an RF choke between the servo and this AOM driver.
We also removed a 50/50 pickoff mirror which was used to take one of the NPRO -> EOM polarizer reject beams and send it across the table into a floppy dump. Its now hitting a closer floppy dump. Let's stop using these crappy anodized aluminum flappers anywhere, Steve.
We also noticed that the PMC REFL path uses a W1 from CVI to send the PMC reflection to the REFL RFPD. The dim beam from the AR coated surface is being used rather than the bright beam from the uncoated surface. Ooops. Steve, can you please order another W1 for 1064 from CVI, but get it with a 2-3 deg wedge angle? This one has a wedge which is too small. |
11399
|
Thu Jul 9 16:39:03 2015 |
Koji | Configuration | General | How to set up your own summary page environment on the LDG cluster |
Here is the summary of my investigation how to set up my own "summary page" environment on the LDG (LIGO Data Grid) cluster.
Here all albert.einstein must be replaced with your own LIGO.ORG user name.
1. Obtain LDAS cluster account
Run the following from any of the terminal and use your LIGO.ORG credential
ssh albert.einstein@ssh.ligo.org
You will be suggested to visit a particular web site. Fill the form on the web site and wait for the approval e-mails.
2. Use LDG SSH login portal
Once you received the approval of the account, you should be able to log in to the system. Type the following command again from your local terminal
ssh albert.einstein@ssh.ligo.org
You are asked to select the site and machines. Select 2- CIT and b. ldas-pcdev1, c. ldas-pcdev2, or d. ldas-pcdev3.
3. Setup bash environment
Setting up the python library path is very important for the proper processing.
Here is my setup for .bash_profile
# .bash_profile
# Get the aliases and functions
if [ -f ~/.bashrc ]; then
. ~/.bashrc
fi
if [ -f ~/.profile ]; then
. ~/.profile
fi
# User specific environment and startup programs
PATH=$PATH:$HOME/bin
export PATH
# So that ssh will work, take care with X logins - see .xsession
[[ -z $SSH_AGENT_PID && -z $DISPLAY ]] &&
exec -l ssh-agent $SHELL -c "bash --login"
|
and .bashrc
# .bashrc
# Source global definitions
if [ -f /etc/bashrc ]; then
. /etc/bashrc
fi
# Set Python environment (based on gpwy-env script)
# clean path environment variable of duplicate entries
cleanpath() {
if [[ -z "$1" ]]; then
$1=PATH
fi
# map to local variable
local badpath=$(eval echo \$$1)
badpath=${badpath%%:}
# remove duplicates
badpath="$(echo "${badpath}" | awk -v RS=':' -v ORS=":" '!a[$1]++')"
# remove trailing colon
badpath=${badpath%%:}
# reset variable and export
eval $1=${badpath}
eval export $1
}
# set PATH
cleanpath PATH
cleanpath PYTHONPATH
PATH=${HOME}/.local/bin:${PATH}
PYTHONPATH=${HOME}/.local/lib/python2.6/site-packages:${PYTHONPATH}
|
The order of cleanpath and PYTHONPATH= is important as we want to use the local library installation before anything kicks in.
4. Install required Python libraries
Run the following lines with this order so that they are installed in your "~/local"
# PIP installation
wget https://bootstrap.pypa.io/get-pip.py
python get-pip.py --user
# numpy, scipy, distribute, matplotlib, astropy, importlib installation
pip install numpy --upgrade --user
pip install scipy --upgrade --user
pip install distribute --upgrade --user
pip install matplotlib --user --upgrade
pip install astropy --upgrade --user
pip install importlib --user --upgrade
# We need to use dev branch of gwpy to run gwsumm propery
cp -r /home/detchar/opt/gwpysoft/lib/python2.6/site-packages/gwpy* ~/.local/lib/python2.6/site-packages/
# gwsumm installation
pip install --user git+https://github.com/gwpy/gwsumm
|
5. Setup summary pages for the 40m
Copy summary page setting from Max's directory.
cp -r ~max.isi/summary ~/
And make temporary directory for the summary pages.
mkdir /usr1/albert.einstein/summary
6. Modify typos in gw_summary_custon
Use your own editor to fix typos
emacs ~/summary/bin/gw_daily_summary_custom
replace max.isi to albert.einstein
change summary40m -> summary
Now the installation is done. From here, the description is for the routine procedure.
7. Run your summary page code
Run Kerberos authentication
kinit albert.einstein@LIGO.ORG
Run a summary page code for a specific date (e.g. for Jul 1st, 2015)
bash ${HOME}/summary/bin/gw_daily_summary_custom --day 20150701
The result can be checked under
https://ldas-jobs.ligo.caltech.edu/~albert.einstein/summary/
https://ldas-jobs.ligo.caltech.edu/~albert.einstein/summary/day/20150701/
Rerun a code for a specific page. This requires the page structure already exists.
The red texts should be modified depending on what ini file you want to run for what day.
/home/albert.einstein/.local/bin/gw_summary day --on-segdb-error warn --verbose --output-dir . --multi-process 20 --no-html --ifo C1 --archive C1EVE 20150630 --config-file /mnt/qfs2/albert.einstein/public_html/summary/etc/defaults.ini,/mnt/qfs2/albert.einstein/public_html/summary/etc/c1eve.ini
This command can actually be found in
https://ldas-jobs.ligo.caltech.edu/~albert.einstein/summary/gw_summary_pipe.sh
8. Some useful command
To check which python library is used
python -c 'import gwpy; print gwpy.__file__'
To list installed python libraries and versions
pip list
This should return the list like the following.
...
astropy (1.0.3)
...
gwpy (0.1b1.dev121)
gwsumm (0.0.0.dev854)
...
matplotlib (1.4.3)
...
numpy (1.9.2)
...
scipy (0.15.1)
...
|
11405
|
Mon Jul 13 18:27:27 2015 |
Eve | Configuration | General | How to set up your own summary page environment on the LDG cluster |
I'd like to build off of Koji's instructions with a few useful tips I discovered while setting up my own summary page environment.
To only make a specified selection of tabs for the summary pages, copy only the corresponding .ini files into /home/albert.einstein/summary/config and run the gw_daily_summary_custom following Koji's instructions below. When asked for nodus's password either hit "enter" three times without providing the password or comment out this section of the code to stop the summary page creation process from taking current data files from nodus. This is especially helpful when the 40m is down (like it is now).
After running the summary page code, the pages can be viewed at https://ldas-jobs.ligo.caltech.edu/~albert.einstein/summary/day/YYYYMMDD/ and corresponding error logs can be found at ~/public_html/summary/logs/gw_summary_pipe_local-687496-0.err. |
11431
|
Mon Jul 20 16:45:15 2015 |
Max Isi | Configuration | General | Summary page c1sus.ini error corrected |
Bad syntax errors in the c1sus.ini config file were causing the summary pages to crash: a plot type had not been indicated for plots 5 and 6, so I've made these "timeseries."
In the future, please remember to always specify a plot type, e.g.:
BAD:
5 = C1:SUS-ETMX_SUSPIT_INMON.mean,
C1:SUS-ITMY_SUSPIT_INMON.mean,
GOOD:
3 = C1:SUS-ETMX_SUSPIT_INMON.mean,
C1:SUS-ITMY_SUSPIT_INMON.mean timeseries
By the way, the pages will continue to be unavailable while I transfer them to the new shared account. |
11530
|
Tue Aug 25 16:33:31 2015 |
Ignacio, Steve | Configuration | PEM | Seismometer enclosure copper foil progress |
Steve ordered about two weeks ago a roll of 0.5 mm thick copper foil to be used for the inside of the seismometer cans. The foil was then waterjet cut by someone in Burbank to the right dimensions (in two pieces, a side and a bottom for each of the three cans).
Today, we glued the copper foil (sides only) inside the three seismometer cans. We used HYSOL EE4215/HD3561(Data Sheet) as our glue. It is a "high impact, low viscocity, room temperature cure casting" that offers "improved thermal conductivity and increased resistance to heat and thermal shock." According to Steve, this is used in electronic boards to glue components when you want it to be thermal conductive.
We are going to finish this off tomorrow by gluing the bottom foil to the cans. The step after this involves soldering the side to the bottow and where the side connects. We have realized that the thermal conductivity of the solder that we are using is only ~50. This is 8 times smaller than that of copper and wil probably limit how good a temperature gradient we will have.
Some action shots,




|
11561
|
Thu Sep 3 00:14:09 2015 |
rana | Configuration | IOO | IMC fast gain change for lock acq |
The IMC often was making that scratchy noise when first catching lock and sometimes breaking. Thinking of the crappy crossover sit that EQ showed in his latest plots, I decided that it didn't make sense to acquire lock with an unstable PZT/EOM crossover, so I have changed mcdown to acquire with +13 dB Fast Gain and its much fast now and no longer makes that sound.
I also changed the caput command from 'caput -l' to 'caput -c -l' to see if the async 'wait for callback' feature will insure that the commands get sent. I witnessed the mcdown not actually writing all of its commands once or twice tonight. With the MC Boost left on its never going to lock.
mcdown has been committed to SVN. Please, if you have recently edit mcup and Autolock, commit them to the SVN or else I will delete them and do an svn up. |
11576
|
Fri Sep 4 10:25:19 2015 |
Steve | Configuration | IOO | AOM stage is ready |
New stage can hold the correct polarization.
DRAWING CORRECTION: Post block height was lowered to be 1.88" from 2.0" |
Attachment 1: stage_AOM-EOM.jpg
|
|
Attachment 2: A-EOMholder.pdf
|
|
11581
|
Mon Sep 7 18:25:16 2015 |
rana | Configuration | IOO | AOM stage is ready |
The new stage missed the right height by ~2 mm. 
Even if I completely bottom out the (New Focus 9071) 4-axis stage, its not short enough. So I removed the AOM from the beam and re-aligned into the PMC.
Steve, please get the aluminum piece remachined to go down by 2.5 mm so we can have some height adjustment room.
Quote: |
New stage can hold the correct polarization.
|
Also, the turning mirror mount just after the EOM and before the AOM is a U-100 and we want it to be a Suprema for stability - let's not forget to swap that after Steve gets the mount fixed. |
11661
|
Sun Oct 4 12:07:11 2015 |
jamie | Configuration | CDS | CSD network tests in progress |
I'm about to start conducting some tests on the CDS network. Things will probably be offline for a bit. Will post when things are back to normal. |
11663
|
Sun Oct 4 14:23:42 2015 |
jamie | Configuration | CDS | CSD network test complete |
I've finished, for now, the CDS network tests that I was conducting. Everything should be back to normal.
What I did:
I wanted to see if I could make the EPICS glitches we've been seeing go away if I unplugged everything from the CDS martian switch in 1X6 except for:
- fb
- fb1
- chiara
- all the front end machines
What I unplugged were things like megatron, nodus, the slow computers, etc. The control room workstations were still connected, so that I could monitor.
I then used StripTool to plot the output of a front end oscillator that I had set up to generate a 0.1 Hz sine wave (see elog 11662). The slow sine wave makes it easy to see the glitches, which show up as flatlines in the trace.
More tests are needed, but there was evidence that unplugging all the extra stuff from the switch did make the EPICS glitches go away. During the duration of the test I did not see any EPICS glitches. Once I plugged everything back in, I started to see them again. However, I'm currently not seeing many glitches (with everything plugged back in) so I'm not sure what that means. I think more tests are needed. If unplugging everything did help, we still need to figure out which machine is the culprit. |
11665
|
Sun Oct 4 14:32:49 2015 |
jamie | Configuration | CDS | CSD network test complete |
Here's an example of the glitches we've been seeing, as seen in the StripTool trace of the front end oscillator:

You can clearly see the glitch at around T = -18. Obviously during non-glitch times the sine wave is nice and cleanish (there are still the very small discretisation from the EPICS sample times). |
11754
|
Wed Nov 11 22:50:39 2015 |
Koji | Configuration | CDS | Slow machine time&date |
I was gazing at the log file for Autolocker script (/opt/rtcds/caltech/c1/scripts/MC/logs/AutoLocker.log )
and found quite old time stamps. e.g.
Old : C1:IOO-MC_VCO_GAIN 1991-08-08 14:36:28.889032 -3
New : C1:IOO-MC_VCO_GAIN 1991-08-08 14:36:36.705699 18
Old : C1:PSL-FSS_FASTGAIN 1991-08-09 19:05:39.972376 14
New : C1:PSL-FSS_FASTGAIN 1991-08-09 19:05:44.939043 18
It was found that the date/time setting of some of the slow machines (at least c1psl and c1iool0) is not correct.
I could not figure out how to fix it.
Question: Is this anything critical?
Another thing: While I was in c1iool0 I frequently saw the message like
c1iool0 > 0xc461f0 (CA event): Events lost, discard count was 514
Is this anything related to EPICS Freeze?
controls@nodus|~ > telnet c1psl.martian
Trying 192.168.113.53...
Connected to c1psl.martian.
Escape character is '^]'.
c1psl > date
Aug 09, 1991 19:13:26.439024274
value = 32 = 0x20 = ' '
c1psl >
telnet> q
Connection closed.
controls@nodus|~ > telnet c1iool0.martian
Trying 192.168.113.57...
Connected to c1iool0.martian.
Escape character is '^]'.
c1iool0 > date
Aug 08, 1991 14:44:39.755679528
value = 32 = 0x20 = ' '
c1iool0 > 0xc461f0 (CA event): Events lost, discard count was 514
Change MC VCO gain to -3.
0xc461f0 (CA event): Events lost, discard count was 423
Change MC VCO gain to 18.
Change boost gain to 1.
Change boost gain to 2.
|
|
11773
|
Tue Nov 17 15:49:23 2015 |
Koji | Configuration | IOO | MC Autolocker modified |
/opt/rtcds/caltech/c1/scripts/MC/AutoLockMC.csh was modified last night.
1. Autolocker sometimes forget to turn off the MC2Tickle. I added the following lines to make sure to turn it off.
echo autolockMCmain: MC locked, nothing for me to do >> ${lfnam}
echo just in case turn off MC2 tickle >> ${lfnam}
${SCRIPTS}/MC/MC2tickleOFF
2. During the lock acquisition, Autolocker frequently stuck on a weak mode. So the following lines were added
so that the Autolocker toggles the servo switch while waiting for the lock.
echo autolockMCmain: Mon=$mclockstatus, Waiting for MC to lock .. >> ${lfnam}
# Turn off MC Servo Input button
ezcawrite C1:IOO-MC_SW1 1
date >> ${lfnam}
sleep 0.5;
# Turn on MC Servo Input button
ezcawrite C1:IOO-MC_SW1 0
sleep 0.5;
|
11791
|
Thu Nov 19 17:06:57 2015 |
Koji | Configuration | CDS | Disabled auto-launching RT processes upon FE booting |
We want to startup the RT processes one by one on boot of FE machines.
Therefore /diskless/root/etc/rc.local on FB was modified as follows. The last sudo line was commented out.
for sys in $(/etc/rt.sh); do
#sudo -u controls sh -c ". /opt/rtapps/rtapps-user-env.sh && /opt/rtcds/cal\
tech/c1/scripts/start${sys}"
# NOTE: we need epics stuff AND iniChk.pl in PATH
# we use -i here so that the .bashrc is sourced, which should also
# source rtapps and rtcds user env (for epics and scripts paths)
# commented out Nov 19, 2015, KA
# see ELOG 11791 http://nodus.ligo.caltech.edu:8080/40m/11791
# sudo -u controls -i /opt/rtcds/caltech/c1/scripts/start${sys}
done
|
11905
|
Mon Jan 4 14:45:41 2016 |
rana, eq, koji | Configuration | Computer Scripts / Programs | nodus pwd change |
We changed the password for controls on nodus this afternoon. We also zeroed out the authorized_keys file and then added back in the couple that we want in there for automatic backups / detchar.
Also did the recommended Ubuntu updates on there. Everything seems to be going OK so far. We think nothing on the interferometer side cares about the nodus password.
We also decided to dis-allow personal laptops on the new Martian router (to be installed soon). |
12158
|
Wed Jun 8 13:50:39 2016 |
jamie | Configuration | CDS | Spectracom IRIG-B card installed on fb1 |
[EDIT: corrected name of installed card]
We just installed a Spectracom TSyc-PCIe timing card on fb1. The hope is that this will help with the GPS timeing syncronization issues we've been seeing in the new daqd on fb1, hopefully elliminating some of the potential failure channels.
The driver, called "symmetricom" in the advLigoRTS source (name of product from competing vendor), was built/installed (from DCC T1500227):
controls@fb1:~/rtscore/tests/advLigoRTS-40m 0$ cd src/drv/symmetricom/
controls@fb1:~/rtscore/tests/advLigoRTS-40m/src/drv/symmetricom 0$ ls
Makefile stest.c symmetricom.c symmetricom.h
controls@fb1:~/rtscore/tests/advLigoRTS-40m/src/drv/symmetricom 0$ make
make -C /lib/modules/3.2.0-4-amd64/build SUBDIRS=/home/controls/rtscore/tests/advLigoRTS-40m/src/drv/symmetricom modules
make[1]: Entering directory `/usr/src/linux-headers-3.2.0-4-amd64'
CC [M] /home/controls/rtscore/tests/advLigoRTS-40m/src/drv/symmetricom/symmetricom.o
/home/controls/rtscore/tests/advLigoRTS-40m/src/drv/symmetricom/symmetricom.c:59:9: warning: initialization from incompatible pointer type [enabled by default]
/home/controls/rtscore/tests/advLigoRTS-40m/src/drv/symmetricom/symmetricom.c:59:9: warning: (near initialization for ‘symmetricom_fops.unlocked_ioctl’) [enabled by default]
/home/controls/rtscore/tests/advLigoRTS-40m/src/drv/symmetricom/symmetricom.c: In function ‘get_cur_time’:
/home/controls/rtscore/tests/advLigoRTS-40m/src/drv/symmetricom/symmetricom.c:89:2: warning: ISO C90 forbids mixed declarations and code [-Wdeclaration-after-statement]
/home/controls/rtscore/tests/advLigoRTS-40m/src/drv/symmetricom/symmetricom.c: In function ‘symmetricom_init’:
/home/controls/rtscore/tests/advLigoRTS-40m/src/drv/symmetricom/symmetricom.c:188:2: warning: ISO C90 forbids mixed declarations and code [-Wdeclaration-after-statement]
/home/controls/rtscore/tests/advLigoRTS-40m/src/drv/symmetricom/symmetricom.c:222:3: warning: label ‘out_remove_proc_entry’ defined but not used [-Wunused-label]
/home/controls/rtscore/tests/advLigoRTS-40m/src/drv/symmetricom/symmetricom.c:158:22: warning: unused variable ‘pci_io_addr’ [-Wunused-variable]
/home/controls/rtscore/tests/advLigoRTS-40m/src/drv/symmetricom/symmetricom.c:156:6: warning: unused variable ‘i’ [-Wunused-variable]
Building modules, stage 2.
MODPOST 1 modules
CC /home/controls/rtscore/tests/advLigoRTS-40m/src/drv/symmetricom/symmetricom.mod.o
LD [M] /home/controls/rtscore/tests/advLigoRTS-40m/src/drv/symmetricom/symmetricom.ko
make[1]: Leaving directory `/usr/src/linux-headers-3.2.0-4-amd64'
controls@fb1:~/rtscore/tests/advLigoRTS-40m/src/drv/symmetricom 0$ sudo make install
#remove all old versions of the driver
find /lib/modules/3.2.0-4-amd64 -name symmetricom.ko -exec rm -f {} \; || true
find /lib/modules/3.2.0-4-amd64 -name symmetricom.ko.gz -exec rm -f {} \; || true
# Install new driver
install -D -m 644 symmetricom.ko /lib/modules/3.2.0-4-amd64/extra/symmetricom.ko
/sbin/depmod -a || true
/sbin/modprobe symmetricom
if [ -e /dev/symmetricom ] ; then \
rm -f /dev/symmetricom ; \
fi
mknod /dev/symmetricom c `grep symmetricom /proc/devices|awk '{print $1}'` 0
chown controls /dev/symmetricom
controls@fb1:~/rtscore/tests/advLigoRTS-40m/src/drv/symmetricom 0$ ls /dev/symmetricom
/dev/symmetricom
controls@fb1:~/rtscore/tests/advLigoRTS-40m/src/drv/symmetricom 0$ ls -al /dev/symmetricom
crw-r--r-- 1 controls root 250, 0 Jun 8 13:42 /dev/symmetricom
controls@fb1:~/rtscore/tests/advLigoRTS-40m/src/drv/symmetricom 0$
|
12161
|
Thu Jun 9 13:28:07 2016 |
jamie | Configuration | CDS | Spectracom IRIG-B card installed on fb1 |
Something is wrong with the timing we're getting out of the symmetricom driver, associated with the new spectracom card.
controls@fb1:~/rtscore/tests/advLigoRTS-40m/src/drv/symmetricom 127$ lalapps_tconvert
1149538884
controls@fb1:~/rtscore/tests/advLigoRTS-40m/src/drv/symmetricom 0$ cat /proc/gps
704637380.00
controls@fb1:~/rtscore/tests/advLigoRTS-40m/src/drv/symmetricom 0$
The GPS time is way off, and it's counting up at something like 900 seconds/second. Something is misconfigured, but I haven't figured out what yet.
The timing distribution module we're using is spitting out what appears to be an IRIG B122 signal (amplitude moduled 1 kHz carrier), which I think is what we expect. This is being fed into the "AM IRIG input" connector on the card.
Not sure why the driver is spinning so fast, though, with the wrong baseline time. Reboot of the machine didn't help. |
12166
|
Fri Jun 10 12:09:01 2016 |
jamie | Configuration | CDS | IRIG-B debugging |
Looks like we might have a problem with the IRIG-B output of the GPS receiver.
Rolf came over this morning to help debug the strange symmetricom driver behavior on fb1 with the new Spectracom card. We restarted the machine againt and this time when we loaded the drive rit was clocking at a normal rate (second/second). However, the overall GPS time was still wrong, showing a time in October from this year.
The IRIG-B122 output is supposed to encode the time of year via amplitude modulation of a 1kHz carrier. The current time of year is:
controls@fb1:~ 0$ TZ=utc date +'%j day, %T'
162 day, 18:57:35
controls@fb1:~ 0$
The absolute year is not encoded, though, so the symmetricon driver has the year offset hard coded into the driver (yuck), to which it adds the time of year from the IRIG-B signal to get the correct GPS time.
However, loading the symmetricom module shows the following:
...
[ 1601.607403] Spectracom GPS card on bus 1; device 0
[ 1601.607408] TSYNC PIC BASE 0 address = fb500000
[ 1601.607429] Remapped 0xffffc90017012000
[ 1606.606164] TSYNC NOT receiving YEAR info, defaulting to by year patch
[ 1606.606168] date = 299 days 18:28:1161455320
[ 1606.606169] bcd time = 1161455320 sec 959 milliseconds 398 microseconds 959398630 nanosec
[ 1606.606171] Board sync = 1
[ 1606.616076] TSYNC NOT receiving YEAR info, defaulting to by year patch
[ 1606.616079] date = 299 days 18:28:1161455320
[ 1606.616080] bcd time = 1161455320 sec 969 milliseconds 331 microseconds 969331350 nanosec
[ 1606.616081] Board sync = 1
controls@fb1:~ 0$
Apparently the symmetricom driver thinks it's the 299nth day of the year, which of course corresponds to some time in october, which jives with the GPS time the driver is spitting out.
Rolf then noticed that the timing module in the VME crate in the adjacent rack, which also receives an IRIG-B signal from the distribution box, was also showing day 299 on it's front panel display. We checked and confirmed that the symmetricom card and the VME timing module both agree on the wrong time of year, strongly suggesting that the GPS receiver is outputing bogus data on it's IRIG-B output, even though it's showing the correct time on it's front panel. We played around with setting in the GPS receiver to no avail. Finally we rebooted the GPS receiver, but it seemed to come up with the same bogus IRIG-B output (again both symmetricom driver and VME timing module agree on the wrong day).
So maybe our GPS receiver is busted? Not sure what to try now.
|
12167
|
Fri Jun 10 12:21:54 2016 |
jamie | Configuration | CDS | GPS receiver not resetting properly |
The GPS receiver (EndRun Technologies box in 1Y5? (rack closest to door)) seems to not coming back up properly after the reboot. The front pannel says that it's "LKD", but the "sync" LED is flashing instead of solid, and the time of year displayed on the front panel is showing day 6. The fb1 symmetricom driver and VME timing module are still both seeing day 299, though. So something may definitely be screwy with the GPS receiver. |
12182
|
Wed Jun 15 10:19:10 2016 |
Steve | Configuration | CDS | GPS antennas... debugging |
Visual inspection of rooftop GPS antennae:
The 2 GPS antennas are located on the north west corner of CES roof. Their condition looks well weathered. I'd be surprised if they work.
The BNC connector of the 1553 head is inside of the conduit so it is more likely to have a better connection than the other one.
I have not had a chance to look into the "GPS Time Server" unit. |
Attachment 1: GPStimeServer.jpg
|
|
Attachment 2: GPSsn.jpg
|
|
Attachment 3: GPSantennas.jpg
|
|
Attachment 4: GPSantHead.jpg
|
|
Attachment 5: GPSantHead2.jpg
|
|
Attachment 6: GPSantCabels.jpg
|
|
12200
|
Mon Jun 20 11:11:20 2016 |
Steve | Configuration | CDS | GPS receiver not resetting properly |
I called https://www.endruntechnologies.com/pdf/USM3014-0000-000.pdf and they said it's very likely just needs a software update. They will email Jamie the details.
Quote: |
The GPS receiver (EndRun Technologies box in 1Y5? (rack closest to door)) seems to not coming back up properly after the reboot. The front pannel says that it's "LKD", but the "sync" LED is flashing instead of solid, and the time of year displayed on the front panel is showing day 6. The fb1 symmetricom driver and VME timing module are still both seeing day 299, though. So something may definitely be screwy with the GPS receiver.
|
|
12201
|
Mon Jun 20 11:19:41 2016 |
jamie | Configuration | CDS | GPS receiver not resetting properly |
I got the email from them. There was apparently a bug that manifested on February 14 2016. I'll try to software update today.
http://endruntechnologies.com/pdf/FSB160218.pdf
http://endruntechnologies.com/upgradetemplx.htm |
12202
|
Mon Jun 20 14:03:04 2016 |
jamie | Configuration | CDS | EndRun GPS receiver upgraded, fixed |
I just upgraded the EndRun Technologies Tempus LX GPS receiver timing unit, and it seems to have fixed all the problems. 
Thanks to Steve for getting the info from EndRun. There was indeed a bug in the firmware that was fixed with a firmware upgrade.
I upgraded both the system firmware and the firmware of the GPS subsystem:
Tempus LX GPS(root@Tempus:~)-> gntpversion
Tempus LX GPS 6010-0044-000 v 5.70 - Wed Oct 1 04:28:34 UTC 2014
Tempus LX GPS(root@Tempus:~)-> gpsversion
F/W 5.10 FPGA 0416
Tempus LX GPS(root@Tempus:~)->
After reboot the system is fully functional, displaying the correct time, and outputting the correct IRIG-B data, as confirmed by the VME timing unit.
I added a wiki page for the unit: https://wiki-40m.ligo.caltech.edu/NTP
Steve added this picture |
Attachment 1: GPSreceiverWorking.jpg
|
|
12376
|
Thu Aug 4 17:57:09 2016 |
Koji | Configuration | General | Don't restart apache2 - nodus /etc/apache2/sites-available/* accidentally deleted |
Late coming elog about the deletion of the apahce config files
Thu Aug 4 8:50ish 2016
Please don't restart apache2
I accidentally deleted four files in /etc/apache2/sites-available / on nodus. The deleted files were
elog nodus public_html svn
I believe public_html is not used as it is not linked from /etc/apache2/sites-enabled
They are the web server config files and need to be reconfigured manually. We have no backup.
Currently all the web services are running as it was. However, once apache2 is restarted, we'll lose the services.
|
12558
|
Thu Oct 13 14:49:57 2016 |
Koji | Configuration | PEM | XLR(F)-XLR(M) cable took from the fibox to the Blue microphone |
[Gautam Koji]
XLR(F)-XLR(M) cable for the blue microphone is missing. Steve ordered one.
We found one in the fibox setup. As we don't use it during the vent, we use this cable for the microphone.
Once we get the new one, it will go to the fibox setup.
|
12598
|
Thu Nov 3 16:30:42 2016 |
Lydia | Configuration | SUS | ETMX to coil matrix expanded |
[ericq, lydia]
Background:
We believe the optimal OSEM damping would use an input matrix diagonalized to the free swing modes of the optic, and an output matrix which drives the coils appropriately to damp these free swing modes. As was discovered, a free swinging optic does not necessarily have eigenmodes that match up perfectly with pitch and yaw, however in the current state the "TO_COIL" output matrix that determines the drive signals in response to the diagonlized sensor output also controls the drive signals for the oplevs, LSC/ASC, and alignment biases. So attempts to diagonalize the output matrix to agree with the input matrix have resulted in problems elsewhere. (See previous elog). So, we want to expand the "TO_COIL" matrices to treat the OSEM sensor inputs separately from the others.
Today:
- We modified the ETMX suspension model (c1scx) to use a modified copy of the sus_single_control block (sus_single_control_mod) that has 3 additional input columns. These are for the sensing modes determined by the input matrix, and are labeled "MODAL POS", "MODAL PIT", and "MODAL YAW."
- The regular POS, PIT, and YAW columns no longer include the diagonalized OSEM sensor signals for ETMX.
- The suspension screen now out of date; it doesn't show the new columns under Output Filters and the summed values displayed for each damping loop do not incluse the OSEM damping.
- The new matrix can be acessed at /opt/rtcds/caltech/c1/medm/c1scx/C1SUS_ETMX_TO_COIL.adl (see Attachment 1). For now, it has the naive values in the new columns so the damping behavior is the same.
- In trying to get a properly generated MEDM screen for the larger matrix, we discovered that the Simulink block for TO_COIL specifies in its description a custom template for the medm autogeneration. We made a new verion of that template with extra columns and new labels, which can be reused for the other suspensions. These templates are in /opt/rtcds/userapps/release/sus/c1/medm/templates, the new one is SUS_TO_COIL_MTRX_EXTRA.adl
- I will be setting the new column values to ones that represent the diagonlized free swing modes given by the input matrix. Hopefully this will improve OSEM damping without getting in the way of anything else. If this works well, the other SUS models can be changed the same way.
|
Attachment 1: 01.png
|
|
12721
|
Mon Jan 16 12:49:06 2017 |
rana | Configuration | Computers | Megatron update |
The "apt-get update" was failing on some machines because it couldn't find the 'Debian squeeze' repos, so I made some changes so that Megatron could be upgraded.
I think Jamie set this up for us a long time ago, but now the LSC has stopped supporting these versions of the software. We're running Ubuntu12 and 'squeeze' is meant to support Ubuntu10. Ubuntu12 (which is what LLO is running) corresponds to 'Debian-wheezy' and Ubuntu14 to 'Debian-Jessie' and Ubuntu16 to 'debian-stretch'.
We should consider upgrading a few of our workstations to Ubuntu 14 LTS to see how painful it is to run our scripts and DTT and DV. Better to upgrade a bit before we are forced to by circumstance.
I followed the instructions from software.ligo.org (https://wiki.ligo.org/DASWG/DebianWheezy) and put the recommended lines into the /etc/apt/sources.list.d/lsc-debian.list file.
but I still got 1 error (previously there were ~7 errors):
W: Failed to fetch http://software.ligo.org/lscsoft/debian/dists/wheezy/Release Unable to find expected entry 'contrib/binary-i386/Packages' in Release file (Wrong sources.list entry or malformed file)
Restarting now to see if things work. If its OK, we ought to change our squeeze lines into wheezy for all workstations so that our LSC software can be upgraded. |
12724
|
Mon Jan 16 22:03:30 2017 |
jamie | Configuration | Computers | Megatron update |
Quote: |
We should consider upgrading a few of our workstations to Ubuntu 14 LTS to see how painful it is to run our scripts and DTT and DV. Better to upgrade a bit before we are forced to by circumstance.
|
I would recommend upgrading the workstations to one of the reference operating systems, either SL7 or Debian squeeze, since that's what the sites are moving towards. If you do that you can just install all the control room software from the supported repos, and not worry about having to compile things from source anymore. |
12825
|
Mon Feb 13 17:19:41 2017 |
yinzi | Configuration | | configuring ethernet for raspberry pi |
Gautam and I were able to get the Raspberry Pi up and running today, including being able to ssh into it from the control room.
Below are some details about the setup/procedure that might be helpful to anyone trying to establish Ethernet connection for a new RPi, or a new operating system/SD card.
Here is the physical setup:


The changes that need to be made for a new Raspbian OS in order to communicate with it over ssh are as follows, with links to tutorials on how to do them:
1. Edit dhcpcd.conf file: https://www.modmypi.com/blog/how-to-give-your-raspberry-pi-a-static-ip-address-update
2. Edit interfaces file: https://www.mathworks.com/help/supportpkg/raspberrypi/ug/getting-the-raspberry_pi-ip-address.html
3. Enable ssh server: http://www.instructables.com/id/Use-ssh-to-talk-with-your-Raspberry-Pi/
The specific addresses for the RPi we set up today are:
IP Address: 192.168.113.107
Gateway/Routers/Domain Name Servers: 192.168.113.2
Netmask: 255.255.255.0
GV: I looked through /etc/var/bind/martian.hosts on chiara and decided to recycle the IP address for Domenica.martian as no RPis are plugged in right now... I'm also removing some of the attachments that seem to have been uploaded multiple times. |
12878
|
Thu Mar 9 20:38:19 2017 |
rana | Configuration | IOO | MC lock acquisition settings changed; no more HOM locks |
The MC was sort of misaligned. It was locking on some vertical HOMs. So I locked it and aligned the suspensions to the input beam (not great; we should really align the input beam to the centered spots on the MC mirrors).
With the HOMs reduced I looked at the MC servo board gains which Guatam has been fiddling with. It seems that since the Mod Depth change we're getting a lot more HOM locks. You can recognize this by seeing the longish stretches on the strip tool where FSS-FAST is going rail-to-rail at 0.03 Hz for many minutes. This is where the MC is locked on a HOM, but the autolocker still thinks its unlocked and so is driving the MC2 position at 0.03 Hz to find the TEM00 mode.
I lowered the input gain and the VCO gain in the mcdown script and now it very rarely locks on a HOM. The UGF in this state is ~3-4 kHz (I estimate), so its just enough to lock, but no more. I tested it by intentionally unlocking ~15 times. It seems robust. It still ramps up to a UGF of ~150 kHz as always. 'mcdown' commited to SVN. |
12935
|
Mon Apr 10 15:22:46 2017 |
rana | Configuration | Wiki | DokuWikis are back up |
AIC Wiki updated to latest stable version of DokuWiki: 2017-02-19b "Frusterick Manners" + CAPTCHA + Upgrade + Gallery PlugIns |
12943
|
Thu Apr 13 21:01:20 2017 |
rana | Configuration | Computers | LG UltraWide on Rossa |
we installed a new curved 34" doublewide monitor on Rossa, but it seems like it has a defective dead pixel region in it. Unless it heals itself by morning, we should return it to Amazon. Please don't throw out he packing materials.
Steve 8am next morning: it is still bad The monitor is cracked. It got kicked while traveling. It's box is damaged the same place.
Shipped back 4-17-2017 |
Attachment 1: LG34c.jpg
|
|
Attachment 2: crack.jpg
|
|
12965
|
Wed May 3 16:12:36 2017 |
johannes | Configuration | Computers | catastrophic multiple monitor failures |
It seems we lost three monitors basically overnight.
The main (landscape, left) displays of Pianosa, Rossa and Allegra are all broken with the same failure mode:
their backlights failed. Gautam and I confirmed that there is still an image displayed on all three, just incredibly faint. While Allegra hasn't been used much, we can narrow down that Pianosa's and Rossa's monitors must have failed within 5 or 6 hours of each other, last night.
One could say ... they turned to the dark side 

Quick edit; There was a functioning Dell 24" monitor next to the iMac that we used as a replacement for Pianosa's primary display. Once the new curved display is paired with Rossa we can use its old display for Donatella or Allegra. |
12966
|
Wed May 3 16:46:18 2017 |
Koji | Configuration | Computers | catastrophic multiple monitor failures |
- Is there any machine that can handle 4K? I have one 4K LCD for no use.
- I also can donate one 24" Dell |
12971
|
Thu May 4 09:52:43 2017 |
rana | Configuration | Computers | catastrophic multiple monitor failures |
That's a new failure mode. Probably we can't trust the power to be safe anymore.
Need Steve to order a couple of surge suppressing power strips for the monitors. The computers are already on the UPS, so they don't need it. |
12978
|
Tue May 9 15:23:12 2017 |
Steve | Configuration | Computers | catastrophic multiple monitor failures |
Gautam and Steve,
Surge protective power strip was install on Friday, May 5 in the Control Room
Computers not connected to the UPS are plugged into Isobar12ultra.
Quote: |
That's a new failure mode. Probably we can't trust the power to be safe anymore.
Need Steve to order a couple of surge suppressing power strips for the monitors. The computers are already on the UPS, so they don't need it.
|
|
Attachment 1: Trip-Lite.jpg
|
|
12993
|
Mon May 15 20:43:25 2017 |
rana | Configuration | Computers | catastrophic multiple monitor failures |
this is not the right one; this Ethernet controlled strip we want in the racks for remote control.
Buy some of these for the MONITORS.
Quote: |
Surge protective power strip was install on Friday, May 5 in the Control Room
Computers not connected to the UPS are plugged into Isobar12ultra.
Quote: |
That's a new failure mode. Probably we can't trust the power to be safe anymore.
Need Steve to order a couple of surge suppressing power strips for the monitors. The computers are already on the UPS, so they don't need it.
|
|
|
13009
|
Tue May 23 18:09:18 2017 |
Kaustubh | Configuration | General | Testing ET-3010 PD |
In continuation with the previous(ET-3040 PD) test.
The ET-3010 PD requires to be fiber coupled for optimal use. I will try to test this model without the fiber couple tomorrow and see whether it works or not. |
13070
|
Fri Jun 16 18:21:40 2017 |
jigyasa | Configuration | Cameras | GigE camera IP |
One of the additional GigE cameras has been IP configured for use and installation.
Static IP assigned to the camera- 192.168.113.152
Subnet mask- 255.255.255.0
Gateway- 192.168.113.2
|
13160
|
Wed Aug 2 15:04:15 2017 |
gautam | Configuration | Computers | control room workstation power distribution |
The 4 control room workstation CPUs (Rossa, Pianosa, Donatella and Allegra) are now connected to the UPS.
The 5 monitors are connected to the recently acquired surge-protecting power strips.
Rack-mountable power strip + spare APC Surge Arrest power strip have been stored in the electronics cabinet.
Quote: |
this is not the right one; this Ethernet controlled strip we want in the racks for remote control.
Buy some of these for the MONITORS.
|
|
13440
|
Tue Nov 21 17:51:01 2017 |
Koji | Configuration | Computers | nodus post OS migration admin |
The post OS migration admin for nodusa bout apache, elogd, svn, iptables, etc can be found in https://wiki-40m.ligo.caltech.edu/NodusUpgradeNov2017
Update: The svn dump from the old svn was done, and it was imported to the new svn repository structure. Now the svn command line and (simple) web interface is running. And "websvn" was also implemented. |
13442
|
Tue Nov 21 23:47:51 2017 |
gautam | Configuration | Computers | nodus post OS migration admin |
I restored the nodus crontab (copied over from the Nov 17 backup of the same at /opt/rtcds/caltech/c1/scripts/crontab/crontab_nodus.20171117080001. There wasn't a crontab, so I made one using sudo crontab -e.
This crontab is supposed to execute some backup scripts, send pizza emails, check chiara disk usage, and backup the crontab itself.
I've commented out the backup of nodus' /etc and /export for now, while we get back to fully operational nodus (though we also have a backup of /cvs/cds/caltech/nodus_backup on the external LaCie drive), they can be re-enabled by un-commenting the appropriate lines in the crontab.
Quote: |
The post OS migration admin for nodusa bout apache, elogd, svn, iptables, etc can be found in https://wiki-40m.ligo.caltech.edu/NodusUpgradeNov2017
Update: The svn dump from the old svn was done, and it was imported to the new svn repository structure. Now the svn command line and (simple) web interface is running. "websvn" is not installed.
|
|
13445
|
Wed Nov 22 11:51:38 2017 |
gautam | Configuration | Computers | nodus post OS migration admin |
Confirmed that this crontab is running - the daily backup of the crontab seems to have successfully executed, and there is now a file crontab_nodus.ligo.caltech.edu.20171122080001 in the directory quoted below. The $HOSTNAME seems to be "nodus.ligo.caltech.edu" whereas it was just "nodus", so the file names are a bit longer now, but I guess that's fine...
Quote: |
I restored the nodus crontab (copied over from the Nov 17 backup of the same at /opt/rtcds/caltech/c1/scripts/crontab/crontab_nodus.20171117080001. There wasn't a crontab, so I made one using sudo crontab -e.
This crontab is supposed to execute some backup scripts, send pizza emails, check chiara disk usage, and backup the crontab itself.
I've commented out the backup of nodus' /etc and /export for now, while we get back to fully operational nodus (though we also have a backup of /cvs/cds/caltech/nodus_backup on the external LaCie drive), they can be re-enabled by un-commenting the appropriate lines in the crontab.
|
|
13461
|
Sun Dec 3 05:25:59 2017 |
gautam | Configuration | Computers | sendmail installed on nodus |
Pizza mail didn't go out last weekend - looking at logfile, it seems like the "sendmail" service was missing. I installed sendmail following the instructions here: https://tecadmin.net/install-sendmail-server-on-centos-rhel-server/
Except that to start the sendmail service, I used systemctl and not init.d. i.e. I ran systemctl start sendmail.service (as root). Test email to myself works. Let's see if it works this weekend. Of course this isn't so critical, more important are the maintenance emails that may need to go out (e.g. disk usage alert on chiara / N2 pressure check, which looks like nodus' responsibilities). |
13462
|
Sun Dec 3 17:01:08 2017 |
Koji | Configuration | Computers | sendmail installed on nodus |
An email has come at 5PM on Dec 3rd.
|
13504
|
Fri Jan 5 17:50:47 2018 |
rana | Configuration | Computers | motif on nodus |
I had to do 'sudo yum install motif' on nodus so that we could get libXm.so.4 so that we could run MEDM. Works now. |