40m QIL Cryo_Lab CTN SUS_Lab TCS_Lab OMC_Lab CRIME_Lab FEA ENG_Labs OptContFac Mariner WBEEShop
  40m Log  Not logged in ELOG logo
Entry  Tue May 8 11:41:16 2018, gautam, Update, General, IFO maintenance ITMX_stuck.png
    Reply  Wed May 9 17:30:04 2018, gautam, Update, General, Input beam misaligned InputBeamGone.pngTTpointing.png
       Reply  Wed May 9 19:51:07 2018, gautam, Update, General, Input beam misaligned DACweirdness.pngDACerror.png
          Reply  Sun May 13 15:15:18 2018, gautam, Update, General, CDS crash vertexFEs_crashed.png
             Reply  Sun May 13 17:31:51 2018, gautam, Update, General, CDS crash CDS_overview_20180513.pngAS_1210293643.jpeg
                Reply  Sun May 13 20:48:38 2018, johannes, Update, General, CDS crash 
                Reply  Thu May 17 11:56:37 2018, gautam, Update, General, EPICS process died on c1ioo 
                   Reply  Thu May 24 10:16:29 2018, gautam, Update, General, All models on c1lsc frontend crashed c1lsc_crashed.png
    Reply  Thu May 10 08:45:16 2018, Steve, Update, General, 4.5M eq. Cabazon, CA Cabazon4.5m79m.png4.5Meq.png
       Reply  Thu May 10 11:38:19 2018, gautam, Update, General, ITMY UL ITMY_UL.pdf
       Reply  Wed Aug 22 08:44:09 2018, Steve, Update, General, earth quake yesterday_EQs.png
          Reply  Fri Aug 24 08:04:37 2018, Steve, Update, General, small earth quake small_EQ.png
             Reply  Mon Aug 27 09:14:45 2018, Steve, Update, PEM, small earth quakes  small_EQs_vs_SUSs.png
                Reply  Tue Nov 27 10:50:20 2018, Steve, Update, PEM, earth quake Mexico 5.5M.Mexico.png
                   Reply  Thu Nov 29 08:13:33 2018, Steve, Update, PEM, EQ 3.9m So CA 3.9mSoCA.pngVac_as_today.pngas_is.png
          Reply  Wed Aug 29 09:20:27 2018, Steve, Update, SUS, local 4.4M earth quake 4.4_La_Verne.png3.4_&_4.4M_EQ.png
             Reply  Wed Aug 29 11:46:27 2018, Jon, Update, SUS, local 4.4M earth quake 
             Reply  Thu Sep 20 08:17:14 2018, Steve, Update, SUS, local 3.4M earth quake local_3.4M.png
Message ID: 13839     Entry time: Sun May 13 20:48:38 2018     In reply to: 13838
Author: johannes 
Type: Update 
Category: General 
Subject: CDS crash 

I think the root of the problem is that the /opt/rtapps/ and /cvs/cds/rtapps/ mounting locations point to the same directory on the nfs server. Gautam and I were cleaning up the /cvs/cds/caltech/target/ directory, placing the previous contents of /cvs/cds/caltech/target/c1auxex/, including database files and startup instructions in /cvs/cds/caltech/target/c1auxex_oldVME/, and then moved /cvs/cds/caltech/target/c1auxex2/, which has the channel database and initialization files for the Acromac DAQ, to /cvs/cds/caltech/target/c1auxex/.

This also required updating the systemd entries on c1auxex to point to the changed directory. While confirming that everything worked as before we noticed that upon startup the EPICS IOC complains about not being able to find the caRepeater binary. This was not new and has not limited DAQ functionality in the past, but we wanted to fix this, as it seemed to be some simple PATH issue. While the paths are all correctly defined in the user login shell, systemd runs on a lower level and doesn't know about them. One thing we tried was to let systemd execute /cvs/cds/rtapps/epics-3.14.12.2_long/etc/epics-user-env.sh initializing EPICS. It was strange that the content of that file was pointing to /opt/rtapps/epics-3.14.12.2_long/base, which is not mounted on the slow machines, so we changed the /opt/ it to /cvs/cds/, not realizing that the frontends read from the same directory (as Gautam said, /cvs/cds does not exist as a mount point on the frontend). It ended up not working this way, and apparently I forgot to change it back during clean up. But worse, never elogged it!

In the end, we managed to to give systemd the correct path definitions by explicitly calling them out in /cvs/cds/caltech/target/c1auxex/ETMXenv, to which a reference was added in the systemd service file. The caRepeater warning no longer appears.

ELOG V3.1.3-