40m QIL Cryo_Lab CTN SUS_Lab TCS_Lab OMC_Lab CRIME_Lab FEA ENG_Labs OptContFac Mariner WBEEShop
  40m Log  Not logged in ELOG logo
Entry  Wed Jul 13 17:30:19 2022, Koji, Update, CDS, Too huge script_archive 
    Reply  Thu Jul 28 15:11:59 2022, Koji, Update, CDS, Too huge script_archive 
Message ID: 17000     Entry time: Wed Jul 13 17:30:19 2022     Reply to this: 17043
Author: Koji 
Type: Update 
Category: CDS 
Subject: Too huge script_archive 

I wanted to check the script archive to see some old settings. I found that the script archive inflated to huge volume (~1TB).
The size of the common NFS volume (/cvs/cds) is 3TB. So it is really significant.

- The scripts living in /opt/rtcds/caltech/c1/scripts are archived daily in /cvs/cds/caltech/scripts_archive as bz2 files. This is done by crontab of megatron (see https://wiki-40m.ligo.caltech.edu/Computers_and_Scripts/CRON)

- In fact, the script folder (say old script folder) /opt/rtcds/caltech/c1/scripts has the size of 10GB. And we have the compressed copy of thi s everyday.

- This large script folder is due to a couple of huge files/folders listed below

  • (scripts)/MEDMtab is 5.3GB / This is probably related to the web MEDM view (on nodus) but I don't think the web page is not updated. (i.e. the images are unused)
  • (scripts)/MC/logs/AutoLocker.log 2.9GB / This is just the accumulated MC autolocker log.
  • (scripts)/GigE 780M / This does not look like scripts but source and object files
  • (scripts)/Admin/n2Check.log 224M / This is important but increases every minute.
  • (scripts)/ZI 316MB / Zurich Instrument installation. This should not be here.

Here I propose some changes.
For the script archive

  • We can remove most of the scripts for the past (say ~2019). We leave an archive file per month.
  • For the scripts in 2020, we leave a weekly archive.
  • For 2021 and 2022, we leave all the archive files.

For the existing large files/folders

  • MEDMtab: the stored files are redundant with the burt snapshots. Remove the image files. Also, we want to move the image-saving location.
  • Autolocker.log: simply zap it
  • n2Check.log: we should move the saving location
  • GigE /ZI: they need a new home where the daily copy is not taken.
ELOG V3.1.3-