Rana and I now seem to have the fast front end computers (c1lsc, c1sus, c1ioo, c1iscex and c1iscey) up and running! Hooray!
It seemed that we needed to change the soft links back to hard links for rtcds and rtapps on the front end machines. On c1ioo, we did:
cd /opt
sudo rm -rf rtcds
sudo rm -rf rtapps
sudo mkdir rtcds
sudo mkdir rtapps
sudo chown controls:1001 rtcds
sudo chown controls:1001 rtapps
mount /opt/rtcds
mount /opt/rtapps
At this time, the front end fstab had several other options in addition to "nolock" for both rtcds and rtapps. They had rw,bg,user,nolock. This state still had some permissions problems. (Later, we have decided that perhaps our next step was unneccesary, since it still left us with (fewer) permissions problems. Taking out the rw,bg,user options from the front end fstab seems to have fixed all permissions issues, so maybe this next chmod step didn't need to be done. But it was done, so I record it for completeness).
On chiara, we did:
cd /home/cds/rtcds
sudo chmod -R 777 *
Then on c1iscex, I didn't have to deal with the soft links, but I did need to mount the rtcds and rtapps directories so that I could see files in them. I just did the last 2 operations from the c1ioo list above (mount /opt/rtcds and mount /opt/rtapps ).
Since we were still seeing some (fewer) permissions problems, we took out the extra options in the front ends' fstab that Rana had added. Rebooting c1iscex after this, everything came back as expected. Nice!
I think that, at this point, remotely rebooting (sudo shutdown -r now) the other front ends made everything come back nicely. Since we had gotten the fstab situation correct, we didn't have to by-hand mount any directories, and all of the models restarted on their own. Finally!
For posterity, here are things that we'll want to remember:
Frame builder's fstab, in /etc/fstab (only the uncommented lines, since there are lots of comments):
/dev/sdb1 / ext3 noatime 0 1
/swapfile none swap sw 0 0
shm /dev/shm tmpfs nodev,nosuid,noexec 0 0
/dev/sda1 /frames ext3 noatime 0 0
192.168.113.104:/home/cds/ /cvs/cds nfs _netdev,auto,rw,bg,soft 0 0
192.168.113.104:/home/cds/rtcds /opt/rtcds nfs _netdev,auto,rw,bg,soft 0 0
192.168.113.104:/home/cds/rtapps /opt/rtapps nfs _netdev,auto,rw,bg,soft 0 0
Fast front end fstabs, which are on the framebuilder in /diskless/root/etc/fstab:
master:/diskless/root / nfs sync,hard,intr,rw,nolock,rsize=8192,wsize=8192 0 0
master:/usr /usr nfs sync,hard,intr,ro,nolock,rsize=8192,wsize=8192 0 0
master:/home /home nfs sync,hard,intr,rw,nolock,rsize=8192,wsize=8192 0 0
none /proc proc defaults 0 0
none /var/log tmpfs size=100m,rw 0 0
none /var/lib/init.d tmpfs size=100m,rw 0 0
none /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620 0 0
none /sys sysfs defaults 0 0
master:/opt /opt nfs async,hard,intr,rw,nolock 0 0
192.168.113.104:/home/cds/rtcds /opt/rtcds nfs nolock 0 0
192.168.113.104:/home/cds/rtapps /opt/rtapps nfs nolock 0 0
|