There were no testpoints according to DTT and DV - This is because:
/cvs/cds/caltech/target/gds/param/tpchn_M1.par was commented out of /cvs/cds/caltech/target/fb/master.
Changing this solved (some of) the problems we encountered.
We also encountered an unkillable frontend process at some point -
The above appeared to be correlated with running startatf a number of times, (so killing and restarting everything repetitively.) We have zero interest in trying to repeat the unkillable bug so we rebooted oms and everything seemed ok.
pkill can not slay the processes spawned by the .rtl files, because they are kernel modules, and thus operate in a lower domain. Sometimes you may invoke the demon of /sbin/rmmod instead of rebooting.