So it turns out that the card that Rolf had given me was not a Dolphin host adapter after all. He did have an actual host adapter board on hand, though, and kindly let us take it. And this one works!
I installed the new board in c1ioo, and it recognized it. Upon boot, the dolphin configuration scripts managed to automatically recognize the card, load the necessary kernel modules, and configure it. I'll describe below how I got everything working.
However, at some point mx_stream stopped working on c1ioo. I have no idea why, and it shouldn't be related to any of this dolphin stuff at all. But given that mx_stream stopped working at the same time the dolphin stuff started working, I didn't take any chances and completely backed out all the dolphin stuff on c1ioo, including removing the dolphin host adapter from the chassis all together. Unfortunately that didn't fix any of the mx_stream issues, so mx_stream continues to not work on c1ioo. I'll follow up in a separate post about that. In the meantime, here's what I did to get dolphin working on c1ioo:
c1ioo Dolphin configuration
To get the new host recognized on the Dolphin network, I had to make a couple of changes to the dolphin manager setup on fb. I referenced the following page:
https://cdswiki.ligo-la.caltech.edu/foswiki/bin/view/CDS/DolphinHowTo
Below are the two patches I made to the dolphin ("dis") config files on fb:
--- /etc/dis/dishosts.conf.bak 2014-04-17 09:31:08.000000000 -0700
+++ /etc/dis/dishosts.conf 2014-04-17 09:28:27.000000000 -0700
@@ -26,6 +26,8 @@
ADAPTER: c1sus_a0 8 0 4
HOSTNAME: c1lsc
ADAPTER: c1lsc_a0 12 0 4
+HOSTNAME: c1ioo
+ADAPTER: c1ioo_a0 16 0 4
# Here we define a socket adapter in single mode.
#SOCKETADAPTER: sockad_0 SINGLE 0
--- /etc/dis/networkmanager.conf.bak 2014-04-17 09:30:40.000000000 -0700
+++ /etc/dis/networkmanager.conf 2014-04-17 09:30:48.000000000 -0700
@@ -39,7 +39,7 @@
# Number of nodes in X Dimension. If you are using a single ring, please
# specify number of nodes in ring.
--dimensionX 2;
+-dimensionX 3;
# Number of nodes in Y Dimension.
I then had to restart the DIS network manager to see these changes take affect:
$ sudo /etc/init.d/dis_networkmgr restart
I then rebooted c1ioo one more time, after which c1ioo showed up in the dxadmin GUI.
At this point I tried adding a dolphin IPC connection between c1als and c1lsc to see if it worked. Unfortunately everything crashed every time I tried to run the models (including models on other machines!). The problem was that I had forgotten to tell the c1ioo IOP (c1x03) to use PCIe RFM (i.e. Dolphin). This is done by adding the following flag to the cdsParamters block in the IOP:
pciRfm=1
Once this was added, and the IOP was rebuilt/installed/restarted and came back up fine. The c1als model with the dolphin output also came up fine.
However, at this point I ran into the c1ioo mx_stream problem and started backing everything out.
|