40m QIL Cryo_Lab CTN SUS_Lab TCS_Lab OMC_Lab CRIME_Lab FEA ENG_Labs OptContFac Mariner WBEEShop
  40m Log  Not logged in ELOG logo
Entry  Thu Apr 17 11:00:54 2014, jamie, Update, CDS, failed attempt to get Dolphin working on c1ioo 
    Reply  Thu Apr 17 16:59:45 2014, jamie, Update, CDS, slightly more successful attempt to get Dolphin working on c1ioo 
       Reply  Wed Apr 30 17:07:19 2014, jamie, Update, CDS, c1ioo now on Dolphin network dolphin.pngALSXonDolphin.pdf
          Reply  Wed Apr 30 17:45:34 2014, jamie, Update, CDS, c1ioo now on Dolphin network 
          Reply  Thu May 1 10:23:42 2014, jamie, Update, CDS, c1ioo dolphin fiber nicely routed green.png
             Reply  Fri May 2 01:01:28 2014, rana, Update, CDS, c1ioo dolphin fiber nicely routed 
                Reply  Fri May 2 11:14:47 2014, jamie, Update, CDS, c1ioo dolphin fiber nicely routed 
             Reply  Tue May 6 10:22:28 2014, steve, Update, CDS, c1ioo dolphin fiber  dolphin1x2.png
                Reply  Tue May 6 10:31:58 2014, jamie, Update, CDS, c1ioo dolphin fiber  
Message ID: 9824     Entry time: Thu Apr 17 16:59:45 2014     In reply to: 9822     Reply to this: 9881
Author: jamie 
Type: Update 
Category: CDS 
Subject: slightly more successful attempt to get Dolphin working on c1ioo 

So it turns out that the card that Rolf had given me was not a Dolphin host adapter after all.  He did have an actual host adapter board on hand, though, and kindly let us take it.  And this one works!

I installed the new board in c1ioo, and it recognized it.  Upon boot, the dolphin configuration scripts managed to automatically recognize the card, load the necessary kernel modules, and configure it.  I'll describe below how I got everything working.

However, at some point mx_stream stopped working on c1ioo.  I have no idea why, and it shouldn't be related to any of this dolphin stuff at all.  But given that mx_stream stopped working at the same time the dolphin stuff started working, I didn't take any chances and completely backed out all the dolphin stuff on c1ioo, including removing the dolphin host adapter from the chassis all together.  Unfortunately that didn't fix any of the mx_stream issues, so mx_stream continues to not work on c1ioo.  I'll follow up in a separate post about that.  In the meantime, here's what I did to get dolphin working on c1ioo:

c1ioo Dolphin configuration

To get the new host recognized on the Dolphin network, I had to make a couple of changes to the dolphin manager setup on fb.  I referenced the following page:

https://cdswiki.ligo-la.caltech.edu/foswiki/bin/view/CDS/DolphinHowTo

Below are the two patches I made to the dolphin ("dis") config files on fb:

--- /etc/dis/dishosts.conf.bak    2014-04-17 09:31:08.000000000 -0700
+++ /etc/dis/dishosts.conf    2014-04-17 09:28:27.000000000 -0700
@@ -26,6 +26,8 @@
 ADAPTER:  c1sus_a0 8 0 4
 HOSTNAME: c1lsc
 ADAPTER:  c1lsc_a0 12 0 4
+HOSTNAME: c1ioo
+ADAPTER:  c1ioo_a0 16 0 4
 
 # Here we define a socket adapter in single mode.
 #SOCKETADAPTER: sockad_0 SINGLE 0

--- /etc/dis/networkmanager.conf.bak    2014-04-17 09:30:40.000000000 -0700
+++ /etc/dis/networkmanager.conf    2014-04-17 09:30:48.000000000 -0700
@@ -39,7 +39,7 @@
 # Number of nodes in X Dimension. If you are using a single ring, please
 # specify number of nodes in ring.
 
--dimensionX 2;
+-dimensionX 3;
 
 # Number of nodes in Y Dimension.

I then had to restart the DIS network manager to see these changes take affect:

$ sudo /etc/init.d/dis_networkmgr restart

I then rebooted c1ioo one more time, after which c1ioo showed up in the dxadmin GUI.

At this point I tried adding a dolphin IPC connection between c1als and c1lsc to see if it worked.  Unfortunately everything crashed every time I tried to run the models (including models on other machines!).  The problem was that I had forgotten to tell the c1ioo IOP (c1x03) to use PCIe RFM (i.e. Dolphin).  This is done by adding the following flag to the cdsParamters block in the IOP:

pciRfm=1

Once this was added, and the IOP was rebuilt/installed/restarted and came back up fine.  The c1als model with the dolphin output also came up fine.

However, at this point I ran into the c1ioo mx_stream problem and started backing everything out.

 

ELOG V3.1.3-