Oracle RAC 11.2.0.4 – add another ethernet to interconnect

Instead of bonding you can use Oracle cluster interconnect HAIP for using multiple ethernets.
And here is how its done 🙂

At the begining I have one interconnect – eth1:

SQL> select * from GV$CLUSTER_INTERCONNECTS;

   INST_ID NAME 	   IP_ADDRESS	    IS_ SOURCE
---------- --------------- ---------------- --- -------------------------------
	 1 eth1:1	   169.254.160.183  NO
	 2 eth1:1	   169.254.83.127   NO

To add another one (eth3), I will use an oifcfg tool:

[root@rico ~]# ifconfig eth3 | grep "addr"
eth3      Link encap:Ethernet  HWaddr 08:00:27:C8:72:97  
          inet addr:10.1.0.1  Bcast:10.1.0.255  Mask:255.255.255.0
          inet6 addr: fe80::a00:27ff:fec8:7297/64 Scope:Link
[root@rico ~]# ssh kowalsky "ifconfig eth3 | grep addr"
root@kowalsky's password: 
eth3      Link encap:Ethernet  HWaddr 08:00:27:69:39:73  
          inet addr:10.1.0.2  Bcast:10.1.0.255  Mask:255.255.255.0
          inet6 addr: fe80::a00:27ff:fe69:3973/64 Scope:Link

[root@rico ~]# oifcfg setif -global eth3/10.1.0.0:cluster_interconnect
[root@rico ~]# oifcfg getif
eth0  192.168.56.0  global  public
eth1  10.0.0.0  global  cluster_interconnect
eth3  10.1.0.0  global  cluster_interconnect

Now the restart of the CRS on all nodes is required for changes to be effective.

SQL> select * from GV$CLUSTER_INTERCONNECTS;

   INST_ID NAME 	   IP_ADDRESS	    IS_ SOURCE
---------- --------------- ---------------- --- -------------------------------
	 1 eth1:1	   169.254.74.205   NO
	 1 eth3:1	   169.254.228.254  NO
	 2 eth1:1	   169.254.127.172  NO
	 2 eth3:1	   169.254.244.158  NO