Hi

I have two machines  where in I simulated Multi node setup (2 compute nodes + 1 openstack controller + 1 Opendaylight)

Integrated stable kilo devstack and latest release of ODL Lithium SR1 to use ODL as neutron backend and L3 forwarder.

1. Able to create networks (net1 and net2) 

2. Able to launch VM's on the compute Nodes (VM1 in CN1 attached to net1 && VM2 in CN2 attached to net2)

3. Not able to ping between VM's, VM1 and VM2 

• GRE is the network type
• Enabled L3 forwarding in ODL - etc/custom.properties
• Some more attributes are added in Openstack controller to inform it that we are using L3 from ODL

local.conf files can be downloaded from here

compute Node local.conf : http://fpaste.org/263578/44136961/

password 12345

Controller Node local.conf : http://fpaste.org/263580/44136973/

password 12345

I am following the links : http://www.flaviof.com/blog/work/how-to-odl-with-openstack-part2.html

                                  http://www.flaviof.com/blog/work/how-to-odl-with-openstack-part1.html

As told in the link, when the gre tunnel is created, flows are populated in table 0 and table 110 across all the nodes and when the router is created and network interfaces are attached to it from Horizon UI

table 60 and 70 are not populated with L3 entries.

Controller :

vikram@vikram:~/devstack$ sudo ovs-ofctl -O OpenFlow13 dump-flows br-int
OFPST_FLOW reply (OF1.3) (xid=0x2):
 cookie=0x0, duration=270.507s, table=0, n_packets=0, n_bytes=0, tun_id=0x54,in_port=3 actions=load:0x2->NXM_NX_REG0[],goto_table:20
 cookie=0x0, duration=297.807s, table=0, n_packets=30, n_bytes=2600, tun_id=0x52,in_port=3 actions=load:0x2->NXM_NX_REG0[],goto_table:20
 cookie=0x0, duration=270.483s, table=0, n_packets=30, n_bytes=2600, tun_id=0x54,in_port=4 actions=load:0x2->NXM_NX_REG0[],goto_table:20
 cookie=0x0, duration=297.746s, table=0, n_packets=0, n_bytes=0, tun_id=0x52,in_port=4 actions=load:0x2->NXM_NX_REG0[],goto_table:20
 cookie=0x0, duration=298.237s, table=0, n_packets=1, n_bytes=78, priority=8192,in_port=1 actions=drop
 cookie=0x0, duration=270.554s, table=0, n_packets=0, n_bytes=0, priority=8192,in_port=5 actions=drop
 cookie=0x0, duration=298.172s, table=0, n_packets=20, n_bytes=2188, in_port=1,dl_src=fa:16:3e:0d:06:ab actions=set_field:0x52->tun_id,load:0x1->NXM_NX_REG0[],goto_table:20
 cookie=0x0, duration=270.557s, table=0, n_packets=25, n_bytes=2614, in_port=5,dl_src=fa:16:3e:fe:86:e6 actions=set_field:0x54->tun_id,load:0x1->NXM_NX_REG0[],goto_table:20
 cookie=0x0, duration=732.463s, table=0, n_packets=6, n_bytes=500, priority=0 actions=goto_table:20
 cookie=0x0, duration=733.381s, table=0, n_packets=183, n_bytes=20191, dl_type=0x88cc actions=CONTROLLER:65535
 cookie=0x0, duration=732.470s, table=20, n_packets=111, n_bytes=10502, priority=0 actions=goto_table:30
 cookie=0x0, duration=732.467s, table=30, n_packets=111, n_bytes=10502, priority=0 actions=goto_table:40
 cookie=0x0, duration=732.458s, table=40, n_packets=111, n_bytes=10502, priority=0 actions=goto_table:50
 cookie=0x0, duration=732.452s, table=50, n_packets=111, n_bytes=10502, priority=0 actions=goto_table:60
 cookie=0x0, duration=732.441s, table=60, n_packets=111, n_bytes=10502, priority=0 actions=goto_table:70
 cookie=0x0, duration=732.430s, table=70, n_packets=111, n_bytes=10502, priority=0 actions=goto_table:80
 cookie=0x0, duration=732.420s, table=80, n_packets=111, n_bytes=10502, priority=0 actions=goto_table:90
 cookie=0x0, duration=732.413s, table=90, n_packets=111, n_bytes=10502, priority=0 actions=goto_table:100
 cookie=0x0, duration=732.406s, table=100, n_packets=111, n_bytes=10502, priority=0 actions=goto_table:110
 cookie=0x0, duration=270.535s, table=110, n_packets=18, n_bytes=1558, priority=16384,reg0=0x2,tun_id=0x54,dl_dst=01:00:00:00:00:00/01:00:00:00:00:00 actions=output:5
 cookie=0x0, duration=297.820s, table=110, n_packets=18, n_bytes=1558, priority=16384,reg0=0x2,tun_id=0x52,dl_dst=01:00:00:00:00:00/01:00:00:00:00:00 actions=output:1
 cookie=0x0, duration=270.527s, table=110, n_packets=10, n_bytes=816, priority=16383,reg0=0x1,tun_id=0x54,dl_dst=01:00:00:00:00:00/01:00:00:00:00:00 actions=output:5,output:3,output:4
 cookie=0x0, duration=297.821s, table=110, n_packets=5, n_bytes=390, priority=16383,reg0=0x1,tun_id=0x52,dl_dst=01:00:00:00:00:00/01:00:00:00:00:00 actions=output:1,output:3,output:4
 cookie=0x0, duration=270.517s, table=110, n_packets=0, n_bytes=0, priority=8192,tun_id=0x54 actions=drop
 cookie=0x0, duration=297.816s, table=110, n_packets=0, n_bytes=0, priority=8192,tun_id=0x52 actions=drop
 cookie=0x0, duration=732.390s, table=110, n_packets=6, n_bytes=500, priority=0 actions=drop
 cookie=0x0, duration=199.481s, table=110, n_packets=15, n_bytes=1798, tun_id=0x54,dl_dst=fa:16:3e:df:52:36 actions=output:4
 cookie=0x0, duration=218.232s, table=110, n_packets=15, n_bytes=1798, tun_id=0x52,dl_dst=fa:16:3e:32:14:79 actions=output:3
 cookie=0x0, duration=270.544s, table=110, n_packets=12, n_bytes=1042, tun_id=0x54,dl_dst=fa:16:3e:fe:86:e6 actions=output:5
 cookie=0x0, duration=298.195s, table=110, n_packets=12, n_bytes=1042, tun_id=0x52,dl_dst=fa:16:3e:0d:06:ab actions=output:1

Compute 1:

vikram@compute1:~/devstack$ sudo ovs-ofctl -O OpenFlow13 dump-flows br-int
OFPST_FLOW reply (OF1.3) (xid=0x2):
 cookie=0x0, duration=298.610s, table=0, n_packets=15, n_bytes=1798, tun_id=0x52,in_port=1 actions=load:0x2->NXM_NX_REG0[],goto_table:20
 cookie=0x0, duration=298.610s, table=0, n_packets=0, n_bytes=0, tun_id=0x52,in_port=4 actions=load:0x2->NXM_NX_REG0[],goto_table:20
 cookie=0x0, duration=298.610s, table=0, n_packets=0, n_bytes=0, priority=8192,in_port=2 actions=drop
 cookie=0x0, duration=298.610s, table=0, n_packets=30, n_bytes=2600, in_port=2,dl_src=fa:16:3e:32:14:79 actions=set_field:0x52->tun_id,load:0x1->NXM_NX_REG0[],goto_table:20
 cookie=0x0, duration=298.610s, table=0, n_packets=36, n_bytes=2994, priority=0 actions=goto_table:20
 cookie=0x0, duration=298.610s, table=0, n_packets=1679, n_bytes=185259, dl_type=0x88cc actions=CONTROLLER:65535
 cookie=0x0, duration=298.609s, table=20, n_packets=80, n_bytes=7302, priority=0 actions=goto_table:30
 cookie=0x0, duration=298.610s, table=30, n_packets=80, n_bytes=7302, priority=0 actions=goto_table:40
 cookie=0x0, duration=298.610s, table=40, n_packets=69, n_bytes=6302, priority=0 actions=goto_table:50
 cookie=0x0, duration=298.609s, table=40, n_packets=11, n_bytes=1000, priority=36001,ip,in_port=2,dl_src=fa:16:3e:32:14:79,nw_src=1.0.0.2 actions=goto_table:50
 cookie=0x0, duration=298.609s, table=40, n_packets=0, n_bytes=0, priority=61011,udp,in_port=2,tp_src=67,tp_dst=68 actions=drop
 cookie=0x0, duration=298.610s, table=50, n_packets=80, n_bytes=7302, priority=0 actions=goto_table:60
 cookie=0x0, duration=298.610s, table=60, n_packets=80, n_bytes=7302, priority=0 actions=goto_table:70
 cookie=0x0, duration=298.609s, table=70, n_packets=80, n_bytes=7302, priority=0 actions=goto_table:80
 cookie=0x0, duration=298.610s, table=80, n_packets=80, n_bytes=7302, priority=0 actions=goto_table:90
 cookie=0x0, duration=298.609s, table=90, n_packets=78, n_bytes=6588, priority=0 actions=goto_table:100
 cookie=0x0, duration=298.609s, table=90, n_packets=2, n_bytes=714, priority=61006,udp,dl_src=fa:16:3e:0d:06:ab,tp_src=67,tp_dst=68 actions=goto_table:100
 cookie=0x0, duration=298.609s, table=100, n_packets=80, n_bytes=7302, priority=0 actions=goto_table:110
 cookie=0x0, duration=298.609s, table=110, n_packets=0, n_bytes=0, priority=8192,tun_id=0x52 actions=drop
 cookie=0x0, duration=298.610s, table=110, n_packets=0, n_bytes=0, priority=16384,reg0=0x2,tun_id=0x52,dl_dst=01:00:00:00:00:00/01:00:00:00:00:00 actions=output:2
 cookie=0x0, duration=298.610s, table=110, n_packets=18, n_bytes=1558, priority=16383,reg0=0x1,tun_id=0x52,dl_dst=01:00:00:00:00:00/01:00:00:00:00:00 actions=output:2,output:1,output:4
 cookie=0x0, duration=298.610s, table=110, n_packets=35, n_bytes=2904, priority=0 actions=drop
 cookie=0x0, duration=298.610s, table=110, n_packets=0, n_bytes=0, tun_id=0x54,dl_dst=fa:16:3e:df:52:36 actions=output:4
 cookie=0x0, duration=298.611s, table=110, n_packets=15, n_bytes=1798, tun_id=0x52,dl_dst=fa:16:3e:32:14:79 actions=output:2
 cookie=0x0, duration=298.611s, table=110, n_packets=0, n_bytes=0, tun_id=0x54,dl_dst=fa:16:3e:fe:86:e6 actions=output:1
 cookie=0x0, duration=298.611s, table=110, n_packets=12, n_bytes=1042, tun_id=0x52,dl_dst=fa:16:3e:0d:06:ab actions=output:1

Compute2:

vikram@compute2:~/devstack$  sudo ovs-ofctl -O OpenFlow13 dump-flows br-int
OFPST_FLOW reply (OF1.3) (xid=0x2):
 cookie=0x0, duration=238.077s, table=0, n_packets=0, n_bytes=0, tun_id=0x54,in_port=2 actions=load:0x2->NXM_NX_REG0[],goto_table:20
 cookie=0x0, duration=238.100s, table=0, n_packets=15, n_bytes=1798, tun_id=0x54,in_port=1 actions=load:0x2->NXM_NX_REG0[],goto_table:20
 cookie=0x0, duration=238.146s, table=0, n_packets=0, n_bytes=0, priority=8192,in_port=3 actions=drop
 cookie=0x0, duration=238.150s, table=0, n_packets=30, n_bytes=2600, in_port=3,dl_src=fa:16:3e:df:52:36 actions=set_field:0x54->tun_id,load:0x1->NXM_NX_REG0[],goto_table:20
 cookie=0x0, duration=406.202s, table=0, n_packets=18, n_bytes=1436, priority=0 actions=goto_table:20
 cookie=0x0, duration=408.075s, table=0, n_packets=166, n_bytes=18528, dl_type=0x88cc actions=CONTROLLER:65535
 cookie=0x0, duration=406.194s, table=20, n_packets=62, n_bytes=5744, priority=0 actions=goto_table:30
 cookie=0x0, duration=406.190s, table=30, n_packets=62, n_bytes=5744, priority=0 actions=goto_table:40
 cookie=0x0, duration=406.174s, table=40, n_packets=51, n_bytes=4744, priority=0 actions=goto_table:50
 cookie=0x0, duration=238.160s, table=40, n_packets=11, n_bytes=1000, priority=36001,ip,in_port=3,dl_src=fa:16:3e:df:52:36,nw_src=2.0.0.2 actions=goto_table:50
 cookie=0x0, duration=238.167s, table=40, n_packets=0, n_bytes=0, priority=61011,udp,in_port=3,tp_src=67,tp_dst=68 actions=drop
 cookie=0x0, duration=406.170s, table=50, n_packets=62, n_bytes=5744, priority=0 actions=goto_table:60
 cookie=0x0, duration=406.165s, table=60, n_packets=62, n_bytes=5744, priority=0 actions=goto_table:70
 cookie=0x0, duration=406.160s, table=70, n_packets=62, n_bytes=5744, priority=0 actions=goto_table:80
 cookie=0x0, duration=406.154s, table=80, n_packets=62, n_bytes=5744, priority=0 actions=goto_table:90
 cookie=0x0, duration=406.149s, table=90, n_packets=60, n_bytes=5030, priority=0 actions=goto_table:100
 cookie=0x0, duration=238.174s, table=90, n_packets=2, n_bytes=714, priority=61006,udp,dl_src=fa:16:3e:fe:86:e6,tp_src=67,tp_dst=68 actions=goto_table:100
 cookie=0x0, duration=406.142s, table=100, n_packets=62, n_bytes=5744, priority=0 actions=goto_table:110
 cookie=0x0, duration=238.106s, table=110, n_packets=0, n_bytes=0, priority=8192,tun_id=0x54 actions=drop
 cookie=0x0, duration=238.132s, table=110, n_packets=0, n_bytes=0, priority=16384,reg0=0x2,tun_id=0x54,dl_dst=01:00:00:00:00:00/01:00:00:00:00:00 actions=output:3
 cookie=0x0, duration=238.120s, table=110, n_packets=18, n_bytes=1558, priority=16383,reg0=0x1,tun_id=0x54,dl_dst=01:00:00:00:00:00/01:00:00:00:00:00 actions=output:3,output:1,output:2
 cookie=0x0, duration=406.128s, table=110, n_packets=17, n_bytes=1346, priority=0 actions=drop
 cookie=0x0, duration=238.140s, table=110, n_packets=15, n_bytes=1798, tun_id=0x54,dl_dst=fa:16:3e:df:52:36 actions=output:3
 cookie=0x0, duration=309.071s, table=110, n_packets=12, n_bytes=1042, tun_id=0x54,dl_dst=fa:16:3e:fe:86:e6 actions=output:1
 cookie=0x0, duration=336.348s, table=110, n_packets=0, n_bytes=0, tun_id=0x52,dl_dst=fa:16:3e:0d:06:ab actions=output:1

Logs are attached

Thanks

Vikram