Hi
I have two machines where in I simulated Multi node setup (2 compute nodes + 1 openstack controller + 1 Opendaylight)
Integrated stable kilo devstack and latest release of ODL Lithium SR1 to use ODL as neutron backend and L3 forwarder.
1. Able to create networks (net1 and net2)
2. Able to launch VM's on the compute Nodes (VM1 in CN1 attached to net1 && VM2 in CN2 attached to net2)
3. Not able to ping between VM's, VM1 and VM2
- GRE is the network type
- Enabled L3 forwarding in ODL - etc/custom.properties
- Some more attributes are added in Openstack controller to inform it that we are using L3 from ODL
local.conf files can be downloaded from here
compute Node local.conf : http://fpaste.org/263578/44136961/
password 12345
Controller Node local.conf : http://fpaste.org/263580/44136973/
password 12345
I am following the links : http://www.flaviof.com/blog/work/how-to-odl-with-openstack-part2.html
http://www.flaviof.com/blog/work/how-to-odl-with-openstack-part1.html
As told in the link, when the gre tunnel is created, flows are populated in table 0 and table 110 across all the nodes and when the router is created and network interfaces are attached to it from Horizon UI
table 60 and 70 are not populated with L3 entries.
Controller :
vikram@vikram:~/devstack$ sudo ovs-ofctl -O OpenFlow13 dump-flows br-int
OFPST_FLOW reply (OF1.3) (xid=0x2):
cookie=0x0, duration=270.507s, table=0, n_packets=0, n_bytes=0, tun_id=0x54,in_port=3 actions=load:0x2->NXM_NX_REG0[],goto_table:20
cookie=0x0, duration=297.807s, table=0, n_packets=30, n_bytes=2600, tun_id=0x52,in_port=3 actions=load:0x2->NXM_NX_REG0[],goto_table:20
cookie=0x0, duration=270.483s, table=0, n_packets=30, n_bytes=2600, tun_id=0x54,in_port=4 actions=load:0x2->NXM_NX_REG0[],goto_table:20
cookie=0x0, duration=297.746s, table=0, n_packets=0, n_bytes=0, tun_id=0x52,in_port=4 actions=load:0x2->NXM_NX_REG0[],goto_table:20
cookie=0x0, duration=298.237s, table=0, n_packets=1, n_bytes=78, priority=8192,in_port=1 actions=drop
cookie=0x0, duration=270.554s, table=0, n_packets=0, n_bytes=0, priority=8192,in_port=5 actions=drop
cookie=0x0, duration=298.172s, table=0, n_packets=20, n_bytes=2188, in_port=1,dl_src=fa:16:3e:0d:06:ab actions=set_field:0x52->tun_id,load:0x1->NXM_NX_REG0[],goto_table:20
cookie=0x0, duration=270.557s, table=0, n_packets=25, n_bytes=2614, in_port=5,dl_src=fa:16:3e:fe:86:e6 actions=set_field:0x54->tun_id,load:0x1->NXM_NX_REG0[],goto_table:20
cookie=0x0, duration=732.463s, table=0, n_packets=6, n_bytes=500, priority=0 actions=goto_table:20
cookie=0x0, duration=733.381s, table=0, n_packets=183, n_bytes=20191, dl_type=0x88cc actions=CONTROLLER:65535
cookie=0x0, duration=732.470s, table=20, n_packets=111, n_bytes=10502, priority=0 actions=goto_table:30
cookie=0x0, duration=732.467s, table=30, n_packets=111, n_bytes=10502, priority=0 actions=goto_table:40
cookie=0x0, duration=732.458s, table=40, n_packets=111, n_bytes=10502, priority=0 actions=goto_table:50
cookie=0x0, duration=732.452s, table=50, n_packets=111, n_bytes=10502, priority=0 actions=goto_table:60
cookie=0x0, duration=732.441s, table=60, n_packets=111, n_bytes=10502, priority=0 actions=goto_table:70
cookie=0x0, duration=732.430s, table=70, n_packets=111, n_bytes=10502, priority=0 actions=goto_table:80
cookie=0x0, duration=732.420s, table=80, n_packets=111, n_bytes=10502, priority=0 actions=goto_table:90
cookie=0x0, duration=732.413s, table=90, n_packets=111, n_bytes=10502, priority=0 actions=goto_table:100
cookie=0x0, duration=732.406s, table=100, n_packets=111, n_bytes=10502, priority=0 actions=goto_table:110
cookie=0x0, duration=270.535s, table=110, n_packets=18, n_bytes=1558, priority=16384,reg0=0x2,tun_id=0x54,dl_dst=01:00:00:00:00:00/01:00:00:00:00:00 actions=output:5
cookie=0x0, duration=297.820s, table=110, n_packets=18, n_bytes=1558, priority=16384,reg0=0x2,tun_id=0x52,dl_dst=01:00:00:00:00:00/01:00:00:00:00:00 actions=output:1
cookie=0x0, duration=270.527s, table=110, n_packets=10, n_bytes=816, priority=16383,reg0=0x1,tun_id=0x54,dl_dst=01:00:00:00:00:00/01:00:00:00:00:00 actions=output:5,output:3,output:4
cookie=0x0, duration=297.821s, table=110, n_packets=5, n_bytes=390, priority=16383,reg0=0x1,tun_id=0x52,dl_dst=01:00:00:00:00:00/01:00:00:00:00:00 actions=output:1,output:3,output:4
cookie=0x0, duration=270.517s, table=110, n_packets=0, n_bytes=0, priority=8192,tun_id=0x54 actions=drop
cookie=0x0, duration=297.816s, table=110, n_packets=0, n_bytes=0, priority=8192,tun_id=0x52 actions=drop
cookie=0x0, duration=732.390s, table=110, n_packets=6, n_bytes=500, priority=0 actions=drop
cookie=0x0, duration=199.481s, table=110, n_packets=15, n_bytes=1798, tun_id=0x54,dl_dst=fa:16:3e:df:52:36 actions=output:4
cookie=0x0, duration=218.232s, table=110, n_packets=15, n_bytes=1798, tun_id=0x52,dl_dst=fa:16:3e:32:14:79 actions=output:3
cookie=0x0, duration=270.544s, table=110, n_packets=12, n_bytes=1042, tun_id=0x54,dl_dst=fa:16:3e:fe:86:e6 actions=output:5
cookie=0x0, duration=298.195s, table=110, n_packets=12, n_bytes=1042, tun_id=0x52,dl_dst=fa:16:3e:0d:06:ab actions=output:1
Compute 1:
vikram@compute1:~/devstack$ sudo ovs-ofctl -O OpenFlow13 dump-flows br-int
OFPST_FLOW reply (OF1.3) (xid=0x2):
cookie=0x0, duration=298.610s, table=0, n_packets=15, n_bytes=1798, tun_id=0x52,in_port=1 actions=load:0x2->NXM_NX_REG0[],goto_table:20
cookie=0x0, duration=298.610s, table=0, n_packets=0, n_bytes=0, tun_id=0x52,in_port=4 actions=load:0x2->NXM_NX_REG0[],goto_table:20
cookie=0x0, duration=298.610s, table=0, n_packets=0, n_bytes=0, priority=8192,in_port=2 actions=drop
cookie=0x0, duration=298.610s, table=0, n_packets=30, n_bytes=2600, in_port=2,dl_src=fa:16:3e:32:14:79 actions=set_field:0x52->tun_id,load:0x1->NXM_NX_REG0[],goto_table:20
cookie=0x0, duration=298.610s, table=0, n_packets=36, n_bytes=2994, priority=0 actions=goto_table:20
cookie=0x0, duration=298.610s, table=0, n_packets=1679, n_bytes=185259, dl_type=0x88cc actions=CONTROLLER:65535
cookie=0x0, duration=298.609s, table=20, n_packets=80, n_bytes=7302, priority=0 actions=goto_table:30
cookie=0x0, duration=298.610s, table=30, n_packets=80, n_bytes=7302, priority=0 actions=goto_table:40
cookie=0x0, duration=298.610s, table=40, n_packets=69, n_bytes=6302, priority=0 actions=goto_table:50
cookie=0x0, duration=298.609s, table=40, n_packets=11, n_bytes=1000, priority=36001,ip,in_port=2,dl_src=fa:16:3e:32:14:79,nw_src=1.0.0.2 actions=goto_table:50
cookie=0x0, duration=298.609s, table=40, n_packets=0, n_bytes=0, priority=61011,udp,in_port=2,tp_src=67,tp_dst=68 actions=drop
cookie=0x0, duration=298.610s, table=50, n_packets=80, n_bytes=7302, priority=0 actions=goto_table:60
cookie=0x0, duration=298.610s, table=60, n_packets=80, n_bytes=7302, priority=0 actions=goto_table:70
cookie=0x0, duration=298.609s, table=70, n_packets=80, n_bytes=7302, priority=0 actions=goto_table:80
cookie=0x0, duration=298.610s, table=80, n_packets=80, n_bytes=7302, priority=0 actions=goto_table:90
cookie=0x0, duration=298.609s, table=90, n_packets=78, n_bytes=6588, priority=0 actions=goto_table:100
cookie=0x0, duration=298.609s, table=90, n_packets=2, n_bytes=714, priority=61006,udp,dl_src=fa:16:3e:0d:06:ab,tp_src=67,tp_dst=68 actions=goto_table:100
cookie=0x0, duration=298.609s, table=100, n_packets=80, n_bytes=7302, priority=0 actions=goto_table:110
cookie=0x0, duration=298.609s, table=110, n_packets=0, n_bytes=0, priority=8192,tun_id=0x52 actions=drop
cookie=0x0, duration=298.610s, table=110, n_packets=0, n_bytes=0, priority=16384,reg0=0x2,tun_id=0x52,dl_dst=01:00:00:00:00:00/01:00:00:00:00:00 actions=output:2
cookie=0x0, duration=298.610s, table=110, n_packets=18, n_bytes=1558, priority=16383,reg0=0x1,tun_id=0x52,dl_dst=01:00:00:00:00:00/01:00:00:00:00:00 actions=output:2,output:1,output:4
cookie=0x0, duration=298.610s, table=110, n_packets=35, n_bytes=2904, priority=0 actions=drop
cookie=0x0, duration=298.610s, table=110, n_packets=0, n_bytes=0, tun_id=0x54,dl_dst=fa:16:3e:df:52:36 actions=output:4
cookie=0x0, duration=298.611s, table=110, n_packets=15, n_bytes=1798, tun_id=0x52,dl_dst=fa:16:3e:32:14:79 actions=output:2
cookie=0x0, duration=298.611s, table=110, n_packets=0, n_bytes=0, tun_id=0x54,dl_dst=fa:16:3e:fe:86:e6 actions=output:1
cookie=0x0, duration=298.611s, table=110, n_packets=12, n_bytes=1042, tun_id=0x52,dl_dst=fa:16:3e:0d:06:ab actions=output:1
Compute2:
vikram@compute2:~/devstack$ sudo ovs-ofctl -O OpenFlow13 dump-flows br-int
OFPST_FLOW reply (OF1.3) (xid=0x2):
cookie=0x0, duration=238.077s, table=0, n_packets=0, n_bytes=0, tun_id=0x54,in_port=2 actions=load:0x2->NXM_NX_REG0[],goto_table:20
cookie=0x0, duration=238.100s, table=0, n_packets=15, n_bytes=1798, tun_id=0x54,in_port=1 actions=load:0x2->NXM_NX_REG0[],goto_table:20
cookie=0x0, duration=238.146s, table=0, n_packets=0, n_bytes=0, priority=8192,in_port=3 actions=drop
cookie=0x0, duration=238.150s, table=0, n_packets=30, n_bytes=2600, in_port=3,dl_src=fa:16:3e:df:52:36 actions=set_field:0x54->tun_id,load:0x1->NXM_NX_REG0[],goto_table:20
cookie=0x0, duration=406.202s, table=0, n_packets=18, n_bytes=1436, priority=0 actions=goto_table:20
cookie=0x0, duration=408.075s, table=0, n_packets=166, n_bytes=18528, dl_type=0x88cc actions=CONTROLLER:65535
cookie=0x0, duration=406.194s, table=20, n_packets=62, n_bytes=5744, priority=0 actions=goto_table:30
cookie=0x0, duration=406.190s, table=30, n_packets=62, n_bytes=5744, priority=0 actions=goto_table:40
cookie=0x0, duration=406.174s, table=40, n_packets=51, n_bytes=4744, priority=0 actions=goto_table:50
cookie=0x0, duration=238.160s, table=40, n_packets=11, n_bytes=1000, priority=36001,ip,in_port=3,dl_src=fa:16:3e:df:52:36,nw_src=2.0.0.2 actions=goto_table:50
cookie=0x0, duration=238.167s, table=40, n_packets=0, n_bytes=0, priority=61011,udp,in_port=3,tp_src=67,tp_dst=68 actions=drop
cookie=0x0, duration=406.170s, table=50, n_packets=62, n_bytes=5744, priority=0 actions=goto_table:60
cookie=0x0, duration=406.165s, table=60, n_packets=62, n_bytes=5744, priority=0 actions=goto_table:70
cookie=0x0, duration=406.160s, table=70, n_packets=62, n_bytes=5744, priority=0 actions=goto_table:80
cookie=0x0, duration=406.154s, table=80, n_packets=62, n_bytes=5744, priority=0 actions=goto_table:90
cookie=0x0, duration=406.149s, table=90, n_packets=60, n_bytes=5030, priority=0 actions=goto_table:100
cookie=0x0, duration=238.174s, table=90, n_packets=2, n_bytes=714, priority=61006,udp,dl_src=fa:16:3e:fe:86:e6,tp_src=67,tp_dst=68 actions=goto_table:100
cookie=0x0, duration=406.142s, table=100, n_packets=62, n_bytes=5744, priority=0 actions=goto_table:110
cookie=0x0, duration=238.106s, table=110, n_packets=0, n_bytes=0, priority=8192,tun_id=0x54 actions=drop
cookie=0x0, duration=238.132s, table=110, n_packets=0, n_bytes=0, priority=16384,reg0=0x2,tun_id=0x54,dl_dst=01:00:00:00:00:00/01:00:00:00:00:00 actions=output:3
cookie=0x0, duration=238.120s, table=110, n_packets=18, n_bytes=1558, priority=16383,reg0=0x1,tun_id=0x54,dl_dst=01:00:00:00:00:00/01:00:00:00:00:00 actions=output:3,output:1,output:2
cookie=0x0, duration=406.128s, table=110, n_packets=17, n_bytes=1346, priority=0 actions=drop
cookie=0x0, duration=238.140s, table=110, n_packets=15, n_bytes=1798, tun_id=0x54,dl_dst=fa:16:3e:df:52:36 actions=output:3
cookie=0x0, duration=309.071s, table=110, n_packets=12, n_bytes=1042, tun_id=0x54,dl_dst=fa:16:3e:fe:86:e6 actions=output:1
cookie=0x0, duration=336.348s, table=110, n_packets=0, n_bytes=0, tun_id=0x52,dl_dst=fa:16:3e:0d:06:ab actions=output:1
Logs are attached
Thanks
Vikram