Date   

Re: [openflowplugin-dev] openflowjava IOB Exception in netvirt csit

Tomáš Slušný <tomas.slusny@...>
 


That is great then, based on your flow that you found to be causing this and content of that Gerrit patch it seems that after it will be finished (if it isn't yet) it should fix this issue. I was suspecting that there is also possibility that some extension can cause this, but that warning message what you was getting was really misleading.

From user perspective only problem is that flow wouldn't be visible in operational, but it will not affect reconcilation, because it would be in config so it will be reconciled properly.

Regards,
Tomas


Od: Jamo Luhrsen <jluhrsen@...>
Odoslané: sobota, 13. mája 2017 0:24
Komu: Tomáš Slušný; openflowplugin-dev@...; openflowjava-dev@...; netvirt-dev@...
Predmet: Re: [openflowplugin-dev] openflowjava IOB Exception in netvirt csit
 
And, now I see a bug was filed:
https://bugs.opendaylight.org/show_bug.cgi?id=8408

and a patch is in progress:
https://git.opendaylight.org/gerrit/#/c/56731

JamO

On 05/12/2017 11:56 AM, Jamo Luhrsen wrote:
> Tomas,
>
> I think I got it. I was only looking at the flows that were added to our control node
> (this is an openstack environment). I see now, that we are also adding some flows to
> one of our compute nodes. you can see that full flow table here [0], and just look for
> flows with short durations (less than 3s) to know what is new.
>
> looking at that and mucking around with one of my ovs setups, I was able to reproduce
> the IOBE with this flow:
>
> ovs-ofctl -O OpenFlow13 add-flow br-int "in_port=1,ip,action=ct(commit,zone=5002,table=47,nat(src=10.10.10.4)),2"
>
> shows up like this:
>
> OFPST_FLOW reply (OF1.3) (xid=0x2):
>  cookie=0x0, duration=2.328s, table=0, n_packets=0, n_bytes=0, ip,in_port=1
> actions=ct(commit,table=47,zone=5002,nat(src=10.10.10.4)),output:2
>
> IOBE:
>
> 2017-05-12 18:52:31,693 | WARN  | entLoopGroup-7-1 | OFDecoder                        | 295 -
> org.opendaylight.openflowjava.openflow-protocol-impl - 0.9.0.SNAPSHOT | Message deserialization failed
> java.lang.IndexOutOfBoundsException: readerIndex(142) + length(4) exceeds writerIndex(142): UnpooledSlicedByteBuf(ridx: 142,
> widx: 142, cap: 142/142, unwrapped: PooledUnsafeDirectByteBuf(ridx: 2632, widx: 2632, cap: 65536))
>         at io.netty.buffer.AbstractByteBuf.checkReadableBytes0(AbstractByteBuf.java:1389)[144:io.netty.buffer:4.1.8.Final]
>         at io.netty.buffer.AbstractByteBuf.readInt(AbstractByteBuf.java:766)[144:io.netty.buffer:4.1.8.Final]
>         at io.netty.buffer.AbstractByteBuf.readUnsignedInt(AbstractByteBuf.java:782)[144:io.netty.buffer:4.1.8.Final]
>
>
> BTW, what is the full effect of this from a user perspective? I think it's just that we
> will not have it in operational, right? Are we going to be in trouble in a reconciliation
> scenario?
>
> Thanks,
> JamO
>
> [0]
> https://logs.opendaylight.org/sandbox/jenkins091/netvirt-csit-1node-openstack-newton-jamo-upstream-stateful-snat-conntrack-carbon/3/archives/log.html.gz#s1-t9-k3-k1-k3-k1-k15-k4
>
>
> On 05/12/2017 05:05 AM, Tomáš Slušný wrote:
>> So I was able to succesfully add both flows you mentioned via RPC, and I do not see any Message derialization failed messages
>> in log. Here is output from dump-flows:
>>
>>
>> $ sudo ovs-ofctl dump-flows s1 -O Openflow13
>> OFPST_FLOW reply (OF1.3) (xid=0x2):
>>  cookie=0x80000006, duration=183.352s, table=21, n_packets=0, n_bytes=0, priority=10,ip,metadata=0x30d52/0xfffffe
>> actions=goto_table:26
>>  cookie=0x80000006, duration=292.436s, table=26, n_packets=0, n_bytes=0, priority=5,ip,metadata=0x30d52/0xfffffe
>> actions=set_field:0x186a9->tun_id,group:1
>>
>> And here is goto_table flow RPC:
>> http://ix.io/tuP
>>
>> And here is set_field flow RPC:
>> http://ix.io/tuQ
>>
>> So maybe there is problem somewhere else?
>>
>> -----------------------------------------------------------------------------------------------------------------------------
>> *Od:* Tomáš Slušný <tomas.slusny@...>
>> *Odoslané:* piatok, 12. mája 2017 10:05
>> *Komu:* Jamo Luhrsen; openflowplugin-dev@...; openflowjava-dev@...;
>> netvirt-dev@...
>> *Predmet:* Re: [openflowplugin-dev] openflowjava IOB Exception in netvirt csit
>> 
>>
>> After looking at it again, it is probably not issue in padding, because it is added in parent class, but it should be some
>> similar issue, so I am trying to fix it.
>>
>>
>> -----------------------------------------------------------------------------------------------------------------------------
>> *Od:* Tomáš Slušný
>> *Odoslané:* piatok, 12. mája 2017 10:01
>> *Komu:* Jamo Luhrsen; openflowplugin-dev@...; openflowjava-dev@...;
>> netvirt-dev@...
>> *Predmet:* Re: [openflowplugin-dev] openflowjava IOB Exception in netvirt csit
>> 
>>
>> Jamo,
>>
>>
>> thanks for your response, it helped me to probably find cause of this issue. Issue is that set-field action deserializer in
>> single layer serialization is not skipping padding at end of set-field action, so then it have some left-over zeros, and
>> based on logs it then tries to deserialize OutputAction (what type is 0) but body does not match, so it fails. I will try to
>> make fix for this as soon as possible. But until then, with single-layer-serialization disabled it will work.
>>
>>
>> Regards,
>>
>> Tomas
>>
>>
>> -----------------------------------------------------------------------------------------------------------------------------
>> *Od:* Jamo Luhrsen <jluhrsen@...>
>> *Odoslané:* piatok, 12. mája 2017 6:42
>> *Komu:* Tomáš Slušný; openflowplugin-dev@...; openflowjava-dev@...;
>> netvirt-dev@...
>> *Predmet:* Re: [openflowplugin-dev] openflowjava IOB Exception in netvirt csit
>> 
>> Tomas,
>>
>> I spent some time trying to figure this out (too much probably...) :) and correct me if
>> I'm wrong but this IOBE is coming from a flow that already exists on the switch and not
>> one we are trying to program. I do notice in a test I did that the IOBE comes every
>> ~3s which I think is our default polling of operational.
>>
>> anyway, I *think* narrowed down the exact test case that introduces this, and then compared
>> the flow table before and after that test case. The only difference are these two flows:
>>
>>  cookie=0x8000006, duration=0.810s, table=21, n_packets=0, n_bytes=0, priority=10,ip,metadata=0x30d52/0xfffffe
>> actions=goto_table:26
>>  cookie=0x8000006, duration=0.810s, table=26, n_packets=0, n_bytes=0, priority=5,ip,metadata=0x30d52/0xfffffe
>> actions=set_field:0x186a9->tun_id,group:225003
>>
>> full flow table here [0]
>>
>> I am only able to check these things with our CSIT stuff. I tried to manually create a flow that
>> looks like the table=26 flow above (via NB rest) but couldn't figure it out. I think my trouble
>> was trying to give a mask to the metadata.
>>
>> Anything help?
>>
>> I didn't try with serialization disabled yet, as that is gonna take some time to figure out
>> how to toggle it with our CSIT.
>>
>> Thanks,
>> JamO
>>
>> [0]
>> https://logs.opendaylight.org/releng/jenkins092/netvirt-csit-1node-openstack-newton-upstream-stateful-snat-conntrack-carbon/21/archives/log.html.gz#s1-s1-s3-t9-k3-k1-k1-k1-k15-k4
>>
>> On 05/10/2017 01:04 AM, Tomáš Slušný wrote:
>>> Hi Jamo,
>>>
>>>
>>> can you please try if this issue also occurs with single-layer serialization disabled? Here is link to wiki on how to disable
>>> it: https://wiki.opendaylight.org/view/OpenDaylight_OpenFlow_Plugin:OF13%2B_Single_Layer_Serialization#Enabling.2FDisabling_Single_Layer_Serialization
>>>
>>> Also, can you send dump of flows (or ideally only that single flow that is failing when OFP is tryining to deserialize it)
>>> from ovs?
>>>
>>>
>>> Regards,
>>>
>>> Tomas
>>>
>>>
>>> -----------------------------------------------------------------------------------------------------------------------------
>>> *Od:* Jamo Luhrsen <jluhrsen@...>
>>> *Odoslané:* utorok, 9. mája 2017 21:24
>>> *Komu:* openflowplugin-dev@...; openflowjava-dev@...; netvirt-dev@...
>>> *Predmet:* [openflowplugin-dev] openflowjava IOB Exception in netvirt csit
>>> 
>>> Hi OFP, OFJ, Netvirt,
>>>
>>> I'm debugging some failures in netvirt CSIT and saw an exception I don't remember
>>> seeing before (not that it's new, I just haven't seen it. although I dig at these
>>> things daily)
>>>
>>> 2017-05-09 15:52:45,124 | WARN  | entLoopGroup-7-5 | OFDecoder                        | 268 -
>>> org.opendaylight.openflowjava.openflow-protocol-impl - 0.9.0.SNAPSHOT | Message deserialization failed
>>> java.lang.IndexOutOfBoundsException: readerIndex(166) + length(4) exceeds writerIndex(166): UnpooledSlicedByteBuf(ridx: 166,
>>> widx: 166, cap: 166/166, unwrapped: PooledUnsafeDirectByteBuf(ridx: 13896, widx: 13896, cap: 16384))
>>>         at io.netty.buffer.AbstractByteBuf.checkReadableBytes0(AbstractByteBuf.java:1389)[117:io.netty.buffer:4.1.8.Final]
>>>         at io.netty.buffer.AbstractByteBuf.readInt(AbstractByteBuf.java:766)[117:io.netty.buffer:4.1.8.Final]
>>>         at io.netty.buffer.AbstractByteBuf.readUnsignedInt(AbstractByteBuf.java:782)[117:io.netty.buffer:4.1.8.Final]
>>>
>>>
>>> There are a lot of them (~1200) over a 90m system test job.
>>>
>>> I don't know yet if they are related to the failures I am debugging, but something is not right.
>>>
>>> Any comments? Need a bug?
>>>
>>> here is the full karaf log:
>>> https://logs.opendaylight.org/releng/jenkins092/netvirt-csit-1node-openstack-newton-upstream-stateful-snat-conntrack-carbon/21/archives/odl1_karaf.log.gz
>>>
>>> Thanks,
>>> JamO
>>> _______________________________________________
>>> openflowplugin-dev mailing list
>>> openflowplugin-dev@...
>>> https://lists.opendaylight.org/mailman/listinfo/openflowplugin-dev
>>>
>>> 
>>>
>>> TomášSlušný
>>>
>>> Software Developer
>>>
>>>
>>> Sídlo / Mlynské Nivy 56 / 821 05 Bratislava / Slovakia
>>> R&D centrum / Janka Kráľa 9 /  974 01 Banská Bystrica / Slovakia
>>> +421 911 083 902/ tomas.slusny@...
>>> reception: +421 2 206 65 114 / www.pantheon.tech <http://www.pantheon.tech>
>>>
>>> logo
>>>
>>> 
>>>
>> 
>> Tomáš Slušný
>> Software Developer
>> 
>> PANTHEONtechnologies s.r.o.
>> Janka Kráľa 9, 974 01 Banská Bystrica
>> Slovakia
>> Tel / +421 220 665 111
>> 
>> MAIL /tomas.slusny@...
>> WEB /www.pantheon.tech
>> 
>> 
>> 
>> Tomáš Slušný
>> Software Developer
>> 
>> PANTHEONtechnologies s.r.o.
>> Janka Kráľa 9, 974 01 Banská Bystrica
>> Slovakia
>> Tel / +421 220 665 111
>> 
>> MAIL /tomas.slusny@...
>> WEB /www.pantheon.tech
>> 
>> 
 
Tomáš Slušný
Software Developer
 
PANTHEON technologies s.r.o.
Janka Kráľa 9, 974 01 Banská Bystrica
Slovakia
Tel / +421 220 665 111
 
MAIL / tomas.slusny@...
WEB / www.pantheon.tech
 
 


Re: [openflowplugin-dev] openflowjava IOB Exception in netvirt csit

Jamo Luhrsen <jluhrsen@...>
 

On 05/12/2017 11:56 AM, Jamo Luhrsen wrote:
Tomas,

I think I got it. I was only looking at the flows that were added to our control node
(this is an openstack environment). I see now, that we are also adding some flows to
one of our compute nodes. you can see that full flow table here [0], and just look for
flows with short durations (less than 3s) to know what is new.

looking at that and mucking around with one of my ovs setups, I was able to reproduce
the IOBE with this flow:

ovs-ofctl -O OpenFlow13 add-flow br-int "in_port=1,ip,action=ct(commit,zone=5002,table=47,nat(src=10.10.10.4)),2"

shows up like this:

OFPST_FLOW reply (OF1.3) (xid=0x2):
cookie=0x0, duration=2.328s, table=0, n_packets=0, n_bytes=0, ip,in_port=1
actions=ct(commit,table=47,zone=5002,nat(src=10.10.10.4)),output:2

IOBE:

2017-05-12 18:52:31,693 | WARN | entLoopGroup-7-1 | OFDecoder | 295 -
org.opendaylight.openflowjava.openflow-protocol-impl - 0.9.0.SNAPSHOT | Message deserialization failed
java.lang.IndexOutOfBoundsException: readerIndex(142) + length(4) exceeds writerIndex(142): UnpooledSlicedByteBuf(ridx: 142,
widx: 142, cap: 142/142, unwrapped: PooledUnsafeDirectByteBuf(ridx: 2632, widx: 2632, cap: 65536))
at io.netty.buffer.AbstractByteBuf.checkReadableBytes0(AbstractByteBuf.java:1389)[144:io.netty.buffer:4.1.8.Final]
at io.netty.buffer.AbstractByteBuf.readInt(AbstractByteBuf.java:766)[144:io.netty.buffer:4.1.8.Final]
at io.netty.buffer.AbstractByteBuf.readUnsignedInt(AbstractByteBuf.java:782)[144:io.netty.buffer:4.1.8.Final]


BTW, what is the full effect of this from a user perspective? I think it's just that we
will not have it in operational, right? Are we going to be in trouble in a reconciliation
scenario?

Thanks,
JamO

[0]
https://logs.opendaylight.org/sandbox/jenkins091/netvirt-csit-1node-openstack-newton-jamo-upstream-stateful-snat-conntrack-carbon/3/archives/log.html.gz#s1-t9-k3-k1-k3-k1-k15-k4


On 05/12/2017 05:05 AM, Tomáš Slušný wrote:
So I was able to succesfully add both flows you mentioned via RPC, and I do not see any Message derialization failed messages
in log. Here is output from dump-flows:


$ sudo ovs-ofctl dump-flows s1 -O Openflow13
OFPST_FLOW reply (OF1.3) (xid=0x2):
cookie=0x80000006, duration=183.352s, table=21, n_packets=0, n_bytes=0, priority=10,ip,metadata=0x30d52/0xfffffe
actions=goto_table:26
cookie=0x80000006, duration=292.436s, table=26, n_packets=0, n_bytes=0, priority=5,ip,metadata=0x30d52/0xfffffe
actions=set_field:0x186a9->tun_id,group:1

And here is goto_table flow RPC:
http://ix.io/tuP

And here is set_field flow RPC:
http://ix.io/tuQ

So maybe there is problem somewhere else?

-----------------------------------------------------------------------------------------------------------------------------
*Od:* Tomáš Slušný <tomas.slusny@...>
*Odoslané:* piatok, 12. mája 2017 10:05
*Komu:* Jamo Luhrsen; openflowplugin-dev@...; openflowjava-dev@...;
netvirt-dev@...
*Predmet:* Re: [openflowplugin-dev] openflowjava IOB Exception in netvirt csit


After looking at it again, it is probably not issue in padding, because it is added in parent class, but it should be some
similar issue, so I am trying to fix it.


-----------------------------------------------------------------------------------------------------------------------------
*Od:* Tomáš Slušný
*Odoslané:* piatok, 12. mája 2017 10:01
*Komu:* Jamo Luhrsen; openflowplugin-dev@...; openflowjava-dev@...;
netvirt-dev@...
*Predmet:* Re: [openflowplugin-dev] openflowjava IOB Exception in netvirt csit


Jamo,


thanks for your response, it helped me to probably find cause of this issue. Issue is that set-field action deserializer in
single layer serialization is not skipping padding at end of set-field action, so then it have some left-over zeros, and
based on logs it then tries to deserialize OutputAction (what type is 0) but body does not match, so it fails. I will try to
make fix for this as soon as possible. But until then, with single-layer-serialization disabled it will work.


Regards,

Tomas


-----------------------------------------------------------------------------------------------------------------------------
*Od:* Jamo Luhrsen <jluhrsen@...>
*Odoslané:* piatok, 12. mája 2017 6:42
*Komu:* Tomáš Slušný; openflowplugin-dev@...; openflowjava-dev@...;
netvirt-dev@...
*Predmet:* Re: [openflowplugin-dev] openflowjava IOB Exception in netvirt csit

Tomas,

I spent some time trying to figure this out (too much probably...) :) and correct me if
I'm wrong but this IOBE is coming from a flow that already exists on the switch and not
one we are trying to program. I do notice in a test I did that the IOBE comes every
~3s which I think is our default polling of operational.

anyway, I *think* narrowed down the exact test case that introduces this, and then compared
the flow table before and after that test case. The only difference are these two flows:

cookie=0x8000006, duration=0.810s, table=21, n_packets=0, n_bytes=0, priority=10,ip,metadata=0x30d52/0xfffffe
actions=goto_table:26
cookie=0x8000006, duration=0.810s, table=26, n_packets=0, n_bytes=0, priority=5,ip,metadata=0x30d52/0xfffffe
actions=set_field:0x186a9->tun_id,group:225003

full flow table here [0]

I am only able to check these things with our CSIT stuff. I tried to manually create a flow that
looks like the table=26 flow above (via NB rest) but couldn't figure it out. I think my trouble
was trying to give a mask to the metadata.

Anything help?

I didn't try with serialization disabled yet, as that is gonna take some time to figure out
how to toggle it with our CSIT.

Thanks,
JamO

[0]
https://logs.opendaylight.org/releng/jenkins092/netvirt-csit-1node-openstack-newton-upstream-stateful-snat-conntrack-carbon/21/archives/log.html.gz#s1-s1-s3-t9-k3-k1-k1-k1-k15-k4

On 05/10/2017 01:04 AM, Tomáš Slušný wrote:
Hi Jamo,


can you please try if this issue also occurs with single-layer serialization disabled? Here is link to wiki on how to disable
it: https://wiki.opendaylight.org/view/OpenDaylight_OpenFlow_Plugin:OF13%2B_Single_Layer_Serialization#Enabling.2FDisabling_Single_Layer_Serialization

Also, can you send dump of flows (or ideally only that single flow that is failing when OFP is tryining to deserialize it)
from ovs?


Regards,

Tomas


-----------------------------------------------------------------------------------------------------------------------------
*Od:* Jamo Luhrsen <jluhrsen@...>
*Odoslané:* utorok, 9. mája 2017 21:24
*Komu:* openflowplugin-dev@...; openflowjava-dev@...; netvirt-dev@...
*Predmet:* [openflowplugin-dev] openflowjava IOB Exception in netvirt csit

Hi OFP, OFJ, Netvirt,

I'm debugging some failures in netvirt CSIT and saw an exception I don't remember
seeing before (not that it's new, I just haven't seen it. although I dig at these
things daily)

2017-05-09 15:52:45,124 | WARN | entLoopGroup-7-5 | OFDecoder | 268 -
org.opendaylight.openflowjava.openflow-protocol-impl - 0.9.0.SNAPSHOT | Message deserialization failed
java.lang.IndexOutOfBoundsException: readerIndex(166) + length(4) exceeds writerIndex(166): UnpooledSlicedByteBuf(ridx: 166,
widx: 166, cap: 166/166, unwrapped: PooledUnsafeDirectByteBuf(ridx: 13896, widx: 13896, cap: 16384))
at io.netty.buffer.AbstractByteBuf.checkReadableBytes0(AbstractByteBuf.java:1389)[117:io.netty.buffer:4.1.8.Final]
at io.netty.buffer.AbstractByteBuf.readInt(AbstractByteBuf.java:766)[117:io.netty.buffer:4.1.8.Final]
at io.netty.buffer.AbstractByteBuf.readUnsignedInt(AbstractByteBuf.java:782)[117:io.netty.buffer:4.1.8.Final]


There are a lot of them (~1200) over a 90m system test job.

I don't know yet if they are related to the failures I am debugging, but something is not right.

Any comments? Need a bug?

here is the full karaf log:
https://logs.opendaylight.org/releng/jenkins092/netvirt-csit-1node-openstack-newton-upstream-stateful-snat-conntrack-carbon/21/archives/odl1_karaf.log.gz

Thanks,
JamO
_______________________________________________
openflowplugin-dev mailing list
openflowplugin-dev@...
https://lists.opendaylight.org/mailman/listinfo/openflowplugin-dev



TomášSlušný

Software Developer


Sídlo / Mlynské Nivy 56 / 821 05 Bratislava / Slovakia
R&D centrum / Janka Kráľa 9 / 974 01 Banská Bystrica / Slovakia
+421 911 083 902/ tomas.slusny@...
reception: +421 2 206 65 114 / www.pantheon.tech <http://www.pantheon.tech>

logo


Tomáš Slušný
Software Developer

PANTHEONtechnologies s.r.o.
Janka Kráľa 9, 974 01 Banská Bystrica
Slovakia
Tel / +421 220 665 111

MAIL /tomas.slusny@...
WEB /www.pantheon.tech



Tomáš Slušný
Software Developer

PANTHEONtechnologies s.r.o.
Janka Kráľa 9, 974 01 Banská Bystrica
Slovakia
Tel / +421 220 665 111

MAIL /tomas.slusny@...
WEB /www.pantheon.tech


Re: [openflowplugin-dev] openflowjava IOB Exception in netvirt csit

Jamo Luhrsen <jluhrsen@...>
 

Tomas,

I think I got it. I was only looking at the flows that were added to our control node
(this is an openstack environment). I see now, that we are also adding some flows to
one of our compute nodes. you can see that full flow table here [0], and just look for
flows with short durations (less than 3s) to know what is new.

looking at that and mucking around with one of my ovs setups, I was able to reproduce
the IOBE with this flow:

ovs-ofctl -O OpenFlow13 add-flow br-int "in_port=1,ip,action=ct(commit,zone=5002,table=47,nat(src=10.10.10.4)),2"

shows up like this:

OFPST_FLOW reply (OF1.3) (xid=0x2):
cookie=0x0, duration=2.328s, table=0, n_packets=0, n_bytes=0, ip,in_port=1
actions=ct(commit,table=47,zone=5002,nat(src=10.10.10.4)),output:2

IOBE:

2017-05-12 18:52:31,693 | WARN | entLoopGroup-7-1 | OFDecoder | 295 -
org.opendaylight.openflowjava.openflow-protocol-impl - 0.9.0.SNAPSHOT | Message deserialization failed
java.lang.IndexOutOfBoundsException: readerIndex(142) + length(4) exceeds writerIndex(142): UnpooledSlicedByteBuf(ridx: 142,
widx: 142, cap: 142/142, unwrapped: PooledUnsafeDirectByteBuf(ridx: 2632, widx: 2632, cap: 65536))
at io.netty.buffer.AbstractByteBuf.checkReadableBytes0(AbstractByteBuf.java:1389)[144:io.netty.buffer:4.1.8.Final]
at io.netty.buffer.AbstractByteBuf.readInt(AbstractByteBuf.java:766)[144:io.netty.buffer:4.1.8.Final]
at io.netty.buffer.AbstractByteBuf.readUnsignedInt(AbstractByteBuf.java:782)[144:io.netty.buffer:4.1.8.Final]


BTW, what is the full effect of this from a user perspective? I think it's just that we
will not have it in operational, right? Are we going to be in trouble in a reconciliation
scenario?

Thanks,
JamO

[0]
https://logs.opendaylight.org/sandbox/jenkins091/netvirt-csit-1node-openstack-newton-jamo-upstream-stateful-snat-conntrack-carbon/3/archives/log.html.gz#s1-t9-k3-k1-k3-k1-k15-k4

On 05/12/2017 05:05 AM, Tomáš Slušný wrote:
So I was able to succesfully add both flows you mentioned via RPC, and I do not see any Message derialization failed messages
in log. Here is output from dump-flows:


$ sudo ovs-ofctl dump-flows s1 -O Openflow13
OFPST_FLOW reply (OF1.3) (xid=0x2):
cookie=0x80000006, duration=183.352s, table=21, n_packets=0, n_bytes=0, priority=10,ip,metadata=0x30d52/0xfffffe
actions=goto_table:26
cookie=0x80000006, duration=292.436s, table=26, n_packets=0, n_bytes=0, priority=5,ip,metadata=0x30d52/0xfffffe
actions=set_field:0x186a9->tun_id,group:1

And here is goto_table flow RPC:
http://ix.io/tuP

And here is set_field flow RPC:
http://ix.io/tuQ

So maybe there is problem somewhere else?

-----------------------------------------------------------------------------------------------------------------------------
*Od:* Tomáš Slušný <tomas.slusny@...>
*Odoslané:* piatok, 12. mája 2017 10:05
*Komu:* Jamo Luhrsen; openflowplugin-dev@...; openflowjava-dev@...;
netvirt-dev@...
*Predmet:* Re: [openflowplugin-dev] openflowjava IOB Exception in netvirt csit


After looking at it again, it is probably not issue in padding, because it is added in parent class, but it should be some
similar issue, so I am trying to fix it.


-----------------------------------------------------------------------------------------------------------------------------
*Od:* Tomáš Slušný
*Odoslané:* piatok, 12. mája 2017 10:01
*Komu:* Jamo Luhrsen; openflowplugin-dev@...; openflowjava-dev@...;
netvirt-dev@...
*Predmet:* Re: [openflowplugin-dev] openflowjava IOB Exception in netvirt csit


Jamo,


thanks for your response, it helped me to probably find cause of this issue. Issue is that set-field action deserializer in
single layer serialization is not skipping padding at end of set-field action, so then it have some left-over zeros, and
based on logs it then tries to deserialize OutputAction (what type is 0) but body does not match, so it fails. I will try to
make fix for this as soon as possible. But until then, with single-layer-serialization disabled it will work.


Regards,

Tomas


-----------------------------------------------------------------------------------------------------------------------------
*Od:* Jamo Luhrsen <jluhrsen@...>
*Odoslané:* piatok, 12. mája 2017 6:42
*Komu:* Tomáš Slušný; openflowplugin-dev@...; openflowjava-dev@...;
netvirt-dev@...
*Predmet:* Re: [openflowplugin-dev] openflowjava IOB Exception in netvirt csit

Tomas,

I spent some time trying to figure this out (too much probably...) :) and correct me if
I'm wrong but this IOBE is coming from a flow that already exists on the switch and not
one we are trying to program. I do notice in a test I did that the IOBE comes every
~3s which I think is our default polling of operational.

anyway, I *think* narrowed down the exact test case that introduces this, and then compared
the flow table before and after that test case. The only difference are these two flows:

cookie=0x8000006, duration=0.810s, table=21, n_packets=0, n_bytes=0, priority=10,ip,metadata=0x30d52/0xfffffe
actions=goto_table:26
cookie=0x8000006, duration=0.810s, table=26, n_packets=0, n_bytes=0, priority=5,ip,metadata=0x30d52/0xfffffe
actions=set_field:0x186a9->tun_id,group:225003

full flow table here [0]

I am only able to check these things with our CSIT stuff. I tried to manually create a flow that
looks like the table=26 flow above (via NB rest) but couldn't figure it out. I think my trouble
was trying to give a mask to the metadata.

Anything help?

I didn't try with serialization disabled yet, as that is gonna take some time to figure out
how to toggle it with our CSIT.

Thanks,
JamO

[0]
https://logs.opendaylight.org/releng/jenkins092/netvirt-csit-1node-openstack-newton-upstream-stateful-snat-conntrack-carbon/21/archives/log.html.gz#s1-s1-s3-t9-k3-k1-k1-k1-k15-k4

On 05/10/2017 01:04 AM, Tomáš Slušný wrote:
Hi Jamo,


can you please try if this issue also occurs with single-layer serialization disabled? Here is link to wiki on how to disable
it: https://wiki.opendaylight.org/view/OpenDaylight_OpenFlow_Plugin:OF13%2B_Single_Layer_Serialization#Enabling.2FDisabling_Single_Layer_Serialization

Also, can you send dump of flows (or ideally only that single flow that is failing when OFP is tryining to deserialize it)
from ovs?


Regards,

Tomas


-----------------------------------------------------------------------------------------------------------------------------
*Od:* Jamo Luhrsen <jluhrsen@...>
*Odoslané:* utorok, 9. mája 2017 21:24
*Komu:* openflowplugin-dev@...; openflowjava-dev@...; netvirt-dev@...
*Predmet:* [openflowplugin-dev] openflowjava IOB Exception in netvirt csit

Hi OFP, OFJ, Netvirt,

I'm debugging some failures in netvirt CSIT and saw an exception I don't remember
seeing before (not that it's new, I just haven't seen it. although I dig at these
things daily)

2017-05-09 15:52:45,124 | WARN | entLoopGroup-7-5 | OFDecoder | 268 -
org.opendaylight.openflowjava.openflow-protocol-impl - 0.9.0.SNAPSHOT | Message deserialization failed
java.lang.IndexOutOfBoundsException: readerIndex(166) + length(4) exceeds writerIndex(166): UnpooledSlicedByteBuf(ridx: 166,
widx: 166, cap: 166/166, unwrapped: PooledUnsafeDirectByteBuf(ridx: 13896, widx: 13896, cap: 16384))
at io.netty.buffer.AbstractByteBuf.checkReadableBytes0(AbstractByteBuf.java:1389)[117:io.netty.buffer:4.1.8.Final]
at io.netty.buffer.AbstractByteBuf.readInt(AbstractByteBuf.java:766)[117:io.netty.buffer:4.1.8.Final]
at io.netty.buffer.AbstractByteBuf.readUnsignedInt(AbstractByteBuf.java:782)[117:io.netty.buffer:4.1.8.Final]


There are a lot of them (~1200) over a 90m system test job.

I don't know yet if they are related to the failures I am debugging, but something is not right.

Any comments? Need a bug?

here is the full karaf log:
https://logs.opendaylight.org/releng/jenkins092/netvirt-csit-1node-openstack-newton-upstream-stateful-snat-conntrack-carbon/21/archives/odl1_karaf.log.gz

Thanks,
JamO
_______________________________________________
openflowplugin-dev mailing list
openflowplugin-dev@...
https://lists.opendaylight.org/mailman/listinfo/openflowplugin-dev



TomášSlušný

Software Developer


Sídlo / Mlynské Nivy 56 / 821 05 Bratislava / Slovakia
R&D centrum / Janka Kráľa 9 / 974 01 Banská Bystrica / Slovakia
+421 911 083 902/ tomas.slusny@...
reception: +421 2 206 65 114 / www.pantheon.tech <http://www.pantheon.tech>

logo


Tomáš Slušný
Software Developer

PANTHEONtechnologies s.r.o.
Janka Kráľa 9, 974 01 Banská Bystrica
Slovakia
Tel / +421 220 665 111

MAIL /tomas.slusny@...
WEB /www.pantheon.tech



Tomáš Slušný
Software Developer

PANTHEONtechnologies s.r.o.
Janka Kráľa 9, 974 01 Banská Bystrica
Slovakia
Tel / +421 220 665 111

MAIL /tomas.slusny@...
WEB /www.pantheon.tech


Re: [openflowplugin-dev] openflowjava IOB Exception in netvirt csit

Tomáš Slušný <tomas.slusny@...>
 

So I was able to succesfully add both flows you mentioned via RPC, and I do not see any Message derialization failed messages in log. Here is output from dump-flows:


$ sudo ovs-ofctl dump-flows s1 -O Openflow13
OFPST_FLOW reply (OF1.3) (xid=0x2):
 cookie=0x80000006, duration=183.352s, table=21, n_packets=0, n_bytes=0, priority=10,ip,metadata=0x30d52/0xfffffe actions=goto_table:26
 cookie=0x80000006, duration=292.436s, table=26, n_packets=0, n_bytes=0, priority=5,ip,metadata=0x30d52/0xfffffe actions=set_field:0x186a9->tun_id,group:1

And here is goto_table flow RPC:
http://ix.io/tuP

And here is set_field flow RPC:
http://ix.io/tuQ

So maybe there is problem somewhere else?


Od: Tomáš Slušný <tomas.slusny@...>
Odoslané: piatok, 12. mája 2017 10:05
Komu: Jamo Luhrsen; openflowplugin-dev@...; openflowjava-dev@...; netvirt-dev@...
Predmet: Re: [openflowplugin-dev] openflowjava IOB Exception in netvirt csit
 

After looking at it again, it is probably not issue in padding, because it is added in parent class, but it should be some similar issue, so I am trying to fix it.



Od: Tomáš Slušný
Odoslané: piatok, 12. mája 2017 10:01
Komu: Jamo Luhrsen; openflowplugin-dev@...; openflowjava-dev@...; netvirt-dev@...
Predmet: Re: [openflowplugin-dev] openflowjava IOB Exception in netvirt csit
 

Jamo,


thanks for your response, it helped me to probably find cause of this issue. Issue is that set-field action deserializer in single layer serialization is not skipping padding at end of set-field action, so then it have some left-over zeros, and based on logs it then tries to deserialize OutputAction (what type is 0) but body does not match, so it fails. I will try to make fix for this as soon as possible. But until then, with single-layer-serialization disabled it will work.


Regards,

Tomas



Od: Jamo Luhrsen <jluhrsen@...>
Odoslané: piatok, 12. mája 2017 6:42
Komu: Tomáš Slušný; openflowplugin-dev@...; openflowjava-dev@...; netvirt-dev@...
Predmet: Re: [openflowplugin-dev] openflowjava IOB Exception in netvirt csit
 
Tomas,

I spent some time trying to figure this out (too much probably...) :) and correct me if
I'm wrong but this IOBE is coming from a flow that already exists on the switch and not
one we are trying to program. I do notice in a test I did that the IOBE comes every
~3s which I think is our default polling of operational.

anyway, I *think* narrowed down the exact test case that introduces this, and then compared
the flow table before and after that test case. The only difference are these two flows:

 cookie=0x8000006, duration=0.810s, table=21, n_packets=0, n_bytes=0, priority=10,ip,metadata=0x30d52/0xfffffe
actions=goto_table:26
 cookie=0x8000006, duration=0.810s, table=26, n_packets=0, n_bytes=0, priority=5,ip,metadata=0x30d52/0xfffffe
actions=set_field:0x186a9->tun_id,group:225003

full flow table here [0]

I am only able to check these things with our CSIT stuff. I tried to manually create a flow that
looks like the table=26 flow above (via NB rest) but couldn't figure it out. I think my trouble
was trying to give a mask to the metadata.

Anything help?

I didn't try with serialization disabled yet, as that is gonna take some time to figure out
how to toggle it with our CSIT.

Thanks,
JamO

[0]
https://logs.opendaylight.org/releng/jenkins092/netvirt-csit-1node-openstack-newton-upstream-stateful-snat-conntrack-carbon/21/archives/log.html.gz#s1-s1-s3-t9-k3-k1-k1-k1-k15-k4

On 05/10/2017 01:04 AM, Tomáš Slušný wrote:
> Hi Jamo,
>
>
> can you please try if this issue also occurs with single-layer serialization disabled? Here is link to wiki on how to disable
> it: https://wiki.opendaylight.org/view/OpenDaylight_OpenFlow_Plugin:OF13%2B_Single_Layer_Serialization#Enabling.2FDisabling_Single_Layer_Serialization
>
> Also, can you send dump of flows (or ideally only that single flow that is failing when OFP is tryining to deserialize it)
> from ovs?
>
>
> Regards,
>
> Tomas
>
>
> -----------------------------------------------------------------------------------------------------------------------------
> *Od:* Jamo Luhrsen <jluhrsen@...>
> *Odoslané:* utorok, 9. mája 2017 21:24
> *Komu:* openflowplugin-dev@...; openflowjava-dev@...; netvirt-dev@...
> *Predmet:* [openflowplugin-dev] openflowjava IOB Exception in netvirt csit

> Hi OFP, OFJ, Netvirt,
>
> I'm debugging some failures in netvirt CSIT and saw an exception I don't remember
> seeing before (not that it's new, I just haven't seen it. although I dig at these
> things daily)
>
> 2017-05-09 15:52:45,124 | WARN  | entLoopGroup-7-5 | OFDecoder                        | 268 -
> org.opendaylight.openflowjava.openflow-protocol-impl - 0.9.0.SNAPSHOT | Message deserialization failed
> java.lang.IndexOutOfBoundsException: readerIndex(166) + length(4) exceeds writerIndex(166): UnpooledSlicedByteBuf(ridx: 166,
> widx: 166, cap: 166/166, unwrapped: PooledUnsafeDirectByteBuf(ridx: 13896, widx: 13896, cap: 16384))
>         at io.netty.buffer.AbstractByteBuf.checkReadableBytes0(AbstractByteBuf.java:1389)[117:io.netty.buffer:4.1.8.Final]
>         at io.netty.buffer.AbstractByteBuf.readInt(AbstractByteBuf.java:766)[117:io.netty.buffer:4.1.8.Final]
>         at io.netty.buffer.AbstractByteBuf.readUnsignedInt(AbstractByteBuf.java:782)[117:io.netty.buffer:4.1.8.Final]
>
>
> There are a lot of them (~1200) over a 90m system test job.
>
> I don't know yet if they are related to the failures I am debugging, but something is not right.
>
> Any comments? Need a bug?
>
> here is the full karaf log:
> https://logs.opendaylight.org/releng/jenkins092/netvirt-csit-1node-openstack-newton-upstream-stateful-snat-conntrack-carbon/21/archives/odl1_karaf.log.gz
>
> Thanks,
> JamO
> _______________________________________________
> openflowplugin-dev mailing list
> openflowplugin-dev@...
> https://lists.opendaylight.org/mailman/listinfo/openflowplugin-dev
>

>
> TomášSlušný
>
> Software Developer
>
>
> Sídlo / Mlynské Nivy 56 / 821 05 Bratislava / Slovakia
> R&D centrum / Janka Kráľa 9 /  974 01 Banská Bystrica / Slovakia
> +421 911 083 902/ tomas.slusny@...
> reception: +421 2 206 65 114 / www.pantheon.tech
>
> logo
>

>
 
Tomáš Slušný
Software Developer
 
PANTHEON technologies s.r.o.
Janka Kráľa 9, 974 01 Banská Bystrica
Slovakia
Tel / +421 220 665 111
 
MAIL / tomas.slusny@...
WEB / www.pantheon.tech
 
 
 
Tomáš Slušný
Software Developer
 
PANTHEON technologies s.r.o.
Janka Kráľa 9, 974 01 Banská Bystrica
Slovakia
Tel / +421 220 665 111
 
MAIL / tomas.slusny@...
WEB / www.pantheon.tech
 
 


Re: [openflowplugin-dev] openflowjava IOB Exception in netvirt csit

Tomáš Slušný <tomas.slusny@...>
 

After looking at it again, it is probably not issue in padding, because it is added in parent class, but it should be some similar issue, so I am trying to fix it.



Od: Tomáš Slušný
Odoslané: piatok, 12. mája 2017 10:01
Komu: Jamo Luhrsen; openflowplugin-dev@...; openflowjava-dev@...; netvirt-dev@...
Predmet: Re: [openflowplugin-dev] openflowjava IOB Exception in netvirt csit
 

Jamo,


thanks for your response, it helped me to probably find cause of this issue. Issue is that set-field action deserializer in single layer serialization is not skipping padding at end of set-field action, so then it have some left-over zeros, and based on logs it then tries to deserialize OutputAction (what type is 0) but body does not match, so it fails. I will try to make fix for this as soon as possible. But until then, with single-layer-serialization disabled it will work.


Regards,

Tomas



Od: Jamo Luhrsen <jluhrsen@...>
Odoslané: piatok, 12. mája 2017 6:42
Komu: Tomáš Slušný; openflowplugin-dev@...; openflowjava-dev@...; netvirt-dev@...
Predmet: Re: [openflowplugin-dev] openflowjava IOB Exception in netvirt csit
 
Tomas,

I spent some time trying to figure this out (too much probably...) :) and correct me if
I'm wrong but this IOBE is coming from a flow that already exists on the switch and not
one we are trying to program. I do notice in a test I did that the IOBE comes every
~3s which I think is our default polling of operational.

anyway, I *think* narrowed down the exact test case that introduces this, and then compared
the flow table before and after that test case. The only difference are these two flows:

 cookie=0x8000006, duration=0.810s, table=21, n_packets=0, n_bytes=0, priority=10,ip,metadata=0x30d52/0xfffffe
actions=goto_table:26
 cookie=0x8000006, duration=0.810s, table=26, n_packets=0, n_bytes=0, priority=5,ip,metadata=0x30d52/0xfffffe
actions=set_field:0x186a9->tun_id,group:225003

full flow table here [0]

I am only able to check these things with our CSIT stuff. I tried to manually create a flow that
looks like the table=26 flow above (via NB rest) but couldn't figure it out. I think my trouble
was trying to give a mask to the metadata.

Anything help?

I didn't try with serialization disabled yet, as that is gonna take some time to figure out
how to toggle it with our CSIT.

Thanks,
JamO

[0]
https://logs.opendaylight.org/releng/jenkins092/netvirt-csit-1node-openstack-newton-upstream-stateful-snat-conntrack-carbon/21/archives/log.html.gz#s1-s1-s3-t9-k3-k1-k1-k1-k15-k4

On 05/10/2017 01:04 AM, Tomáš Slušný wrote:
> Hi Jamo,
>
>
> can you please try if this issue also occurs with single-layer serialization disabled? Here is link to wiki on how to disable
> it: https://wiki.opendaylight.org/view/OpenDaylight_OpenFlow_Plugin:OF13%2B_Single_Layer_Serialization#Enabling.2FDisabling_Single_Layer_Serialization
>
> Also, can you send dump of flows (or ideally only that single flow that is failing when OFP is tryining to deserialize it)
> from ovs?
>
>
> Regards,
>
> Tomas
>
>
> -----------------------------------------------------------------------------------------------------------------------------
> *Od:* Jamo Luhrsen <jluhrsen@...>
> *Odoslané:* utorok, 9. mája 2017 21:24
> *Komu:* openflowplugin-dev@...; openflowjava-dev@...; netvirt-dev@...
> *Predmet:* [openflowplugin-dev] openflowjava IOB Exception in netvirt csit

> Hi OFP, OFJ, Netvirt,
>
> I'm debugging some failures in netvirt CSIT and saw an exception I don't remember
> seeing before (not that it's new, I just haven't seen it. although I dig at these
> things daily)
>
> 2017-05-09 15:52:45,124 | WARN  | entLoopGroup-7-5 | OFDecoder                        | 268 -
> org.opendaylight.openflowjava.openflow-protocol-impl - 0.9.0.SNAPSHOT | Message deserialization failed
> java.lang.IndexOutOfBoundsException: readerIndex(166) + length(4) exceeds writerIndex(166): UnpooledSlicedByteBuf(ridx: 166,
> widx: 166, cap: 166/166, unwrapped: PooledUnsafeDirectByteBuf(ridx: 13896, widx: 13896, cap: 16384))
>         at io.netty.buffer.AbstractByteBuf.checkReadableBytes0(AbstractByteBuf.java:1389)[117:io.netty.buffer:4.1.8.Final]
>         at io.netty.buffer.AbstractByteBuf.readInt(AbstractByteBuf.java:766)[117:io.netty.buffer:4.1.8.Final]
>         at io.netty.buffer.AbstractByteBuf.readUnsignedInt(AbstractByteBuf.java:782)[117:io.netty.buffer:4.1.8.Final]
>
>
> There are a lot of them (~1200) over a 90m system test job.
>
> I don't know yet if they are related to the failures I am debugging, but something is not right.
>
> Any comments? Need a bug?
>
> here is the full karaf log:
> https://logs.opendaylight.org/releng/jenkins092/netvirt-csit-1node-openstack-newton-upstream-stateful-snat-conntrack-carbon/21/archives/odl1_karaf.log.gz
>
> Thanks,
> JamO
> _______________________________________________
> openflowplugin-dev mailing list
> openflowplugin-dev@...
> https://lists.opendaylight.org/mailman/listinfo/openflowplugin-dev
>

>
> TomášSlušný
>
> Software Developer
>
>
> Sídlo / Mlynské Nivy 56 / 821 05 Bratislava / Slovakia
> R&D centrum / Janka Kráľa 9 /  974 01 Banská Bystrica / Slovakia
> +421 911 083 902/ tomas.slusny@...
> reception: +421 2 206 65 114 / www.pantheon.tech
>
> logo
>

>
 
Tomáš Slušný
Software Developer
 
PANTHEON technologies s.r.o.
Janka Kráľa 9, 974 01 Banská Bystrica
Slovakia
Tel / +421 220 665 111
 
MAIL / tomas.slusny@...
WEB / www.pantheon.tech
 
 


Re: [openflowplugin-dev] openflowjava IOB Exception in netvirt csit

Tomáš Slušný <tomas.slusny@...>
 

Jamo,


thanks for your response, it helped me to probably find cause of this issue. Issue is that set-field action deserializer in single layer serialization is not skipping padding at end of set-field action, so then it have some left-over zeros, and based on logs it then tries to deserialize OutputAction (what type is 0) but body does not match, so it fails. I will try to make fix for this as soon as possible. But until then, with single-layer-serialization disabled it will work.


Regards,

Tomas



Od: Jamo Luhrsen <jluhrsen@...>
Odoslané: piatok, 12. mája 2017 6:42
Komu: Tomáš Slušný; openflowplugin-dev@...; openflowjava-dev@...; netvirt-dev@...
Predmet: Re: [openflowplugin-dev] openflowjava IOB Exception in netvirt csit
 
Tomas,

I spent some time trying to figure this out (too much probably...) :) and correct me if
I'm wrong but this IOBE is coming from a flow that already exists on the switch and not
one we are trying to program. I do notice in a test I did that the IOBE comes every
~3s which I think is our default polling of operational.

anyway, I *think* narrowed down the exact test case that introduces this, and then compared
the flow table before and after that test case. The only difference are these two flows:

 cookie=0x8000006, duration=0.810s, table=21, n_packets=0, n_bytes=0, priority=10,ip,metadata=0x30d52/0xfffffe
actions=goto_table:26
 cookie=0x8000006, duration=0.810s, table=26, n_packets=0, n_bytes=0, priority=5,ip,metadata=0x30d52/0xfffffe
actions=set_field:0x186a9->tun_id,group:225003

full flow table here [0]

I am only able to check these things with our CSIT stuff. I tried to manually create a flow that
looks like the table=26 flow above (via NB rest) but couldn't figure it out. I think my trouble
was trying to give a mask to the metadata.

Anything help?

I didn't try with serialization disabled yet, as that is gonna take some time to figure out
how to toggle it with our CSIT.

Thanks,
JamO

[0]
https://logs.opendaylight.org/releng/jenkins092/netvirt-csit-1node-openstack-newton-upstream-stateful-snat-conntrack-carbon/21/archives/log.html.gz#s1-s1-s3-t9-k3-k1-k1-k1-k15-k4

On 05/10/2017 01:04 AM, Tomáš Slušný wrote:
> Hi Jamo,
>
>
> can you please try if this issue also occurs with single-layer serialization disabled? Here is link to wiki on how to disable
> it: https://wiki.opendaylight.org/view/OpenDaylight_OpenFlow_Plugin:OF13%2B_Single_Layer_Serialization#Enabling.2FDisabling_Single_Layer_Serialization
>
> Also, can you send dump of flows (or ideally only that single flow that is failing when OFP is tryining to deserialize it)
> from ovs?
>
>
> Regards,
>
> Tomas
>
>
> -----------------------------------------------------------------------------------------------------------------------------
> *Od:* Jamo Luhrsen <jluhrsen@...>
> *Odoslané:* utorok, 9. mája 2017 21:24
> *Komu:* openflowplugin-dev@...; openflowjava-dev@...; netvirt-dev@...
> *Predmet:* [openflowplugin-dev] openflowjava IOB Exception in netvirt csit

> Hi OFP, OFJ, Netvirt,
>
> I'm debugging some failures in netvirt CSIT and saw an exception I don't remember
> seeing before (not that it's new, I just haven't seen it. although I dig at these
> things daily)
>
> 2017-05-09 15:52:45,124 | WARN  | entLoopGroup-7-5 | OFDecoder                        | 268 -
> org.opendaylight.openflowjava.openflow-protocol-impl - 0.9.0.SNAPSHOT | Message deserialization failed
> java.lang.IndexOutOfBoundsException: readerIndex(166) + length(4) exceeds writerIndex(166): UnpooledSlicedByteBuf(ridx: 166,
> widx: 166, cap: 166/166, unwrapped: PooledUnsafeDirectByteBuf(ridx: 13896, widx: 13896, cap: 16384))
>         at io.netty.buffer.AbstractByteBuf.checkReadableBytes0(AbstractByteBuf.java:1389)[117:io.netty.buffer:4.1.8.Final]
>         at io.netty.buffer.AbstractByteBuf.readInt(AbstractByteBuf.java:766)[117:io.netty.buffer:4.1.8.Final]
>         at io.netty.buffer.AbstractByteBuf.readUnsignedInt(AbstractByteBuf.java:782)[117:io.netty.buffer:4.1.8.Final]
>
>
> There are a lot of them (~1200) over a 90m system test job.
>
> I don't know yet if they are related to the failures I am debugging, but something is not right.
>
> Any comments? Need a bug?
>
> here is the full karaf log:
> https://logs.opendaylight.org/releng/jenkins092/netvirt-csit-1node-openstack-newton-upstream-stateful-snat-conntrack-carbon/21/archives/odl1_karaf.log.gz
>
> Thanks,
> JamO
> _______________________________________________
> openflowplugin-dev mailing list
> openflowplugin-dev@...
> https://lists.opendaylight.org/mailman/listinfo/openflowplugin-dev
>

>
> TomášSlušný
>
> Software Developer
>
>
> Sídlo / Mlynské Nivy 56 / 821 05 Bratislava / Slovakia
> R&D centrum / Janka Kráľa 9 /  974 01 Banská Bystrica / Slovakia
> +421 911 083 902/ tomas.slusny@...
> reception: +421 2 206 65 114 / www.pantheon.tech
>
> logo
>

>
 
Tomáš Slušný
Software Developer
 
PANTHEON technologies s.r.o.
Janka Kráľa 9, 974 01 Banská Bystrica
Slovakia
Tel / +421 220 665 111
 
MAIL / tomas.slusny@...
WEB / www.pantheon.tech
 
 


Re: [openflowplugin-dev] openflowjava IOB Exception in netvirt csit

Jamo Luhrsen <jluhrsen@...>
 

Tomas,

I spent some time trying to figure this out (too much probably...) :) and correct me if
I'm wrong but this IOBE is coming from a flow that already exists on the switch and not
one we are trying to program. I do notice in a test I did that the IOBE comes every
~3s which I think is our default polling of operational.

anyway, I *think* narrowed down the exact test case that introduces this, and then compared
the flow table before and after that test case. The only difference are these two flows:

cookie=0x8000006, duration=0.810s, table=21, n_packets=0, n_bytes=0, priority=10,ip,metadata=0x30d52/0xfffffe
actions=goto_table:26
cookie=0x8000006, duration=0.810s, table=26, n_packets=0, n_bytes=0, priority=5,ip,metadata=0x30d52/0xfffffe
actions=set_field:0x186a9->tun_id,group:225003

full flow table here [0]

I am only able to check these things with our CSIT stuff. I tried to manually create a flow that
looks like the table=26 flow above (via NB rest) but couldn't figure it out. I think my trouble
was trying to give a mask to the metadata.

Anything help?

I didn't try with serialization disabled yet, as that is gonna take some time to figure out
how to toggle it with our CSIT.

Thanks,
JamO

[0]
https://logs.opendaylight.org/releng/jenkins092/netvirt-csit-1node-openstack-newton-upstream-stateful-snat-conntrack-carbon/21/archives/log.html.gz#s1-s1-s3-t9-k3-k1-k1-k1-k15-k4

On 05/10/2017 01:04 AM, Tomáš Slušný wrote:
Hi Jamo,


can you please try if this issue also occurs with single-layer serialization disabled? Here is link to wiki on how to disable
it: https://wiki.opendaylight.org/view/OpenDaylight_OpenFlow_Plugin:OF13%2B_Single_Layer_Serialization#Enabling.2FDisabling_Single_Layer_Serialization

Also, can you send dump of flows (or ideally only that single flow that is failing when OFP is tryining to deserialize it)
from ovs?


Regards,

Tomas


-----------------------------------------------------------------------------------------------------------------------------
*Od:* Jamo Luhrsen <jluhrsen@...>
*Odoslané:* utorok, 9. mája 2017 21:24
*Komu:* openflowplugin-dev@...; openflowjava-dev@...; netvirt-dev@...
*Predmet:* [openflowplugin-dev] openflowjava IOB Exception in netvirt csit

Hi OFP, OFJ, Netvirt,

I'm debugging some failures in netvirt CSIT and saw an exception I don't remember
seeing before (not that it's new, I just haven't seen it. although I dig at these
things daily)

2017-05-09 15:52:45,124 | WARN | entLoopGroup-7-5 | OFDecoder | 268 -
org.opendaylight.openflowjava.openflow-protocol-impl - 0.9.0.SNAPSHOT | Message deserialization failed
java.lang.IndexOutOfBoundsException: readerIndex(166) + length(4) exceeds writerIndex(166): UnpooledSlicedByteBuf(ridx: 166,
widx: 166, cap: 166/166, unwrapped: PooledUnsafeDirectByteBuf(ridx: 13896, widx: 13896, cap: 16384))
at io.netty.buffer.AbstractByteBuf.checkReadableBytes0(AbstractByteBuf.java:1389)[117:io.netty.buffer:4.1.8.Final]
at io.netty.buffer.AbstractByteBuf.readInt(AbstractByteBuf.java:766)[117:io.netty.buffer:4.1.8.Final]
at io.netty.buffer.AbstractByteBuf.readUnsignedInt(AbstractByteBuf.java:782)[117:io.netty.buffer:4.1.8.Final]


There are a lot of them (~1200) over a 90m system test job.

I don't know yet if they are related to the failures I am debugging, but something is not right.

Any comments? Need a bug?

here is the full karaf log:
https://logs.opendaylight.org/releng/jenkins092/netvirt-csit-1node-openstack-newton-upstream-stateful-snat-conntrack-carbon/21/archives/odl1_karaf.log.gz

Thanks,
JamO
_______________________________________________
openflowplugin-dev mailing list
openflowplugin-dev@...
https://lists.opendaylight.org/mailman/listinfo/openflowplugin-dev



TomášSlušný

Software Developer


Sídlo / Mlynské Nivy 56 / 821 05 Bratislava / Slovakia
R&D centrum / Janka Kráľa 9 / 974 01 Banská Bystrica / Slovakia
+421 911 083 902/ tomas.slusny@...
reception: +421 2 206 65 114 / www.pantheon.tech

logo



Re: ODL disconnects from switch during performance tests

Michal Rehak -X (mirehak - PANTHEON TECHNOLOGIES@Cisco) <mirehak@...>
 

Added ofplugin-dev.




From: openflowjava-dev-bounces@... <openflowjava-dev-bounces@...> on behalf of Thomas FERRANDIZ <Thomas.FERRANDIZ@...>
Sent: Wednesday, May 10, 2017 17:36
To: openflowjava-dev@...
Subject: [openflowjava-dev] ODL disconnects from switch during performance tests
 

Hello all,

 

I am currently developing a stateful firewall application for SDN using ODL as the controller.

The application uses the TCP flags OpenFlow extension to match the successive states when establishing a connection.

This means that a large amount of packets–in is sent to the controller and that in turn the controller adds and deletes many flows from the switches.

I use the MD-SAL API to add and remove flows from the switches without going through the datastore.

The version of ODL used is Boron-SR3.

 

At the moment, I am writing a POC firewall with only one switch and I run into the following problem.

I run a stress test that involves creating TCP connection from a client machine to a server machine (running Apache).

The 2 machines are connected by an OVS switch connected to ODL.

 

When the stress test is run with a low number of connections/second (~50) everything works fine.

When using ~200 TCP connections/second, the firewall seems to work fine for a few seconds.

Then the duration of the TCP connections start to increase and the controller ends up disconnection from the OVS.

 

The following errors appear in the log:

 

2017-04-07 09:42:34,419 | ERROR | pool-15-thread-1 | OutboundQueueProviderImpl        | 192 - org.opendaylight.openflowplugin.impl - 0.3.2.Boron-SR2 | No queue present, failing request

 

And the future returned by salFlowService.addFlow show the following error message:

 

Error: [operation-failed]: Device disconnected

 

The following exception also occurs:

org.opendaylight.controller.md.sal.dom.api.DOMRpcImplementationNotAvailableException: No implementation of RPC AbsoluteSchemaPath{path=[(urn:opendaylight:flow:service?revision=2013-08-19)add-flow]} available

                at org.opendaylight.controller.md.sal.dom.broker.impl.DOMRpcRoutingTable.invokeRpc(DOMRpcRoutingTable.java:173)[154:org.opendaylight.controller.sal-broker-impl:1.4.3.Boron-SR3]

                at org.opendaylight.controller.md.sal.dom.broker.impl.DOMRpcRouter.invokeRpc(DOMRpcRouter.java:102)[154:org.opendaylight.controller.sal-broker-impl:1.4.3.Boron-SR3]

                at Proxy1d02b267_bf62_4c92_a739_263c328d7038.invokeRpc(Unknown Source)[:]

                at org.opendaylight.controller.md.sal.binding.impl.RpcServiceAdapter.invoke0(RpcServiceAdapter.java:65)[156:org.opendaylight.controller.sal-binding-broker-impl:1.4.3.Boron-SR3]

                at org.opendaylight.controller.md.sal.binding.impl.RpcServiceAdapter.access$000(RpcServiceAdapter.java:43)[156:org.opendaylight.controller.sal-binding-broker-impl:1.4.3.Boron-SR3]

                at org.opendaylight.controller.md.sal.binding.impl.RpcServiceAdapter$RpcInvocationStrategy.invoke(RpcServiceAdapter.java:159)[156:org.opendaylight.controller.sal-binding-broker-impl:1.4.3.Boron-SR3]

                at org.opendaylight.controller.md.sal.binding.impl.RpcServiceAdapter.invoke(RpcServiceAdapter.java:96)[156:org.opendaylight.controller.sal-binding-broker-impl:1.4.3.Boron-SR3]

                at com.sun.proxy.$Proxy54.addFlow(Unknown Source)[120:org.opendaylight.openflowplugin.model.flow-service:0.3.3.Boron-SR3]

 

The OVS logs also shows that it’s the controller that breaks the connection.

 

The JVM has 8GB of memory allocated and uses at most 3 so it’s not a memory issue.

The machine running ODL has 8 logical cores, of which only one is used.

CPU and memory usage is also pretty low on the machine running OVS.

 

So my question would be whether you have an idea of what I could do to solve this issue or a direction in which to investigate?

 

Thanks in advance,

 

Thomas Ferrandiz

{P}

R&D Engineer

Network Architecture & Security

 

 

1219 AVENUE CHAMPS BLANCS
35510 CESSON-SÉVIGNÉ (FR)

 

 

 

 

 

 


ODL disconnects from switch during performance tests

Thomas Ferrandiz
 

Hello all,

 

I am currently developing a stateful firewall application for SDN using ODL as the controller.

The application uses the TCP flags OpenFlow extension to match the successive states when establishing a connection.

This means that a large amount of packets–in is sent to the controller and that in turn the controller adds and deletes many flows from the switches.

I use the MD-SAL API to add and remove flows from the switches without going through the datastore.

The version of ODL used is Boron-SR3.

 

At the moment, I am writing a POC firewall with only one switch and I run into the following problem.

I run a stress test that involves creating TCP connection from a client machine to a server machine (running Apache).

The 2 machines are connected by an OVS switch connected to ODL.

 

When the stress test is run with a low number of connections/second (~50) everything works fine.

When using ~200 TCP connections/second, the firewall seems to work fine for a few seconds.

Then the duration of the TCP connections start to increase and the controller ends up disconnection from the OVS.

 

The following errors appear in the log:

 

2017-04-07 09:42:34,419 | ERROR | pool-15-thread-1 | OutboundQueueProviderImpl        | 192 - org.opendaylight.openflowplugin.impl - 0.3.2.Boron-SR2 | No queue present, failing request

 

And the future returned by salFlowService.addFlow show the following error message:

 

Error: [operation-failed]: Device disconnected

 

The following exception also occurs:

org.opendaylight.controller.md.sal.dom.api.DOMRpcImplementationNotAvailableException: No implementation of RPC AbsoluteSchemaPath{path=[(urn:opendaylight:flow:service?revision=2013-08-19)add-flow]} available

                at org.opendaylight.controller.md.sal.dom.broker.impl.DOMRpcRoutingTable.invokeRpc(DOMRpcRoutingTable.java:173)[154:org.opendaylight.controller.sal-broker-impl:1.4.3.Boron-SR3]

                at org.opendaylight.controller.md.sal.dom.broker.impl.DOMRpcRouter.invokeRpc(DOMRpcRouter.java:102)[154:org.opendaylight.controller.sal-broker-impl:1.4.3.Boron-SR3]

                at Proxy1d02b267_bf62_4c92_a739_263c328d7038.invokeRpc(Unknown Source)[:]

                at org.opendaylight.controller.md.sal.binding.impl.RpcServiceAdapter.invoke0(RpcServiceAdapter.java:65)[156:org.opendaylight.controller.sal-binding-broker-impl:1.4.3.Boron-SR3]

                at org.opendaylight.controller.md.sal.binding.impl.RpcServiceAdapter.access$000(RpcServiceAdapter.java:43)[156:org.opendaylight.controller.sal-binding-broker-impl:1.4.3.Boron-SR3]

                at org.opendaylight.controller.md.sal.binding.impl.RpcServiceAdapter$RpcInvocationStrategy.invoke(RpcServiceAdapter.java:159)[156:org.opendaylight.controller.sal-binding-broker-impl:1.4.3.Boron-SR3]

                at org.opendaylight.controller.md.sal.binding.impl.RpcServiceAdapter.invoke(RpcServiceAdapter.java:96)[156:org.opendaylight.controller.sal-binding-broker-impl:1.4.3.Boron-SR3]

                at com.sun.proxy.$Proxy54.addFlow(Unknown Source)[120:org.opendaylight.openflowplugin.model.flow-service:0.3.3.Boron-SR3]

 

The OVS logs also shows that it’s the controller that breaks the connection.

 

The JVM has 8GB of memory allocated and uses at most 3 so it’s not a memory issue.

The machine running ODL has 8 logical cores, of which only one is used.

CPU and memory usage is also pretty low on the machine running OVS.

 

So my question would be whether you have an idea of what I could do to solve this issue or a direction in which to investigate?

 

Thanks in advance,

 

Thomas Ferrandiz

{P}

R&D Engineer

Network Architecture & Security

 

 

1219 AVENUE CHAMPS BLANCS
35510 CESSON-SÉVIGNÉ (FR)

 

 

 

 

 

 


Re: [openflowplugin-dev] openflowjava IOB Exception in netvirt csit

Tomáš Slušný <tomas.slusny@...>
 

Hi Jamo,


can you please try if this issue also occurs with single-layer serialization disabled? Here is link to wiki on how to disable it: https://wiki.opendaylight.org/view/OpenDaylight_OpenFlow_Plugin:OF13%2B_Single_Layer_Serialization#Enabling.2FDisabling_Single_Layer_Serialization

Also, can you send dump of flows (or ideally only that single flow that is failing when OFP is tryining to deserialize it) from ovs?


Regards,

Tomas



Od: Jamo Luhrsen <jluhrsen@...>
Odoslané: utorok, 9. mája 2017 21:24
Komu: openflowplugin-dev@...; openflowjava-dev@...; netvirt-dev@...
Predmet: [openflowplugin-dev] openflowjava IOB Exception in netvirt csit
 
Hi OFP, OFJ, Netvirt,

I'm debugging some failures in netvirt CSIT and saw an exception I don't remember
seeing before (not that it's new, I just haven't seen it. although I dig at these
things daily)

2017-05-09 15:52:45,124 | WARN  | entLoopGroup-7-5 | OFDecoder                        | 268 -
org.opendaylight.openflowjava.openflow-protocol-impl - 0.9.0.SNAPSHOT | Message deserialization failed
java.lang.IndexOutOfBoundsException: readerIndex(166) + length(4) exceeds writerIndex(166): UnpooledSlicedByteBuf(ridx: 166,
widx: 166, cap: 166/166, unwrapped: PooledUnsafeDirectByteBuf(ridx: 13896, widx: 13896, cap: 16384))
        at io.netty.buffer.AbstractByteBuf.checkReadableBytes0(AbstractByteBuf.java:1389)[117:io.netty.buffer:4.1.8.Final]
        at io.netty.buffer.AbstractByteBuf.readInt(AbstractByteBuf.java:766)[117:io.netty.buffer:4.1.8.Final]
        at io.netty.buffer.AbstractByteBuf.readUnsignedInt(AbstractByteBuf.java:782)[117:io.netty.buffer:4.1.8.Final]


There are a lot of them (~1200) over a 90m system test job.

I don't know yet if they are related to the failures I am debugging, but something is not right.

Any comments? Need a bug?

here is the full karaf log:
https://logs.opendaylight.org/releng/jenkins092/netvirt-csit-1node-openstack-newton-upstream-stateful-snat-conntrack-carbon/21/archives/odl1_karaf.log.gz

Thanks,
JamO
_______________________________________________
openflowplugin-dev mailing list
openflowplugin-dev@...
https://lists.opendaylight.org/mailman/listinfo/openflowplugin-dev

 

TomášSlušný

Software Developer


Sídlo Mlynské Nivy 56 / 821 05 Bratislava / Slovakia
R&D centrum 
Janka Kráľa 9 /  974 01 Banská Bystrica Slovakia
+421 911 083 902 / tomas.slusny@...
reception: +421 2 206 65 114 / www.pantheon.tech

logo

 


openflowjava IOB Exception in netvirt csit

Jamo Luhrsen <jluhrsen@...>
 

Hi OFP, OFJ, Netvirt,

I'm debugging some failures in netvirt CSIT and saw an exception I don't remember
seeing before (not that it's new, I just haven't seen it. although I dig at these
things daily)

2017-05-09 15:52:45,124 | WARN | entLoopGroup-7-5 | OFDecoder | 268 -
org.opendaylight.openflowjava.openflow-protocol-impl - 0.9.0.SNAPSHOT | Message deserialization failed
java.lang.IndexOutOfBoundsException: readerIndex(166) + length(4) exceeds writerIndex(166): UnpooledSlicedByteBuf(ridx: 166,
widx: 166, cap: 166/166, unwrapped: PooledUnsafeDirectByteBuf(ridx: 13896, widx: 13896, cap: 16384))
at io.netty.buffer.AbstractByteBuf.checkReadableBytes0(AbstractByteBuf.java:1389)[117:io.netty.buffer:4.1.8.Final]
at io.netty.buffer.AbstractByteBuf.readInt(AbstractByteBuf.java:766)[117:io.netty.buffer:4.1.8.Final]
at io.netty.buffer.AbstractByteBuf.readUnsignedInt(AbstractByteBuf.java:782)[117:io.netty.buffer:4.1.8.Final]


There are a lot of them (~1200) over a 90m system test job.

I don't know yet if they are related to the failures I am debugging, but something is not right.

Any comments? Need a bug?

here is the full karaf log:
https://logs.opendaylight.org/releng/jenkins092/netvirt-csit-1node-openstack-newton-upstream-stateful-snat-conntrack-carbon/21/archives/odl1_karaf.log.gz

Thanks,
JamO


openflowjava IOB Exception in netvirt csit

Jamo Luhrsen <jluhrsen@...>
 

Hi OFP, OFJ, Netvirt,

I'm debugging some failures in netvirt CSIT and saw an exception I don't remember
seeing before (not that it's new, I just haven't seen it. although I dig at these
things daily)

2017-05-09 15:52:45,124 | WARN | entLoopGroup-7-5 | OFDecoder | 268 -
org.opendaylight.openflowjava.openflow-protocol-impl - 0.9.0.SNAPSHOT | Message deserialization failed
java.lang.IndexOutOfBoundsException: readerIndex(166) + length(4) exceeds writerIndex(166): UnpooledSlicedByteBuf(ridx: 166,
widx: 166, cap: 166/166, unwrapped: PooledUnsafeDirectByteBuf(ridx: 13896, widx: 13896, cap: 16384))
at io.netty.buffer.AbstractByteBuf.checkReadableBytes0(AbstractByteBuf.java:1389)[117:io.netty.buffer:4.1.8.Final]
at io.netty.buffer.AbstractByteBuf.readInt(AbstractByteBuf.java:766)[117:io.netty.buffer:4.1.8.Final]
at io.netty.buffer.AbstractByteBuf.readUnsignedInt(AbstractByteBuf.java:782)[117:io.netty.buffer:4.1.8.Final]


There are a lot of them (~1200) over a 90m system test job.

I don't know yet if they are related to the failures I am debugging, but something is not right.

Any comments? Need a bug?

Thanks,
JamO


Re: [release] Autorelease carbon failed to build openflow-protocol-impl from openflowjava

Katie Zhang <katie.zhang.huawei@...>
 

Thanks Michal.

Katie

On Tue, May 2, 2017 at 11:52 PM, Michal Rehak -X (mirehak - PANTHEON TECHNOLOGIES at Cisco) <mirehak@...> wrote:

Ok,

let me increase the timeout.


Regards,

Michal



From: Colin Dixon <colin@...>
Sent: Tuesday, May 2, 2017 13:52
To: Jenkins; Michal Rehak -X (mirehak - PANTHEON TECHNOLOGIES at Cisco)

Cc: openflowjava-dev@lists.opendaylight.org; openflowplugin-dev@lists.opendaylight.org; release@...
Subject: Re: [openflowjava-dev] [release] Autorelease carbon failed to build openflow-protocol-impl from openflowjava
 
I've only seen it the once. 

--Colin

On Tue, May 2, 2017 at 5:26 AM Michal Rehak -X (mirehak - PANTHEON TECHNOLOGIES at Cisco) <mirehak@...> wrote:

Hi Team,

I tried with openjdk and oraclejdk - both ran successfully for me - locally.


I guess there are 3 possible reasons for failures in jenkins env.

- there is accidentally another instance of test running on the same machine (occupying port 9874)

- there is no epoll available

- the machine does not make it within 2 secs - we might want to increase the timeout for tests like this


org.opendaylight.openflowjava.protocol.impl.core.connection.UdpHandlerTest#startupServer



Is this failure stable?



Regards,

Michal




From: openflowjava-dev-bounces@lists.opendaylight.org <openflowjava-dev-bounces@lists.opendaylight.org> on behalf of Colin Dixon <colin@...>
Sent: Monday, May 1, 2017 15:24
To: Jenkins
Cc: openflowjava-dev@lists.opendaylight.org; openflowplugin-dev@lists.opendaylight.org; release@...
Subject: Re: [openflowjava-dev] [release] Autorelease carbon failed to build openflow-protocol-impl from openflowjava
 
(also adding openflowplugin-dev)

Any ideas folks?

org.opendaylight.openflowjava.protocol.impl.core.connection.UdpHandlerTest
testWithEmptyAddressOnEpoll(org.opendaylight.openflowjava.protocol.impl.core.connection.UdpHandlerTest)  Time elapsed: 2.068 sec  <<< FAILURE!
java.lang.AssertionError: Wrong - start server
at org.junit.Assert.fail(Assert.java:88)
at org.junit.Assert.assertTrue(Assert.java:41)
at org.opendaylight.openflowjava.protocol.impl.core.connection.UdpHandlerTest.testWithEmptyAddressOnEpoll(UdpHandlerTest.java:70)


--Colin


On Mon, May 1, 2017 at 12:10 AM, Jenkins <jenkins-dontreply@opendaylight.org> wrote:
Attention openflowjava-devs,

Autorelease carbon failed to build openflow-protocol-impl from openflowjava in build
279. Attached is a snippet of the error message related to the
failure that we were able to automatically parse as well as console logs.


Console Logs:
https://logs.opendaylight.org/releng/jenkins092/autorelease-release-carbon/279

Jenkins Build:
https://jenkins.opendaylight.org/releng/job/autorelease-release-carbon/279/

Please review and provide an ETA on when a fix will be available.

Thanks,
ODL releng/autorelease team


_______________________________________________
release mailing list
release@...
https://lists.opendaylight.org/mailman/listinfo/release



_______________________________________________
release mailing list
release@...
https://lists.opendaylight.org/mailman/listinfo/release





Re: [release] Autorelease carbon failed to build openflow-protocol-impl from openflowjava

Michal Rehak -X (mirehak - PANTHEON TECHNOLOGIES@Cisco) <mirehak@...>
 

Ok,

let me increase the timeout.


Regards,

Michal



From: Colin Dixon <colin@...>
Sent: Tuesday, May 2, 2017 13:52
To: Jenkins; Michal Rehak -X (mirehak - PANTHEON TECHNOLOGIES at Cisco)
Cc: openflowjava-dev@...; openflowplugin-dev@...; release@...
Subject: Re: [openflowjava-dev] [release] Autorelease carbon failed to build openflow-protocol-impl from openflowjava
 
I've only seen it the once. 

--Colin

On Tue, May 2, 2017 at 5:26 AM Michal Rehak -X (mirehak - PANTHEON TECHNOLOGIES at Cisco) <mirehak@...> wrote:

Hi Team,

I tried with openjdk and oraclejdk - both ran successfully for me - locally.


I guess there are 3 possible reasons for failures in jenkins env.

- there is accidentally another instance of test running on the same machine (occupying port 9874)

- there is no epoll available

- the machine does not make it within 2 secs - we might want to increase the timeout for tests like this


org.opendaylight.openflowjava.protocol.impl.core.connection.UdpHandlerTest#startupServer



Is this failure stable?



Regards,

Michal




From: openflowjava-dev-bounces@... <openflowjava-dev-bounces@...> on behalf of Colin Dixon <colin@...>
Sent: Monday, May 1, 2017 15:24
To: Jenkins
Cc: openflowjava-dev@...; openflowplugin-dev@...; release@...
Subject: Re: [openflowjava-dev] [release] Autorelease carbon failed to build openflow-protocol-impl from openflowjava
 
(also adding openflowplugin-dev)

Any ideas folks?

org.opendaylight.openflowjava.protocol.impl.core.connection.UdpHandlerTest
testWithEmptyAddressOnEpoll(org.opendaylight.openflowjava.protocol.impl.core.connection.UdpHandlerTest)  Time elapsed: 2.068 sec  <<< FAILURE!
java.lang.AssertionError: Wrong - start server
at org.junit.Assert.fail(Assert.java:88)
at org.junit.Assert.assertTrue(Assert.java:41)
at org.opendaylight.openflowjava.protocol.impl.core.connection.UdpHandlerTest.testWithEmptyAddressOnEpoll(UdpHandlerTest.java:70)


--Colin


On Mon, May 1, 2017 at 12:10 AM, Jenkins <jenkins-dontreply@...> wrote:
Attention openflowjava-devs,

Autorelease carbon failed to build openflow-protocol-impl from openflowjava in build
279. Attached is a snippet of the error message related to the
failure that we were able to automatically parse as well as console logs.


Console Logs:
https://logs.opendaylight.org/releng/jenkins092/autorelease-release-carbon/279

Jenkins Build:
https://jenkins.opendaylight.org/releng/job/autorelease-release-carbon/279/

Please review and provide an ETA on when a fix will be available.

Thanks,
ODL releng/autorelease team


_______________________________________________
release mailing list
release@...
https://lists.opendaylight.org/mailman/listinfo/release



Re: [release] Autorelease carbon failed to build openflow-protocol-impl from openflowjava

Colin Dixon
 

I've only seen it the once. 

--Colin

On Tue, May 2, 2017 at 5:26 AM Michal Rehak -X (mirehak - PANTHEON TECHNOLOGIES at Cisco) <mirehak@...> wrote:

Hi Team,

I tried with openjdk and oraclejdk - both ran successfully for me - locally.


I guess there are 3 possible reasons for failures in jenkins env.

- there is accidentally another instance of test running on the same machine (occupying port 9874)

- there is no epoll available

- the machine does not make it within 2 secs - we might want to increase the timeout for tests like this


org.opendaylight.openflowjava.protocol.impl.core.connection.UdpHandlerTest#startupServer



Is this failure stable?



Regards,

Michal




From: openflowjava-dev-bounces@... <openflowjava-dev-bounces@...> on behalf of Colin Dixon <colin@...>
Sent: Monday, May 1, 2017 15:24
To: Jenkins
Cc: openflowjava-dev@...; openflowplugin-dev@...; release@...
Subject: Re: [openflowjava-dev] [release] Autorelease carbon failed to build openflow-protocol-impl from openflowjava
 
(also adding openflowplugin-dev)

Any ideas folks?

org.opendaylight.openflowjava.protocol.impl.core.connection.UdpHandlerTest
testWithEmptyAddressOnEpoll(org.opendaylight.openflowjava.protocol.impl.core.connection.UdpHandlerTest)  Time elapsed: 2.068 sec  <<< FAILURE!
java.lang.AssertionError: Wrong - start server
at org.junit.Assert.fail(Assert.java:88)
at org.junit.Assert.assertTrue(Assert.java:41)
at org.opendaylight.openflowjava.protocol.impl.core.connection.UdpHandlerTest.testWithEmptyAddressOnEpoll(UdpHandlerTest.java:70)


--Colin


On Mon, May 1, 2017 at 12:10 AM, Jenkins <jenkins-dontreply@...> wrote:
Attention openflowjava-devs,

Autorelease carbon failed to build openflow-protocol-impl from openflowjava in build
279. Attached is a snippet of the error message related to the
failure that we were able to automatically parse as well as console logs.


Console Logs:
https://logs.opendaylight.org/releng/jenkins092/autorelease-release-carbon/279

Jenkins Build:
https://jenkins.opendaylight.org/releng/job/autorelease-release-carbon/279/

Please review and provide an ETA on when a fix will be available.

Thanks,
ODL releng/autorelease team


_______________________________________________
release mailing list
release@...
https://lists.opendaylight.org/mailman/listinfo/release



Re: [release] Autorelease carbon failed to build openflow-protocol-impl from openflowjava

Michal Rehak -X (mirehak - PANTHEON TECHNOLOGIES@Cisco) <mirehak@...>
 

Hi Team,

I tried with openjdk and oraclejdk - both ran successfully for me - locally.


I guess there are 3 possible reasons for failures in jenkins env.

- there is accidentally another instance of test running on the same machine (occupying port 9874)

- there is no epoll available

- the machine does not make it within 2 secs - we might want to increase the timeout for tests like this


org.opendaylight.openflowjava.protocol.impl.core.connection.UdpHandlerTest#startupServer



Is this failure stable?



Regards,

Michal




From: openflowjava-dev-bounces@... <openflowjava-dev-bounces@...> on behalf of Colin Dixon <colin@...>
Sent: Monday, May 1, 2017 15:24
To: Jenkins
Cc: openflowjava-dev@...; openflowplugin-dev@...; release@...
Subject: Re: [openflowjava-dev] [release] Autorelease carbon failed to build openflow-protocol-impl from openflowjava
 
(also adding openflowplugin-dev)

Any ideas folks?

org.opendaylight.openflowjava.protocol.impl.core.connection.UdpHandlerTest
testWithEmptyAddressOnEpoll(org.opendaylight.openflowjava.protocol.impl.core.connection.UdpHandlerTest)  Time elapsed: 2.068 sec  <<< FAILURE!
java.lang.AssertionError: Wrong - start server
at org.junit.Assert.fail(Assert.java:88)
at org.junit.Assert.assertTrue(Assert.java:41)
at org.opendaylight.openflowjava.protocol.impl.core.connection.UdpHandlerTest.testWithEmptyAddressOnEpoll(UdpHandlerTest.java:70)


--Colin


On Mon, May 1, 2017 at 12:10 AM, Jenkins <jenkins-dontreply@...> wrote:
Attention openflowjava-devs,

Autorelease carbon failed to build openflow-protocol-impl from openflowjava in build
279. Attached is a snippet of the error message related to the
failure that we were able to automatically parse as well as console logs.


Console Logs:
https://logs.opendaylight.org/releng/jenkins092/autorelease-release-carbon/279

Jenkins Build:
https://jenkins.opendaylight.org/releng/job/autorelease-release-carbon/279/

Please review and provide an ETA on when a fix will be available.

Thanks,
ODL releng/autorelease team


_______________________________________________
release mailing list
release@...
https://lists.opendaylight.org/mailman/listinfo/release



Re: [release] Autorelease carbon failed to build openflow-protocol-impl from openflowjava

Colin Dixon
 

(also adding openflowplugin-dev)

Any ideas folks?

org.opendaylight.openflowjava.protocol.impl.core.connection.UdpHandlerTest
testWithEmptyAddressOnEpoll(org.opendaylight.openflowjava.protocol.impl.core.connection.UdpHandlerTest)  Time elapsed: 2.068 sec  <<< FAILURE!
java.lang.AssertionError: Wrong - start server
at org.junit.Assert.fail(Assert.java:88)
at org.junit.Assert.assertTrue(Assert.java:41)
at org.opendaylight.openflowjava.protocol.impl.core.connection.UdpHandlerTest.testWithEmptyAddressOnEpoll(UdpHandlerTest.java:70)


--Colin


On Mon, May 1, 2017 at 12:10 AM, Jenkins <jenkins-dontreply@...> wrote:
Attention openflowjava-devs,

Autorelease carbon failed to build openflow-protocol-impl from openflowjava in build
279. Attached is a snippet of the error message related to the
failure that we were able to automatically parse as well as console logs.


Console Logs:
https://logs.opendaylight.org/releng/jenkins092/autorelease-release-carbon/279

Jenkins Build:
https://jenkins.opendaylight.org/releng/job/autorelease-release-carbon/279/

Please review and provide an ETA on when a fix will be available.

Thanks,
ODL releng/autorelease team


_______________________________________________
release mailing list
release@...
https://lists.opendaylight.org/mailman/listinfo/release



[release] Autorelease carbon failed to build openflow-protocol-impl from openflowjava

Jenkins <jenkins-dontreply@...>
 

Attention openflowjava-devs,

Autorelease carbon failed to build openflow-protocol-impl from openflowjava in build
279. Attached is a snippet of the error message related to the
failure that we were able to automatically parse as well as console logs.


Console Logs:
https://logs.opendaylight.org/releng/jenkins092/autorelease-release-carbon/279

Jenkins Build:
https://jenkins.opendaylight.org/releng/job/autorelease-release-carbon/279/

Please review and provide an ETA on when a fix will be available.

Thanks,
ODL releng/autorelease team


Re: Opendaylight

Ajay Chopra <chopraa@...>
 

Hi Michal ,

Thank you  .

Now I am able to add flows ,but now I wanted know what all flows should we add so that I can successfully enable ping between two hosts .

Following flows needs to be added .

 

1)ICMP

2)ARP

3)Flow between two switches  

 

-Ajay

From: Michal Rehak -X (mirehak - PANTHEON TECHNOLOGIES at Cisco) [mailto:mirehak@...]
Sent: 28 April 2017 13:32
To: Ajay Chopra <chopraa@...>; ccain@...; openflowjava-dev@...; openflowplugin-dev@...
Subject: Re: [openflowjava-dev] Opendaylight

 

Added openflowplugin-dev list.

 

 


From: openflowjava-dev-bounces@... <openflowjava-dev-bounces@...> on behalf of Ajay Chopra <chopraa@...>
Sent: Wednesday, April 26, 2017 11:27
To: ccain@...; openflowjava-dev@...
Subject: [openflowjava-dev] Opendaylight

 

Hi Opendaylight team ,

 

I am working on opendaylight controller ,can you help me in adding the flows using postman .

When I add flows  using the http://10.119.162.14:8181/restconf/config/opendaylight-inventory:nodes/node/openflow:224635998159098/table/0 or

Try to get information of flows that are there not able to get the information .

 

Is there any way we need to install some feature to enable the addition of flows ? Getting 404 not found .

 

 

Regards,

Ajay Chopra

 



::DISCLAIMER::
----------------------------------------------------------------------------------------------------------------------------------------------------

The contents of this e-mail and any attachment(s) are confidential and intended for the named recipient(s) only.
E-mail transmission is not guaranteed to be secure or error-free as information could be intercepted, corrupted,
lost, destroyed, arrive late or incomplete, or may contain viruses in transmission. The e mail and its contents
(with or without referred errors) shall therefore not attach any liability on the originator or HCL or its affiliates.
Views or opinions, if any, presented in this email are solely those of the author and may not necessarily reflect the
views or opinions of HCL or its affiliates. Any form of reproduction, dissemination, copying, disclosure, modification,
distribution and / or publication of this message without the prior written consent of authorized representative of
HCL is strictly prohibited. If you have received this email in error please delete it and notify the sender immediately.
Before opening any email and/or attachments, please check them for viruses and other defects.

----------------------------------------------------------------------------------------------------------------------------------------------------


Re: Opendaylight

Michal Rehak -X (mirehak - PANTHEON TECHNOLOGIES@Cisco) <mirehak@...>
 

Added openflowplugin-dev list.




From: openflowjava-dev-bounces@... <openflowjava-dev-bounces@...> on behalf of Ajay Chopra <chopraa@...>
Sent: Wednesday, April 26, 2017 11:27
To: ccain@...; openflowjava-dev@...
Subject: [openflowjava-dev] Opendaylight
 

Hi Opendaylight team ,

 

I am working on opendaylight controller ,can you help me in adding the flows using postman .

When I add flows  using the http://10.119.162.14:8181/restconf/config/opendaylight-inventory:nodes/node/openflow:224635998159098/table/0 or

Try to get information of flows that are there not able to get the information .

 

Is there any way we need to install some feature to enable the addition of flows ? Getting 404 not found .

 

 

Regards,

Ajay Chopra

 



::DISCLAIMER::
----------------------------------------------------------------------------------------------------------------------------------------------------

The contents of this e-mail and any attachment(s) are confidential and intended for the named recipient(s) only.
E-mail transmission is not guaranteed to be secure or error-free as information could be intercepted, corrupted,
lost, destroyed, arrive late or incomplete, or may contain viruses in transmission. The e mail and its contents
(with or without referred errors) shall therefore not attach any liability on the originator or HCL or its affiliates.
Views or opinions, if any, presented in this email are solely those of the author and may not necessarily reflect the
views or opinions of HCL or its affiliates. Any form of reproduction, dissemination, copying, disclosure, modification,
distribution and / or publication of this message without the prior written consent of authorized representative of
HCL is strictly prohibited. If you have received this email in error please delete it and notify the sender immediately.
Before opening any email and/or attachments, please check them for viruses and other defects.

----------------------------------------------------------------------------------------------------------------------------------------------------

61 - 80 of 861