This group is locked. No changes can be made to the group while it is locked.
Date
1 - 4 of 4
[integration-dev] Inputs on cbench-like Java based tool that supports openflow 1.3
|
Madhava Bangera, Raksha <raksha.madhava.bangera@...>
Thanks, Jamo.
toggle quoted message
Show quoted text
-----Original Message-----
From: Jamo Luhrsen [mailto:jluhrsen@...] Sent: Monday, August 31, 2015 5:44 PM To: Madhava Bangera, Raksha; Daniel Farrell Cc: openflowjava-dev@...; integration-dev@... Subject: Re: [integration-dev] Inputs on cbench-like Java based tool that supports openflow 1.3 Madhava, Since this tool should be controller agnostic, Daniel's idea of hosting it in the Perf Group umbrella makes perfect sense. There are a lot of *features* we'd all probably like to have but no need to eat the whole elephant now. If we just had a tool that replicated the current cbench test with OF1.3, we would start using it immediately :) Feel free to reach out for help anytime. Someone always seems ready to help. JamO On 08/31/2015 03:22 PM, Madhava Bangera, Raksha wrote: Thanks, Daniel for your feedback and encouragement! |
|
Jamo Luhrsen <jluhrsen@...>
Madhava,
toggle quoted message
Show quoted text
Since this tool should be controller agnostic, Daniel's idea of hosting it in the Perf Group umbrella makes perfect sense. There are a lot of *features* we'd all probably like to have but no need to eat the whole elephant now. If we just had a tool that replicated the current cbench test with OF1.3, we would start using it immediately :) Feel free to reach out for help anytime. Someone always seems ready to help. JamO On 08/31/2015 03:22 PM, Madhava Bangera, Raksha wrote:
Thanks, Daniel for your feedback and encouragement! |
|
Madhava Bangera, Raksha <raksha.madhava.bangera@...>
Thanks, Daniel for your feedback and encouragement!
toggle quoted message
Show quoted text
-----Original Message-----
From: Daniel Farrell [mailto:dfarrell@...] Sent: Saturday, August 29, 2015 8:28 AM To: Madhava Bangera, Raksha Cc: integration-dev@...; openflowjava-dev@... Subject: Re: [integration-dev] Inputs on cbench-like Java based tool that supports openflow 1.3 Hello Raksha! This is a great project! Wonderful news to start a Saturday. :) There have been discussions about building a CBench replacement for quite some time. Ed and I talked about it at a Dev Design Summit seriously enough that I created a "Better CBench" repo (but didn't actually end up with time to build it). There's little doubt that it needs to be replaced. WCBench makes it more usable, but CBench is barely holding together and is becoming more and more irrelevant as OF1.3 becomes normal. One thing to keep in mind is that CBench-style tests aren't meant to provide more than a small portion of the performance picture for an SDN controller. Tests that uses OF southbound packet-in messages to stress the controller are also very hard to compare controller to controller, as it's easy to optimize that metric to amazing values without actually getting much real-world benefit. It also of course only applies to reactive OF SDN controllers. That said, CBench and WCBench have found a bunch of bugs for us and we still use them in CI to help watch for changes in performance (and verify it doesn't fall off a cliff). You could do this work under the umbrella of the newly created ODL Performance Group (I'm on a wiki-creating sprint atm, link soon). The idea is to provide a namespace under which we can organize perf work. I'd be glad to help! as you can tell I've thought about this quite a bit and am excited it's making more progress. Thank you for your work! Daniel Farrell Software Engineer, Red Hat SDN Team https://twitter.com/dfarrell07 ----- Original Message ----- Hi all, |
|
Daniel Farrell <dfarrell@...>
Hello Raksha!
toggle quoted message
Show quoted text
This is a great project! Wonderful news to start a Saturday. :) There have been discussions about building a CBench replacement for quite some time. Ed and I talked about it at a Dev Design Summit seriously enough that I created a "Better CBench" repo (but didn't actually end up with time to build it). There's little doubt that it needs to be replaced. WCBench makes it more usable, but CBench is barely holding together and is becoming more and more irrelevant as OF1.3 becomes normal. One thing to keep in mind is that CBench-style tests aren't meant to provide more than a small portion of the performance picture for an SDN controller. Tests that uses OF southbound packet-in messages to stress the controller are also very hard to compare controller to controller, as it's easy to optimize that metric to amazing values without actually getting much real-world benefit. It also of course only applies to reactive OF SDN controllers. That said, CBench and WCBench have found a bunch of bugs for us and we still use them in CI to help watch for changes in performance (and verify it doesn't fall off a cliff). You could do this work under the umbrella of the newly created ODL Performance Group (I'm on a wiki-creating sprint atm, link soon). The idea is to provide a namespace under which we can organize perf work. I'd be glad to help! as you can tell I've thought about this quite a bit and am excited it's making more progress. Thank you for your work! Daniel Farrell Software Engineer, Red Hat SDN Team https://twitter.com/dfarrell07 ----- Original Message -----
Hi all, |