Netvirt jobs are failing with stack error: uwsgi directory no found


JamO Luhrsen
 

Thanks. I gave a review just now.

JamO

On 6/16/20 5:15 AM, srinivas.rachakonda@... wrote:

Hi Jamo,

 

Raised the below review:

https://git.opendaylight.org/gerrit/c/releng/builder/+/90459

 

 

 

Thanks,

Srinivas

+91-9243478719

 

From: Jamo Luhrsen <jluhrsen@...>
Sent: 16 June 2020 00:04
To: srinivas.rachakonda@...; 'Anil Belur' <abelur@...>
Cc: 'Thanh Ha' <zxiiro@...>; 'Dayavanti Gopal Kamath' <dayavanti.gopal.kamath@...>; 'P S Ravikanth' <ravikanth.ps@...>; 'odl netvirt dev' <netvirt-dev@...>; 'Karthikeyan Krishnan' <karthikeyan.k@...>; integration-dev@...
Subject: Re: Netvirt jobs are failing with stack error: uwsgi directory no found

 

The last passing job is installing uWSGI v2.0.18 so maybe v2.0.19 is broken? Maybe you can
try pinning it back to v2.0.18 to see if it helps?

 

Thanks,
JamO

 

On 6/15/20 8:31 AM, srinivas.rachakonda@... wrote:

Hi Jamo/Anil,

 

Netvirt CSIT jobs are failing with the below error since morning.

 

https://logs.opendaylight.org/releng/vex-yul-odl-jenkins-1/netvirt-csit-1node-0cmb-1ctl-2cmp-openstack-queens-upgrade-snat-conntrack-magnesium/274/control_1/stack.log.gz

 

 

2020-06-15 10:54:16.154 |   Downloading https://files.pythonhosted.org/packages/6f/e9/729f0eb15f4847c729c1a841bcbb5e327d08d208de0cbe661224955c9297/uWSGI-2.0.19.tar.gz (804kB)

2020-06-15 10:54:17.017 |   Saved ./uWSGI-2.0.19.tar.gz

2020-06-15 10:54:19.063 | Successfully downloaded uwsgi

2020-06-15 10:54:19.808 | You are using pip version 9.0.3, however version 20.1.1 is available.

2020-06-15 10:54:19.808 | You should consider upgrading via the 'pip install --upgrade pip' command.

2020-06-15 10:54:19.853 | + lib/apache:install_apache_uwsgi:97       :   local uwsgi

2020-06-15 10:54:19.858 | ++ lib/apache:install_apache_uwsgi:98       :   ls 'uwsgi*'

2020-06-15 10:54:19.861 | ls: cannot access uwsgi*: No such file or directory

2020-06-15 10:54:19.865 | + lib/apache:install_apache_uwsgi:98       :   uwsgi=

2020-06-15 10:54:19.869 | + lib/apache:install_apache_uwsgi:1        :   exit_trap

2020-06-15 10:54:19.873 | + ./stack.sh:exit_trap:516                 :   local r=2

2020-06-15 10:54:19.877 | ++ ./stack.sh:exit_trap:517                 :   jobs -p

2020-06-15 10:54:19.879 | + ./stack.sh:exit_trap:517                 :   jobs=

2020-06-15 10:54:19.881 | + ./stack.sh:exit_trap:520                 :   [[ -n '' ]]

2020-06-15 10:54:19.883 | + ./stack.sh:exit_trap:526                 :   '[' -f '' ']'

2020-06-15 10:54:19.885 | + ./stack.sh:exit_trap:531                 :   kill_spinner

2020-06-15 10:54:19.887 | + ./stack.sh:kill_spinner:430              :   '[' '!' -z '' ']'

2020-06-15 10:54:19.889 | + ./stack.sh:exit_trap:533                 :   [[ 2 -ne 0 ]]

2020-06-15 10:54:19.891 | + ./stack.sh:exit_trap:534                 :   echo 'Error on exit'

2020-06-15 10:54:19.891 | Error on exit

2020-06-15 10:54:19.894 | + ./stack.sh:exit_trap:536                 :   type -p generate-subunit

2020-06-15 10:54:19.896 | + ./stack.sh:exit_trap:537                 :   generate-subunit 1592218203 256 fail

2020-06-15 10:54:21.128 | + ./stack.sh:exit_trap:539                 :   [[ -z /opt/stack/logs ]]

2020-06-15 10:54:21.132 | + ./stack.sh:exit_trap:542                 :   /opt/stack/devstack/tools/worlddump.py -d /opt/stack/logs

2020-06-15 10:54:21.513 | ovs-vsctl: unix:/var/run/openvswitch/db.sock: database connection failed (No such file or directory)

2020-06-15 10:54:21.616 | ovs-vsctl: unix:/var/run/openvswitch/db.sock: database connection failed (No such file or directory)

2020-06-15 10:54:22.462 | + ./stack.sh:exit_trap:551                 :   exit 2

 

Could you please look into the issue.

 

 

Thanks,

Srinivas

+91-9243478719

 


Srinivas <srinivas.rachakonda@...>
 

Hi Jamo,

 

Raised the below review:

https://git.opendaylight.org/gerrit/c/releng/builder/+/90459

 

 

 

Thanks,

Srinivas

+91-9243478719

 

From: Jamo Luhrsen <jluhrsen@...>
Sent: 16 June 2020 00:04
To: srinivas.rachakonda@...; 'Anil Belur' <abelur@...>
Cc: 'Thanh Ha' <zxiiro@...>; 'Dayavanti Gopal Kamath' <dayavanti.gopal.kamath@...>; 'P S Ravikanth' <ravikanth.ps@...>; 'odl netvirt dev' <netvirt-dev@...>; 'Karthikeyan Krishnan' <karthikeyan.k@...>; integration-dev@...
Subject: Re: Netvirt jobs are failing with stack error: uwsgi directory no found

 

The last passing job is installing uWSGI v2.0.18 so maybe v2.0.19 is broken? Maybe you can
try pinning it back to v2.0.18 to see if it helps?

 

Thanks,
JamO

 

On 6/15/20 8:31 AM, srinivas.rachakonda@... wrote:

Hi Jamo/Anil,

 

Netvirt CSIT jobs are failing with the below error since morning.

 

https://logs.opendaylight.org/releng/vex-yul-odl-jenkins-1/netvirt-csit-1node-0cmb-1ctl-2cmp-openstack-queens-upgrade-snat-conntrack-magnesium/274/control_1/stack.log.gz

 

 

2020-06-15 10:54:16.154 |   Downloading https://files.pythonhosted.org/packages/6f/e9/729f0eb15f4847c729c1a841bcbb5e327d08d208de0cbe661224955c9297/uWSGI-2.0.19.tar.gz (804kB)

2020-06-15 10:54:17.017 |   Saved ./uWSGI-2.0.19.tar.gz

2020-06-15 10:54:19.063 | Successfully downloaded uwsgi

2020-06-15 10:54:19.808 | You are using pip version 9.0.3, however version 20.1.1 is available.

2020-06-15 10:54:19.808 | You should consider upgrading via the 'pip install --upgrade pip' command.

2020-06-15 10:54:19.853 | + lib/apache:install_apache_uwsgi:97       :   local uwsgi

2020-06-15 10:54:19.858 | ++ lib/apache:install_apache_uwsgi:98       :   ls 'uwsgi*'

2020-06-15 10:54:19.861 | ls: cannot access uwsgi*: No such file or directory

2020-06-15 10:54:19.865 | + lib/apache:install_apache_uwsgi:98       :   uwsgi=

2020-06-15 10:54:19.869 | + lib/apache:install_apache_uwsgi:1        :   exit_trap

2020-06-15 10:54:19.873 | + ./stack.sh:exit_trap:516                 :   local r=2

2020-06-15 10:54:19.877 | ++ ./stack.sh:exit_trap:517                 :   jobs -p

2020-06-15 10:54:19.879 | + ./stack.sh:exit_trap:517                 :   jobs=

2020-06-15 10:54:19.881 | + ./stack.sh:exit_trap:520                 :   [[ -n '' ]]

2020-06-15 10:54:19.883 | + ./stack.sh:exit_trap:526                 :   '[' -f '' ']'

2020-06-15 10:54:19.885 | + ./stack.sh:exit_trap:531                 :   kill_spinner

2020-06-15 10:54:19.887 | + ./stack.sh:kill_spinner:430              :   '[' '!' -z '' ']'

2020-06-15 10:54:19.889 | + ./stack.sh:exit_trap:533                 :   [[ 2 -ne 0 ]]

2020-06-15 10:54:19.891 | + ./stack.sh:exit_trap:534                 :   echo 'Error on exit'

2020-06-15 10:54:19.891 | Error on exit

2020-06-15 10:54:19.894 | + ./stack.sh:exit_trap:536                 :   type -p generate-subunit

2020-06-15 10:54:19.896 | + ./stack.sh:exit_trap:537                 :   generate-subunit 1592218203 256 fail

2020-06-15 10:54:21.128 | + ./stack.sh:exit_trap:539                 :   [[ -z /opt/stack/logs ]]

2020-06-15 10:54:21.132 | + ./stack.sh:exit_trap:542                 :   /opt/stack/devstack/tools/worlddump.py -d /opt/stack/logs

2020-06-15 10:54:21.513 | ovs-vsctl: unix:/var/run/openvswitch/db.sock: database connection failed (No such file or directory)

2020-06-15 10:54:21.616 | ovs-vsctl: unix:/var/run/openvswitch/db.sock: database connection failed (No such file or directory)

2020-06-15 10:54:22.462 | + ./stack.sh:exit_trap:551                 :   exit 2

 

Could you please look into the issue.

 

 

Thanks,

Srinivas

+91-9243478719

 


JamO Luhrsen
 

The last passing job is installing uWSGI v2.0.18 so maybe v2.0.19 is broken? Maybe you can
try pinning it back to v2.0.18 to see if it helps?


Thanks,
JamO


On 6/15/20 8:31 AM, srinivas.rachakonda@... wrote:

Hi Jamo/Anil,

 

Netvirt CSIT jobs are failing with the below error since morning.

 

https://logs.opendaylight.org/releng/vex-yul-odl-jenkins-1/netvirt-csit-1node-0cmb-1ctl-2cmp-openstack-queens-upgrade-snat-conntrack-magnesium/274/control_1/stack.log.gz

 

 

2020-06-15 10:54:16.154 |   Downloading https://files.pythonhosted.org/packages/6f/e9/729f0eb15f4847c729c1a841bcbb5e327d08d208de0cbe661224955c9297/uWSGI-2.0.19.tar.gz (804kB)

2020-06-15 10:54:17.017 |   Saved ./uWSGI-2.0.19.tar.gz

2020-06-15 10:54:19.063 | Successfully downloaded uwsgi

2020-06-15 10:54:19.808 | You are using pip version 9.0.3, however version 20.1.1 is available.

2020-06-15 10:54:19.808 | You should consider upgrading via the 'pip install --upgrade pip' command.

2020-06-15 10:54:19.853 | + lib/apache:install_apache_uwsgi:97       :   local uwsgi

2020-06-15 10:54:19.858 | ++ lib/apache:install_apache_uwsgi:98       :   ls 'uwsgi*'

2020-06-15 10:54:19.861 | ls: cannot access uwsgi*: No such file or directory

2020-06-15 10:54:19.865 | + lib/apache:install_apache_uwsgi:98       :   uwsgi=

2020-06-15 10:54:19.869 | + lib/apache:install_apache_uwsgi:1        :   exit_trap

2020-06-15 10:54:19.873 | + ./stack.sh:exit_trap:516                 :   local r=2

2020-06-15 10:54:19.877 | ++ ./stack.sh:exit_trap:517                 :   jobs -p

2020-06-15 10:54:19.879 | + ./stack.sh:exit_trap:517                 :   jobs=

2020-06-15 10:54:19.881 | + ./stack.sh:exit_trap:520                 :   [[ -n '' ]]

2020-06-15 10:54:19.883 | + ./stack.sh:exit_trap:526                 :   '[' -f '' ']'

2020-06-15 10:54:19.885 | + ./stack.sh:exit_trap:531                 :   kill_spinner

2020-06-15 10:54:19.887 | + ./stack.sh:kill_spinner:430              :   '[' '!' -z '' ']'

2020-06-15 10:54:19.889 | + ./stack.sh:exit_trap:533                 :   [[ 2 -ne 0 ]]

2020-06-15 10:54:19.891 | + ./stack.sh:exit_trap:534                 :   echo 'Error on exit'

2020-06-15 10:54:19.891 | Error on exit

2020-06-15 10:54:19.894 | + ./stack.sh:exit_trap:536                 :   type -p generate-subunit

2020-06-15 10:54:19.896 | + ./stack.sh:exit_trap:537                 :   generate-subunit 1592218203 256 fail

2020-06-15 10:54:21.128 | + ./stack.sh:exit_trap:539                 :   [[ -z /opt/stack/logs ]]

2020-06-15 10:54:21.132 | + ./stack.sh:exit_trap:542                 :   /opt/stack/devstack/tools/worlddump.py -d /opt/stack/logs

2020-06-15 10:54:21.513 | ovs-vsctl: unix:/var/run/openvswitch/db.sock: database connection failed (No such file or directory)

2020-06-15 10:54:21.616 | ovs-vsctl: unix:/var/run/openvswitch/db.sock: database connection failed (No such file or directory)

2020-06-15 10:54:22.462 | + ./stack.sh:exit_trap:551                 :   exit 2

 

Could you please look into the issue.

 

 

Thanks,

Srinivas

+91-9243478719