1. Integration-Dev
  2. Topics

[release] [integration-dev] [it-infrastructure-alerts][notice] ODL maintenance window (12:00p Wed, Nov 3 to 8:30p Wed, Nov 3 UTC)

Daniel de la Rosa
 

Hi Anil and all

it looks like all services are still down.. any ETA?

Thanks

On Wed, Nov 3, 2021 at 3:42 AM Anil Belur <abelur@...> wrote:
ODL Maintenance window is starting soon, Jenkins (releng and sandbox) has been put in restart mode. Will notify here once everything is complete. 

On Wed, Oct 27, 2021 at 5:40 PM Anil Belur <abelur@...> wrote:
What: LF will perform migration and system updates on all ODL systems.

When: 12:00p Wed, Nov 3 to 8:30pm Wed, Nov 3 UTC (10:00pm Wed, Nov 3 to 6:30am Thu, Nov 4 AEST)

Why: ODL Services (Jenkins, Nexus, Sigul, Ingress) would be migrated across data centers. LF will install system updates on all ODL nodes and services.
 
Impact: Users may be unable to access any services (Jira, Gerrit, Wiki, Jenkins, Sonar, Nexus, Sigul) during this time.

Jenkins will be put in shutdown mode before the window starts and any long-running Jenkins jobs _will_ be canceled if they don't complete before the start of the window. Notices will be posted to the mailing lists and on the LFN #opendaylight slack channel at the start and end of the maintenance.

https://www.worldtimebuddy.com/?qm=1&lid=100,6077243,2174003&h=100&date=2021-11-3&sln=12-20.5&hf=1

Thanks,
Anil Belur
Robert Varga
 

On 03/11/2021 20:48, Daniel de la Rosa wrote:
Hi Anil and all
it looks like all services are still down.. any ETA?
Hmm, just got a message about maintenance being complete, wiki/gerrit/jira work, but jenkins is reporting a 502.

Regards,
Robert

OpenPGP_signature

OpenPGP_signature

Daniel de la Rosa
 

Robert, Casey just told me in slack that nexus and jenkins taking longer to migrate... no ETA according to @Andrew Grimberg and @Anil Belur 


On Wed, Nov 3, 2021 at 1:34 PM Robert Varga <nite@...> wrote:


On 03/11/2021 20:48, Daniel de la Rosa wrote:
> Hi Anil and all
>
> it looks like all services are still down.. any ETA?

Hmm, just got a message about maintenance being complete,
wiki/gerrit/jira work, but jenkins is reporting a 502.

Regards,
Robert
Casey Cain
 

I just got a ping from Andy on Slack.

We're working with Vexxhost to get the systems online ASAP. After some discussions we're going to be bringing them up and some of this migration is going to be done another way. Otherwise we're talking over 20 hours of downtime after what we've been seeing with the migration

The primary portion of the migration has been completed, what's taking so long is data partition migrations, but we've got an alternative to the offline migration because of how we manage our systems (thankfully).  We'll see some degraded performance, but not significant.

I'll let you know if I hear anything else.

Best,
Casey Cain
Senior Technical Community Architect
Linux Foundation
_________________
WeChat: okaru6
WhatsApp: +1.503.779.4519

Sent via Superhuman


On Wed, Nov 03, 2021 at 1:49 PM, Daniel de la Rosa <ddelarosa0707@...> wrote:
Robert, Casey just told me in slack that nexus and jenkins taking longer to migrate... no ETA according to @Andrew Grimberg and @Anil Belur 

On Wed, Nov 3, 2021 at 1:34 PM Robert Varga <nite@hq.sk> wrote:


On 03/11/2021 20:48, Daniel de la Rosa wrote:
> Hi Anil and all
>
> it looks like all services are still down.. any ETA?

Hmm, just got a message about maintenance being complete,
wiki/gerrit/jira work, but jenkins is reporting a 502.

Regards,
Robert

1 - 4 of 4