Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

Incident description

On 27th July 2019, the The host names opsdb1.dante.net and opsdb2.dante.net could not be resolved from the both Dashboard boxes. The root cause incident description can be found at: DNS Outage 2019-02-27

Incident severity: CRITICAL

...

Time (CET)
28 Jul, 22:00Issue Reported by OC
28 Jul, 22:30

Picked up by Robert L

28 Jul, 22:45

Fixed by updating the Dashboard application to point at prod-opsdb01,geant.net (and 02).

29 Jul, 08:10

The issue reported to Devops for root cause analyses.

29 Jul, 09:30
30 Jul, 14:30

Proposal was discussed between IT and SWD to avoid such failures in future.

20 Jun, 16.30

...

Details at - DNS Outage 2019-02-27

Proposed Solution

The Dashboard application updated to point at prod-opsdb01,geant.net (and 02) .