Unplanned downtime for customers in Norway

Incident Report for Ferdia

Resolved

🔍 Incident Details
----------------------
Time: July 22, 2025
Duration: Approximately 15 minutes
Affected Areas: All companies in Norway East and Norway West
Error Message: HTTP 503 – Service Unavailable

🛠️ What Happened?
------------------------
An error in an automated file handling rule (lifecycle policy) caused the most recent production file (image) for teq-frontend to be mistakenly deleted.

In Norway East and Norway West, high system load caused services to restart. When they attempted to fetch the file to start up again, it had already been deleted, resulting in a technical error (ImagePullBack Error).

✅ Actions Taken
---------------------
We immediately rebuilt and published the missing file via our pipeline. As a result, the service was quickly restored to normal operation.

🔧 Going Forward
---------------------
We are now reviewing all lifecycle policies with the relevant teams to ensure this cannot happen again.
Posted Jul 22, 2025 - 08:00 CEST