All Systems are up and running
This page provides a real-time overview of Mendix system status, details on upcoming scheduled maintenance, and a record of past incidents. Refer to the documentation for more information.
Mendix Cloud v3 EU - Physical server outage
Incident
Report for Mendix Technology
Postmortem
After closely analysing the chain of events and the involved components we have come to the following conclusion.
- A disk failure in the shared data storage system was handled in an unexpected manner by the storage system which resulted in issues with the stability of the network connections.
- After eliminating any possible cause, resetting individual network connections and finally one of the core network switches resulted in regaining network stability.
- Mendix is working with suppliers to resolve any possible underlying issue to prevent this incident from occurring again.
Please contact customer support should you require more information.
Resolved
This incident has been resolved.
Monitoring
The reboot of the networking infrastructure has alleviated the stability issue and the environment is performing as expected. We are monitoring the situation and will update the status when necessary.
Update
The engineers are still working on restarting the networking infrastructure. We will post the next update in an hour.
Update
The next step in the process of resolving this issue will be to restart all other components in the networking infrastructure. We will post the next update in an hour.
Update
In cooperation with the supplier, engineers are currently working to clear, reset and restore the connections between the storage subsystem and the servers. We are analysing the results of this action and will post a next update in an hour.
Investigating
The engineers working on the case have come to the conclusion after resolving a likely root cause that this did not resolve the stability issue which is causing the partial failure. We are continuing the investigations and will post a next update in 1 hour.
Identified
The engineers working on this issue have isolated a likely root cause and are working towards a recovery scenario. We currently expect to see results of this at around 15:00 CEST. We will post an update on or before that time.
Update
Unfortunately, we have no news to report. We are continuing investigating this issue with the supplier and will post another update within 1 hour.
Update
A number of applications running on Mx Cloud V3 are experiencing slowdowns due to the partial storage failure.
We are continuing investigating this issue with the supplier and will post another update within 1 hour.
We are continuing investigating this issue with the supplier and will post another update within 1 hour.
Investigating
We are experiencing a partial failure on the storage subsystem in Mendix Cloud v3 EU. We're currently investigating the issue and will post an update within 1 hour of this posting.