ISSUE IS RESOLVED
I want to address the recent slowness on our servers and share what I know so far. This incident started around 10:21 AM EST and lasted until approximately 1:05 PM EST, during which apps were painfully slow, essentially to the point of being unusable.
First and foremost, everything is now back up and running smoothly. However, my team and I are still investigating the root cause of the issue. What I can tell you is that this event was highly unusual. We did not detect any specific issues within the Tadabase platform, and we did not make any updates or changes that could have triggered this slowdown.
In response to the slowness, we rebooted some of our servers, but unfortunately, this did not resolve the issue. Upon further investigation, we discovered that the same slowness impacted 76 database clusters across three entirely unrelated AWS accounts. This has led me to strongly believe there was a significant underlying issue with AWS RDS (Relational Database Service), even though AWS is currently reporting no disruptions on their end.
We are in direct contact with AWS to further investigate this and am continuing to review logs and diagnostics to uncover any potential explanations. While the exact cause remains unclear, I want to assure you that I am fully committed to getting to the bottom of this. I will continue to provide updates as I learn more.
I deeply appreciate your patience and understanding during this time.
Moe
