All Systems Operational
Website Operational
Platform Analysis ? Operational
Classic Analysis ? Operational
GitHub Operational
Operational
Degraded Performance
Partial Outage
Major Outage
Maintenance
System Metrics Month Week Day
Error Rate
Fetching
Analysis processing time
Fetching
Past Incidents
Sep 29, 2016

No incidents reported today.

Sep 28, 2016

No incidents reported.

Sep 27, 2016
Resolved - This incident has been resolved.
Sep 27, 14:15 EDT
Monitoring - We made a change to our churn calculation job to perform far less work. Calculation time has returned to normal.
Sep 27, 13:39 EDT
Identified - We've been alerted to a delay in calculating churn information. We're bringing on more workers to handle the increased traffic.
Sep 27, 11:13 EDT
Sep 26, 2016
Resolved - This incident has been resolved.
Sep 26, 09:51 EDT
Monitoring - We've made it through the backlog and the system is operating normally now.
Sep 26, 08:32 EDT
Identified - An incident has been reported in our AWS region that explains the networking connectivity errors we were seeing. The system seems healthier now, but analysis is still delayed as we work through a backlog of work.
Sep 26, 08:23 EDT
Investigating - We're experiencing connection timeouts talking to 3rd-party services like GitHub, Stripe, etc. Users may experience errors on the website, a delay in analysis starting, or analysis errors related to the clone step. We're investigating.
Sep 26, 08:06 EDT
Sep 25, 2016

No incidents reported.

Sep 24, 2016

No incidents reported.

Sep 23, 2016

No incidents reported.

Sep 22, 2016

No incidents reported.

Sep 21, 2016

No incidents reported.

Sep 20, 2016

No incidents reported.

Sep 19, 2016

No incidents reported.

Sep 18, 2016
Resolved - This incident has been resolved.
Sep 18, 23:02 EDT
Monitoring - Correction: Classic analysis is operating normally, we were misreading some metrics when we made the last update. All systems should be operating normally at this time.
Sep 18, 22:59 EDT
Update - We tracked the issue down to ECS services not being placed correctly after the underlying EC2 instances were rotated (as they are every night). The website and Platform analysis is operating normally now. Our Classic analysis hasn't recovered yet, and we're working to address that now.
Sep 18, 22:57 EDT
Update - After restarting some services, the site is back up and analysis is occurring normally. We're continuing to monitor and trying to identify a root cause.
Sep 18, 22:41 EDT
Identified - Our site is down and analysis appears stopped. We're investigating.
Sep 18, 22:28 EDT
Resolved - This incident has been resolved.
Sep 18, 06:28 EDT
Monitoring - All services appear to be back to normal. We are continuing to monitor system health.
Sep 18, 06:23 EDT
Identified - Our database experienced connectivity issues several minutes ago impacted site availability for a few minutes. We've addressed site connectivity, and are investigating additional connectivity issues in our analysis services which will be delaying analysis results.
Sep 18, 06:11 EDT
Sep 17, 2016

No incidents reported.

Sep 16, 2016
Resolved - This incident has been resolved.
Sep 16, 07:49 EDT
Monitoring - Analysis wait times have returned to normal.
Sep 16, 06:25 EDT
Identified - We identified a service stuck processing a bad message. After clearing the bad message, things are moving again. We're currently processing the backlog of work, so analysis wait times may remain elevated for a few more minutes.
Sep 16, 06:20 EDT
Investigating - We've been alerted to a back up in our services starting analysis. We're investigating the cause.
Sep 16, 06:01 EDT
Sep 15, 2016

No incidents reported.