Lecture Capture Status
Echo360 Status
March 8, 2023 7:08PM UTC
Investigating - We are investigating an issue with EchoVideo System Access in our Asia Pacific region. Please stay tuned to status.echo360.com; we'll have another update within the next hour.
March 8, 2023 8:08PM UTC
Investigating - We are aware that some of our customers in the Asia Pacific region are experiencing difficulty logging into the EchoVideo platform. Our Engineering and Site Reliability teams are isolating the problem to resolve the authentication errors.
March 8, 2023 9:05PM UTC
Monitoring - Our Engineering and Site Reliability teams have identified and resolved the authentication issues for the EchoVideo platform in the Asia Pacific region. We are continuing to monitor the system and will have another update within the next hour.
March 8, 2023 10:10PM UTC
Resolved - Our Engineering team has confirmed that the authentication issues on the EchoVideo platform in the Asia Pacific region are now resolved. We will ensure that all capture processing tasks complete successfully and will provide a full incident report here shortly.
March 10, 2023 2:09PM UTC
Resolved - Echo360 Incident Report 20170603
Incident Date:
Start: 2023-03-09 04:40 AM AEDT
End: 2023-03-09 07:58 AM AEDT
Region(s) Affected:
Echo360 Asia Pacific Region
Service(s) Affected:
EchoVideo
User Impact:
Users were unable to log into EchoVideo in our Asia Pacific Region.
Timeline:
2023-03-09 04:40 AM AEDT: Echo360 deployed an update to a third-party integration for EchoVideo in the Asia Pacific region, resulting in subsequent authentication errors in the region.
2023-03-09 05:30 AM AEDT: Echo360 identified an increase in error messages on the EchoVideo platform in our Asia Pacific region and began investigating the issue.
2023-03-09 06:00 AM AEDT: Echo360 confirmed this as a service disruption and continued to investigate the issue.
2023-03-09 07:50 AM AEDT: Echo360 identified the root cause for the issue and deployed a fix restoring service in the Asia Pacific Region
2023-03-09 07:58 AM AEDT: Echo360 verified access was restored in the Asia Pacific region and continued to monitor the platform.
2023-03-09 09:04 AM AEDT: Echo360 resolved the incident.
Summary, Root Cause, and Resolution:
The EchoVideo platform in the Asia Pacific region experienced a disruption resulting in user authentication failures following an update to a third-party integration in the region. After identifying the root cause, the Echo360 team deployed a fix resolving the issue.
Corrective Action:
Echo360 is updating our pre-deployment testing process as well as our internal monitoring and notification services. This will reduce the chance of a similar incident occurring in the future as well as reduce the time required to identify and respond to future incidents.
Investigating - We are investigating an issue with EchoVideo System Access in our Asia Pacific region. Please stay tuned to status.echo360.com; we'll have another update within the next hour.
March 8, 2023 8:08PM UTC
Investigating - We are aware that some of our customers in the Asia Pacific region are experiencing difficulty logging into the EchoVideo platform. Our Engineering and Site Reliability teams are isolating the problem to resolve the authentication errors.
March 8, 2023 9:05PM UTC
Monitoring - Our Engineering and Site Reliability teams have identified and resolved the authentication issues for the EchoVideo platform in the Asia Pacific region. We are continuing to monitor the system and will have another update within the next hour.
March 8, 2023 10:10PM UTC
Resolved - Our Engineering team has confirmed that the authentication issues on the EchoVideo platform in the Asia Pacific region are now resolved. We will ensure that all capture processing tasks complete successfully and will provide a full incident report here shortly.
March 10, 2023 2:09PM UTC
Resolved - Echo360 Incident Report 20170603
Incident Date:
Start: 2023-03-09 04:40 AM AEDT
End: 2023-03-09 07:58 AM AEDT
Region(s) Affected:
Echo360 Asia Pacific Region
Service(s) Affected:
EchoVideo
User Impact:
Users were unable to log into EchoVideo in our Asia Pacific Region.
Timeline:
2023-03-09 04:40 AM AEDT: Echo360 deployed an update to a third-party integration for EchoVideo in the Asia Pacific region, resulting in subsequent authentication errors in the region.
2023-03-09 05:30 AM AEDT: Echo360 identified an increase in error messages on the EchoVideo platform in our Asia Pacific region and began investigating the issue.
2023-03-09 06:00 AM AEDT: Echo360 confirmed this as a service disruption and continued to investigate the issue.
2023-03-09 07:50 AM AEDT: Echo360 identified the root cause for the issue and deployed a fix restoring service in the Asia Pacific Region
2023-03-09 07:58 AM AEDT: Echo360 verified access was restored in the Asia Pacific region and continued to monitor the platform.
2023-03-09 09:04 AM AEDT: Echo360 resolved the incident.
Summary, Root Cause, and Resolution:
The EchoVideo platform in the Asia Pacific region experienced a disruption resulting in user authentication failures following an update to a third-party integration in the region. After identifying the root cause, the Echo360 team deployed a fix resolving the issue.
Corrective Action:
Echo360 is updating our pre-deployment testing process as well as our internal monitoring and notification services. This will reduce the chance of a similar incident occurring in the future as well as reduce the time required to identify and respond to future incidents.
14:09, Fri 10 Mar 2023
February 16, 2023 6:50PM UTC
Scheduled - The Relational Database Service (RDS) MySQL clusters that EchoVideo uses in AWS will be upgraded to a newer version as part of our standard maintenance process. Echo360 has performed many tests upgrading MySQL in preparation for this upgrade and have scheduled the updates during low usage periods as follows:
• North America Region: Saturday 18th February, 10am EST
Users of the platform at this time may experience connection and/or authentication errors while this maintenance is being performed but reconnection should occur automatically. An update will be posted on our status page https://status.echo360.com/ once the maintenance has completed.
February 18, 2023 3:10PM UTC
Active - The Scheduled Maintenance has started. Once complete, we will update the status page.
February 18, 2023 4:27PM UTC
Completed - The scheduled maintenance has been completed. If you are experiencing issues, please contact support@echo360.com.
Scheduled - The Relational Database Service (RDS) MySQL clusters that EchoVideo uses in AWS will be upgraded to a newer version as part of our standard maintenance process. Echo360 has performed many tests upgrading MySQL in preparation for this upgrade and have scheduled the updates during low usage periods as follows:
• North America Region: Saturday 18th February, 10am EST
Users of the platform at this time may experience connection and/or authentication errors while this maintenance is being performed but reconnection should occur automatically. An update will be posted on our status page https://status.echo360.com/ once the maintenance has completed.
February 18, 2023 3:10PM UTC
Active - The Scheduled Maintenance has started. Once complete, we will update the status page.
February 18, 2023 4:27PM UTC
Completed - The scheduled maintenance has been completed. If you are experiencing issues, please contact support@echo360.com.
16:27, Sat 18 Feb 2023
February 16, 2023 6:47PM UTC
Scheduled - The Relational Database Service (RDS) MySQL clusters that EchoVideo uses in AWS will be upgraded to a newer version as part of our standard maintenance process. Echo360 has performed many tests upgrading MySQL in preparation for this upgrade and have scheduled the updates during low usage periods as follows:
• Canada Region: Saturday 18th February, 12pm EST
Users of the platform at this time may experience connection and/or authentication errors while this maintenance is being performed but reconnection should occur automatically. An update will be posted on our status page https://status.echo360.com/ once the maintenance has completed.
February 18, 2023 3:10PM UTC
Active - The Scheduled Maintenance has started. Once complete, we will update the status page.
February 18, 2023 4:27PM UTC
Completed - The scheduled maintenance has been completed. If you are experiencing issues, please contact support@echo360.com.
Scheduled - The Relational Database Service (RDS) MySQL clusters that EchoVideo uses in AWS will be upgraded to a newer version as part of our standard maintenance process. Echo360 has performed many tests upgrading MySQL in preparation for this upgrade and have scheduled the updates during low usage periods as follows:
• Canada Region: Saturday 18th February, 12pm EST
Users of the platform at this time may experience connection and/or authentication errors while this maintenance is being performed but reconnection should occur automatically. An update will be posted on our status page https://status.echo360.com/ once the maintenance has completed.
February 18, 2023 3:10PM UTC
Active - The Scheduled Maintenance has started. Once complete, we will update the status page.
February 18, 2023 4:27PM UTC
Completed - The scheduled maintenance has been completed. If you are experiencing issues, please contact support@echo360.com.
16:27, Sat 18 Feb 2023