Report an issue at: IIT Help Center, help@gsu.edu or call 404-413-HELP (4357)
Faculty/Staff Online Email Login Issues Reported
Incident Report for GSU Technology Systems
Postmortem

Incident Summary
At approximately 10:46am on Friday, March 20, 2015, a server error prevented GSU faculty and staff from accessing Microsoft's "Office 365" cloud-based services, including email, instant messenger (Lync), and SharePoint. These access issues persisted intermittently up until 9:46pm, when access was fully restored for all impacted customers. During this period, customers who remained logged in to Office 365 were not impacted.

Because we recognize that interruptions of service impact campus processes, we are communicating this post-outage analysis of what occurred and the measures being taken to address the factors resulting in this incident.

Incident Cause
The primary Active Directory Federation Services server that governs faculty and staff authentication to Microsoft Office 365 experienced an error during an automated token-signing certificate update process. This error resulted in certificates at GSU and Microsoft being out of sync, which caused the subsequent disruption of access. Microsoft support engineers are engaged and are actively investigating the root cause of the error.

Incident Response Measures
Information Systems & Technology is implementing improved monitoring of ADFS, developing a better understanding of Microsoft's automated certificate updating process, and establishing new procedures to ensure faster, more accurate customer communications in the event of future incidents.

Posted Mar 23, 2015 - 18:14 EDT

Resolved
Issues reported earlier with Faculty and Staff Email login page as well as Microsoft Cloud Services have successfully been resolved. If you are still experiencing problems with Faculty and Staff Email , please contact IS&T Help Center at help@gsu.edu or call 404-413-4357(Help).
Posted Mar 20, 2015 - 22:44 EDT
Update
IS&T is continuing to investigate reports of issues with Outlook Desktop Client Authentication, access via the Faculty and Staff Email webpage, and Microsoft Cloud Services (including Lync, OneDrive, and SharePoint). IS&T system engineers are currently working closely with Microsoft engineers to address the situation. Additional information will be posted here as it becomes available.
Posted Mar 20, 2015 - 18:23 EDT
Investigating
IS&T is investigating reports of a new issue with Outlook Desktop Client Authentication for some users. Users can log in to their email account on the web and this is not affecting email service. IS&T System Engineers are currently investigating the issue. Additional information will be posted here as it becomes available.
Posted Mar 20, 2015 - 13:44 EDT
Monitoring
IS&T has restored functionality to the Faculty and Staff Email login page as well as Microsoft Cloud Services. We will continue to monitor these systems for stability throughout the day. Please contact the IS&T Help Center if you are still experiencing any issues by email at help@gsu.edu or by phone at 404-413-HELP (404-413-4357).
Posted Mar 20, 2015 - 12:20 EDT
Identified
IS&T has confirmed an issue with the Faculty and Staff Email login page and Microsoft Cloud Services including services such as OneDrive and SharePoint. This does not appear to be affecting the Outlook Desktop Client or Email service itself. IS&T System Engineers are currently working on the issue. Additional information will be posted here as it becomes available.
Posted Mar 20, 2015 - 11:27 EDT
Investigating
IS&T is currently investigating reports of an issue with the Faculty and Staff Email login page. This does not appear to be affecting the Outlook Desktop Client or Email service itself, only the log in page for faculty and staff email online. Additional information will be posted here when the issue is confirmed.
Posted Mar 20, 2015 - 10:54 EDT