Advantedge digital status page

Current information on systems availability.

Check here for updates about AdvantEdge Digital's systems availability. 

CURRENT STATUS

AEA V2 Data Warehouse |  - Service Incident

5/20/2022
3:23 PM CT
The issue still persists. We are manually loading the files daily. We are continuing to troubleshoot with Microsoft. 

5/16/2022
9:11 AM CT
The issue still persists. We are manually loading the files daily. We are continuing to troubleshoot with Microsoft. 

5/13/2022
4:40 PM CT
The issue still persists. We are manually loading the files daily. We are continuing to troubleshoot with Microsoft. All of the files are up-to-date as of today.

5/12/2022
2:11 PM CT
 We have manually loaded the files successfully.
 
 5/11/2022
 10:42 AM CT
 All of the files are up-to-date. We are still monitoring the process closely.
 
 5/10/2022
 3:06 PM CT
 The issue has been resolved. We are still monitoring the process closely.
 
 5/10/2022
 9:14 AM CT
 We are working on loading the data from 5/8/2022 to current. 
 
 5/9/2022
 9:05 AM CT
 AEA  V2 Data Warehouse is up to date. We believe that today's ingestion process should also complete successfully. We are still monitoring the process closely.
 
 5/6/2022
 9:08 AM CT
 AEA  V2 Data Warehouse is up to date. We believe that today's ingestion process should also complete successfully. We are still monitoring the process closely.
 
 5/5/2022
 9:01 AM CT
 We have continued to work through this issue and have been able to progress further in the ingestion process. We have been able to successfully load the 05/03 files into the warehouse and working on getting the other missed days loaded.
 
 5/4/2022
 12:24 PM CT
 After implementing the MSFT recommended change yesterday afternoon, we attempted a manual run of the ingestion process. We found that the overall process was able to get past the previous steps that had failed, but it ended up failing on a later step. We've shared this information on the MSFT case and we will look into this new step failure.
 
 
 5/3/2022
 12:14 PM CT
 We are continuing our troubleshooting efforts with Microsoft.
 
 5/2/2022
 4:33 PM CT
 We have received the necessary information from SoftwareONE and will continue to troubleshoot with Microsoft Support to troubleshoot the issue.
 
 2:44 PM CT
 Our 3rd party vendors are meeting to review the issue.
 
 1:10 PM CT
Our AEA Infrastructure support team members began investigating the daily file ingestion pipelines that started failing. An error message indicated a specific file that we had received was not accessible. 
  
A critical support case (INC6802446) has been opened with SoftwareONE in order to troubleshoot this issue further.
 
 
Once we obtain the necessary information from SoftwareONE, we will continue to work with Microsoft Support to troubleshoot the issue.

 4/29/2022
 11:09 AM CT
 Some customer's daily warehouse ingestion process began failing at 11:09:50 am CT. No changes have been pushed to the code that manages the warehouse and the infrastructure is all up and running. That afternoon, we began engaging with Microsoft Support as the issue appears to be occurring at the management level of the Azure resources.
 
Client access to the warehouse is still available, but new data is currently unable to be ingested. As we receive meaningful updates from Microsoft, we will update you as well.

All DLX systems are fully operational

PAST INCIDENTS
  • Resolved 8:00 AM CT 5/13/2022
 Some customer's daily warehouse ingestion process began failing at 11:09:50 am CT on 4/29/2022. No changes have been pushed to the code that manages the warehouse and the infrastructure is all up and running. That afternoon, we began engaging with Microsoft Support as the issue appears to be occurring at the management level of the Azure resources.

  • Resolved 4:00 PM CT 4/21/2022
Connectivity to the AEA V1 is currently down. This is causing Power BI reports to not update.

  • Resolved 6:48 PM CT 2/6/2022
SSO users are unable to submit applications on CDX for some customers.
  • Resolved 5:30PM CT 12/10/2021
CDX Simulator New Auto loan terms are not populating for some customers.
Some customers are experiencing an issue with the CDX Simulator.