Delays in Stats Processing

• 4:00 PM PDT (UTC-7) June 12th, 2023

  What happened?
  On 06/12/23 at approximately 01:00 AM PDT, our data processing pipeline began failing. Upon investigation, we noticed degradation in our data warehouse provider. We initiated a reboot in order to resolve the issue.

  What was the impact?
  Between 06/12/23 01:00AM PDT and 06/12/23 04:00PM PDT, the following impact could have been experienced:

  • Charts had stale data or no data at all
  • There was a delay sending events to external tracking servers
  • Ad selection could have been based on stale data, resulting in campaign pacing issues

  How did we resolve the issue?
  Upon discovering degradation in our data warehouse provider’s servers, we initiated a reboot. The pipeline recovered by 11:00 AM PDT.

  We apologize for any inconvenience caused. Feel free to reach out to support@art19.com with any other questions or concerns.

  11:00 AM PDT (UTC-7) June 12th, 2023

  Our data pipeline has recovered and statistics are up to date. Due to the original delay, there is a backup in external tracking pings that will need to catch up. We will post another update once this has cleared.

  05:21 AM PDT (UTC-7) June 12th, 2023

  At approximately 01:00 AM PDT, our data processing pipeline began failing. Upon investigation, we noticed degradation in our data warehouse provider. We have remediated the issue but our pipeline is still currently recovering. During this time, you may notice:

  • Charts have stale data or no data at all
  • There is a delay sending events to external tracking servers
  • Ad selection has been based on stale data, resulting in campaign pacing issues