Sync Site Maintenance

The Sync site will undergo some maintenance on 2013-07-17 @ 21:00 UTC-4.  The site will be down for approximately 15-20 minutes.  This maintenance window will be used used to upgrade the memory in some servers.

-- The maintenance was completed at 21:29 UTC-4

2013-06-26 Site availability

We experienced a loss of connectivity to our web sites due to a distributed denial of service (DDOS) attack on an IP address located at the same data center as our equipment.  Below is the response from our data center's network operations team.  None of Supply Point Systems' equipment or services were directly targeted and none of our systems have been comprised or breeched as a result of the DDOS.

"At approximately 9:36 AM monitoring systems alerted us to packet loss

over our circuits to the datacenter. Engineers were able to

quickly isolate the cause of the attack to a DDOS attack to an IP on

the network and we subsequently mitigated the attack. Full service was

restored at approximately 9:48AM. Engineers are continuously reviewing

options that will help in preventing issues from wide spread DDOS

attacks. In recent weeks we have upgraded several network circuits to

improve capacity to handle DDOS attacks and we will continue to

increase the network capacity including DDOS mitigation services.

Engineers are continuing to monitor the network for any abnormalities.

We certainly apologize for the inconvenience caused by the attack this

morning."

Sync Site Restored

The sync site has been restored to a proper working status.  The site was down from 09:21 - 10:31 UTC-4.

The extended outage was caused by a remote management card that failed to properly reboot the web servers.  The management card has been replaced and the servers have been restarted.

Web Sync Availability

We have experienced a connectivity issue today between our web servers and our SAN.  An emergency reboot of the web servers was needed to restore connectivity.

Report Availability

We experienced a problem with the reporting library that caused the report viewer to appear blank.  Only the report viewer was effected and we were able to restart the reporting component.  Additional monitoring will be done to try to detect what the cause of the issue is so that we can prevent it in the future.

Sync Site Maintenance

The sync site will be offline for maintenance for approximately 15-20 minutes on May 8, 2013 starting at 21:30 UTC-5.

SPS Sync Outage

Problem:

The outage today on the sync site resulted from an unanticipated failure mode.  The primary sync web server had an issue connecting to some of its application files resulting in application errors.  Our load balancing system did not detect the site as being down so it did not redirect traffic to an alternate server.

Resolution:

Internal checks were added so that if this type of error occurs in the future, the site will be taken offline to allow the traffic to be redirected properly.