SPS Sync Site Issues

While the site was operational, we had an issue the morning of July 3 with several customer logins failing.  That was resolved mid-morning and had to do with a problem in an authentication routine.  

We also had an issue with saving and transmitting reports from the browser page.  This was fixed at approximately 5 PM EST.   This did NOT affect any scheduled tasks on the site.   

Sync Site DNS Outage

From approximately 09:20-09:40 UTC-4 our DNS provider stopped resolving traffic to https://spssync.net.  The problem has been resolved but there may be some residual delays accessing the site until DNS propagation completes in the next little while.

MIPWWEBSRV001 Application Error

From approximately 12:23 to 12:28 UTC-4 today, this particular web server experienced an application error that required a restart of the web server software.  Users that were connected to this web server at the time of the error may have experienced delays or error messages.  The server is operating normally now.

Portal Authentication Errors Today

We experienced a problem with the Portal site today that prevented it from authenticating users from the Sync site.  The authentication problem was isolated to a single web server so not every user of the site experienced the problem.  The problem was observed at approximately 09:45 UTC-4 and was resolved at approximately 10:25 UTC-4.

Sync Error Messages Today

We experienced a problem today with one of our web servers that was causing some users to experience errors.  The problem was isolated to a single web server and other web servers were still able to service traffic requests uninterrupted.  Our load balancers did not properly detect the error on the web server and as a result some users were sent to the troubled server while other users were sent to other functioning servers.  We will be investigating the issue and taking necessary actions to ensure better detection and mediation of this type of problem going forward.

Sync site outage

We experienced an outage on the sync site today at approximately 08:30 UTC -5 and it lasted for approximately 12 minutes.  The problem has been traced to our application delivery controllers and a support case has been escalated with our vendor's technical support group.

Insecure Sync Site Access (Update)

The redirect mechanism has been fixed and the insecure request will again be redirected to the secure site.

Insecure Sync Site Access

There is currently an issue with the Sync site in regards to plain text traffic.  The mechanism that automatically redirects insecure traffic to the secured site is not working properly at the moment.  The site is available but for right now; the https:// must be specified in order to connect to the site.  For example, https://spssync.net will work but http://spssync.net will not work.  

Sync Site Maintenance

The sync site had to be taken down for a critical software update.  The reboot happened @ 2014-01-06 22:15 EST.

Service Outage (Update)

As of 2014-01-06 20:00 EST the services have been restored.

Service Outage (Update)

The server has been repaired and the data is currently being restored from backup.  The web sites will be available again soon.

Service Outage

At 2014-01-06 01:46 EST we have experienced a hardware failure that effects one of our web application servers.  The following services will be unavailable until the hardware can be repaired.

www.supplypointsystems.com
ftp.supplypointsystems.com
fileshare.supplypointsystems.com