Resolved -
Redcentric update:
"Please be advised; following our previous update further close monitoring of the HSCN service has continued. Discussions with a small subset of customers have been taking place to address the latency reported yesterday.
Our close monitoring will continue into early next week as a precaution with the next update to be issued tomorrow unless circumstances change. "
We are closing this incident now as it appears to have reduced in scope and has not affected any Titan users.
Apr 18, 14:36 UTC
Update -
Redcentric update:
"Please be advised; close monitoring has taken place overnight and into this morning, during this time we have received some reports of latency being experienced from a small subset of customers. Discussions with these customers will take place on a case by case basis and next steps agreed.
In the meantime, our close monitoring of the service will continue and our next update will be tomorrow unless circumstances change."
Apr 17, 14:43 UTC
Monitoring -
Latest update from Redcentric received below, and the incident is ongoing. Please be aware this status update is precautionary and we have not seen any impact to any Titan services at present.
"Please be advised; work under change reference 9638536 has now concluded. Unfortunately, an issue was experienced with the configuration amendments and so the change has been backed out.
Our Core Network team will be performing a review to understand the next steps required. Overnight and into the morning, a period of close monitoring shall take place and a further update shall be issued this AM. "
Apr 17, 08:30 UTC
Update -
Further update from Redcentric:
"Please be advised; investigations have continued with our 3rd Line and Core Network teams. Off the back of these investigations, and to address an issue identified, an Emergency Change has been raised under reference 9638536 and scheduled for 6pm this evening.
During the change, our Core Network team will be making adjustments to the Quality of Service (QoS) configuration on one of our HSCN core devices. There is a risk, as with any change, that traffic may be disrupted. To avoid this, a failover on the specified interface will be performed, with a small outage expected while services failover. "
Apr 16, 13:00 UTC
Identified -
Update from Redcentric:
"Please be advised; investigations have been taking place between our 3rd Line and Core Network teams. These investigations have identified a potential issue on one of our core devices. This continues to be investigated alongside customers who have reported impact.
In the meantime, our Core Network team are reviewing next steps and further updates will be made available in due course. "
If you are experiencing any issues related to this please let us know.
Apr 16, 11:27 UTC
Investigating -
We have been advised by the HSCN provider Redcentric that they are currently experiencing an issue with HSCN network connectivity, which could cause latency/slow speeds for NHS spine access.
Titan uses Redcentric for its core HSCN connectivity from Titan to the spine, however so far we have not seen any impact to our services, but we will continue to monitor closely.
Any customers using Redcentric for their HSCN connection at the pharmacy may be affected directly for connections to Titan and the spine. We will provide an update when we have more information.
Apr 16, 10:48 UTC