Update - Hi,

We have moved most client machines to the new management cluster. However there are still a number to move. So that we don't interfere with backup processes and other services we will reschedule the remainder and choose appropriate times to do the work in discussion with the client where appropriate.

regards,

Paul
Aug 15, 23:21 UTC
Monitoring - All clients in Enfield may experience some service slowdowns and very short periods of downtime over the next couple of hours while we work to resolve this issue.

We will be monitoring closely for affected services and apologise for the inconvenience caused.

regards,

Paul Orrock
Technical Director
Aug 15, 20:20 UTC
Update - Unfortunately we've been unable to resolve the issues without requiring downtime.

We are currently contacting all affected clients to schedule a few short periods of downtime to recover proper administrative control of each virtual machine.

We apologise for the inconvenience caused.

Regards,

Simon Wilcox
Managing Director
Aug 15, 16:28 UTC
Identified - Hi,

We are continuing to have issues with our management server and some other issues related to it. We're endeavoring to find a fix in conjunction with VMware and will post further updates as we know more.

There is a chance we will have to schedule an emergency downtime period to reboot all the VMs in Enfield. If this happens we expect downtime to be no more than a couple of minutes and will try and do it in as controlled a manner as possible. Further updates to follow.

regards,

Paul Orrock
Technical Director
Aug 15, 08:48 UTC
Investigating - Hi,

We are currently experiencing issues with the controlling management server that runs our Enfield client cluster. Client virtual machines continue to run unaffected and in the event of a host failure, they should restart on another host in the cluster. We are currently trying to recover the management server with assistance from vmware support.

There should currently be no downtime for client machines but we regard this as an at risk notification because we are restricted in the actions we can take on the cluster.

Further updates will follow.

regards,

Paul Orrock
Technical Director
Aug 14, 18:07 UTC

About This Site

Welcome to Digital Craftsmen's home for information on our IaaS systems and applications.
Should there be any interruptions in service, or when maintenance is planned, we will provide status updates here. If you don't see your issue, let us know!
Email: support@digitalcraftsmen.com
Phone: 020 7183 1555

Infrastructure ? Operational
Internet connectivity ? Operational
Core network ? Operational
Compute Cloud ? Operational
Storage Cloud ? Operational
Backup ? Operational
Platform Applications ? Operational
Monitoring ? Operational
RMM ? Operational
DNS Service ? Operational
Mail Relay ? Operational
Third-Party Applications Operational
90 days ago
100.0 % uptime
Today
Cloudflare ? Operational
90 days ago
100.0 % uptime
Today
Dyn DNS ? Operational
90 days ago
100.0 % uptime
Today
Support ? Operational
Service Desk ? Operational
Phone System ? Operational
Email System ? Operational
Locations ? Operational
Coppergate House (Office) ? Operational
Enfield Datacentre ? Operational
London Hosting Centre ? Operational
AWS ? Operational
AWS ec2-eu-west-1 Operational
AWS elb-eu-west-1 Operational
AWS route53 Operational
AWS rds-eu-west-1 Operational
Azure Operational
90 days ago
100.0 % uptime
Today
Azure ? Operational
90 days ago
100.0 % uptime
Today
Operational
Degraded Performance
Partial Outage
Major Outage
Maintenance
Major outage
Partial outage
No downtime recorded on this day.
had a major outage
had a partial outage
Past Incidents
Aug 25, 2019

No incidents reported today.

Aug 24, 2019
Resolved - This incident has been resolved.
Aug 24, 12:01 UTC
Update - Good Afternoon,

The host has now been stable for over 24 hours and all tests have passed along with being placed back into the cluster.

Kind Regards
Rhodri Metcalfe-Davies
Aug 24, 12:01 UTC
Monitoring - Hi,

The physical host had stopped at the underlying vmware system and required rebooting to recover it. We're running a series on tests on it to ensure that it is fully operational before returning it to the cluster.

All client services were recovered within a few minutes of the failure. We apologise for this outage and will ensure that any learnings from the tests are implemented.

regards

Paul Orrock
Technical Director.
Aug 23, 11:48 UTC
Investigating - Hi,

We have had a host fail in Enfield. The client virtual machines that were on it have been automatically restarted by the cluster manager on another host. Clients may have noticed a short period of downtime while the high availability service actioned the restarts. All client machines should now be back up.

Further updates will follow.

regards,

Paul Orrock
Aug 23, 10:14 UTC
Aug 22, 2019

No incidents reported.

Aug 21, 2019

No incidents reported.

Aug 20, 2019

No incidents reported.

Aug 19, 2019

No incidents reported.

Aug 18, 2019

No incidents reported.

Aug 17, 2019

No incidents reported.

Aug 16, 2019

No incidents reported.

Aug 13, 2019

No incidents reported.

Aug 12, 2019

No incidents reported.

Aug 11, 2019

No incidents reported.