BT Broadband - problems this morning

[1_man_and_his_dob(lo)]

In case anybody else is having trouble. I thought iCloud might be down, but apparently BT are having problems this morning. This will affect PlusNet users as well.

BBC link

 

[makems]

We are having problems here in the North East. Strangely not all web sites are affected - BBC, and some others are just not accessible, whilst Daily Mail, FT, motorhomefun and eBay seem to be OK.

 

[Bluemooner]

Bbc site slow here as well

 

[icantremember]

Yes ... lots of problems here this morning.

 

[GJH]

We are having problems here in the North East.

Not on Virgin we're not Mind you, I bet Virgin themselves are having problems as their Preston Farm offices are served by BT

^{_{Subscribers  do not see these advertisements}}

 

[Jim]

They have had problems for a few days, but some big servers seem to have fallen over this morning.

 

[Dorset Diver]

My PlusNet connection is up and down like a whores draws at present. Not sure if this post will work.

 

[The Dudess]

Had problems earlier today but all seems OK now.

 

[Bill_OR]

Had problems earlier today but all seems OK now.

Likewise.

 

[Chris]

Not to worry, BT are super efficient at resolving internet issues.

My ar$e they are

^{_{Subscribers  do not see these advertisements}}

 

[deleted-member02]

My PlusNet connection is up and down like a whores draws at present. Not sure if this post will work.

My plusnet connection is playing up too.
We're off tomorrow, so I've been busy downloading, had about 30gig left to go and the kids blaming me for wifi issues.
Apologies if I'm slowing everyone else down....

 

[1_man_and_his_dob(lo)]

Plusnet website:

We’re sorry that some BT and Plusnet customers have been experiencing problems accessing some internet services this morning. This is due to power issues at one of our internet peering partners’ sites in London.

Someone forgot to put some coins in the electric meter

 

[PaulyP]

It's the heat !!!!!

 

[Doctor Dave]

Had problems here in Wiltshire - at least I did - but seems OK now. I couldn't get any emails from Yahoo on the laptop but strangely could on my iPhone. Some web sites would work but some others wouldn't. Oh, and the BT Desktop Help was no go.

Dave

 

[Clarky]

BT broadband is always rubbish when you live in rural Suffolk.

Richard.

^{_{Subscribers  do not see these advertisements}}

 

[Langtoftlad]

PlusNet rock solid at Langtoft Towers - lets hope the Open Reach engineers don't mess it up as they "fix" it.

 

[Gizmouk]

There was a power outage at Telecity Docklands (Harbour Exchange), effecting BT / Pussnet and a number of banks etc

 

[Gizmouk]

PlusNet rock solid at Langtoft Towers - lets hope the Open Reach engineers don't mess it up as they "fix" it.

It was power related - so (fortunately) Open Wretch "engineers" won't be allowed to touch / make it worse

 

[1_man_and_his_dob(lo)]

If anyone's been having connection issues again today (BBC site failed for me earlier), it might be because another exchange in London had a power failure this morning. BT and Plusnet again.

 

[Dorset Diver]

I wish they would pay their bills, they charge us enough .

^{_{Subscribers  do not see these advertisements}}

 

[Gromett]

The problem yesterday was at Harbour Exchange Square where LInX is located. I used to have my business based there and I can tell you it is a nightmare place to operate from. Many problems with power including a massive power surge that took out a not insignificant portion of my servers. I was happy to leave that place. Back then it was called Redbus however.

Todays outage was apparently a circuit breaker tripping. Same company however. It looks like over the last 18 years they still haven't figured out how to provide stable power to the companies operating at those data centres. Grrrr.

I am not one to come to the defence of BT normally but in both these two "events" it was not BT's fault.

 

[Gromett]

PS: if you want further details.....

http://arstechnica.co.uk/business/2016/07/bt-isps-telehouse-north-major-outage/

 

[Dorset Diver]

The problem yesterday was at Harbour Exchange Square where LInX is located. I used to have my business based there and I can tell you it is a nightmare place to operate from. Many problems with power including a massive power surge that took out a not insignificant portion of my servers. I was happy to leave that place. Back then it was called Redbus however.

Todays outage was apparently a circuit breaker tripping. Same company however. It looks like over the last 18 years they still haven't figured out how to provide stable power to the companies operating at those data centres. Grrrr.

I am not one to come to the defence of BT normally but in both these two "events" it was not BT's fault.

Of course it's BT's fault. They should ensure they only use facilities that have stable and reliable supplies with adequate back-up.

 

[Gizmouk]

The problem yesterday was at Harbour Exchange Square where LInX is located. I used to have my business based there and I can tell you it is a nightmare place to operate from. Many problems with power including a massive power surge that took out a not insignificant portion of my servers. I was happy to leave that place. Back then it was called Redbus however.

Todays outage was apparently a circuit breaker tripping. Same company however. It looks like over the last 18 years they still haven't figured out how to provide stable power to the companies operating at those data centres. Grrrr.

I am not one to come to the defence of BT normally but in both these two "events" it was not BT's fault.

No it wasn't
Yesterday - Telecity, Harbour Exchange
Today - Telehouse, North.

I always love to give BT a good kicking, but in these cases, let's just leave it at lack of "diverse routing" and be done

 

[Gromett]

And if you want to read the about the MAJOR fault I suffered through.
http://www.theregister.co.uk/2005/03/02/redbus_incident_report/

They say it had limited effect. However it was almost a full working day without power, and when the power came back on there were literally 100's of technicians from many companies running around the data centre floor getting in each others way trying to replace fuses and servers. Over half my fuses were blown. The data centre owners had to send staff out round London hunting for fuses which they then handed out on the data centre floor. From memory I lost at least 6 servers from the initial surge and just under half of the remaining servers had blown fuses. This happened across 2 floor of the Harbour Exchange Square building and they only operated on 3 floors at that time.. They upgraded the power system just after this to prevent repeats but there was at least one more failure before I finally moved of there.

Redbus was bought out by Telecity not long after that. Who were then bought out by equinix.

^{_{Subscribers  do not see these advertisements}}

 

[Gromett]

No it wasn't
Yesterday - Telecity, Hardbour Exchange
Today - Telehouse, North.

I thought Equinix had bought both companies out some time ago. I admit I was wrong on that count. There was talk some time ago of Equinix buying Telehouse. Equinix did buy out Telehouse Internet Exchange (TiX) so I was probably mis-remembering this? Equinix owns Telecity.

I always love to give BT a good kicking, but in these cases, let's just leave it at lack of "diverse routing" and be done

They did have diverse routing, which is why it did come back up. However the traffic was then routed via other networks which suffered a higher traffic than normal hence the country wide slow down for some people. BGP routing as you probably know is not instant when routing around issues.

 

[Gizmouk]

And if you want to read the about the MAJOR fault I suffered through.
http://www.theregister.co.uk/2005/03/02/redbus_incident_report/

Basically - CT came lose - fell off into bit where it ought not to be - caused big bang - UPS array didn't go into static bypass - everyone run away even though data halls are positive pressure and protected by fire suppressant systems - eventually someone came back and put UPS array into manual wrap around.
A nasty (and expensive) catalogue of errors - and I bet Redbus invoked the "our problem becomes your loss clause"

 

[Gromett]

A nasty (and expensive) catalogue of errors - and I bet Redbus invoked the "our problem becomes your loss clause"

Yup Major Screw up. Their bigger customers got compensation but small player like me with only 2 racks got shafted. It took me a year+ to recover from the financial impact and I lost a bunch of clients due to it. I never forgave them for that particular outage.

 

[Gromett]

everyone run away even though data halls are positive pressure and protected by fire suppressant systems

Standard practice to run away when fire alarm goes off. They say that FM-200 is safe for humans, but I for one wouldn't want to risk my life for fire and possible FM-200 problems.... Especially when you are in a high rise on the 8/9th floor and have loads of security doors to get through to get out. I would have run as well

 

[Gizmouk]

I remember doing my Halon training - that really is scarey stuff.
You can stand in a room throughout a FM200 dump and breathe normally. I haven't tried it, and have no intention on trying - although I was in a data hall when an FM200 system went into "first knock". Fastest I've moved in many years - Even for my size, I moved damn quick !!

^{_{Subscribers  do not see these advertisements}}