[deutsch100]

So. Carolina servers down. Most USA (and possibly Canadian) My BMW apps are non-functional. BMW is trying to re-route via Munich, but obviously this is a huge undertaking.

My BMW app has not updated since Thurs 9/26 at 3pm. I cannot send any commands, range and battery will not update, location is wrong... but cannot explain this one....OTA software came in today via the car, as the app is 100% down!

https://youtube.com/shorts/sDwkdJsO_...9EWUPIXglKuWTP

[RichardInCA]

Good intel - just went to initiate preconditioning for a trip and saw that it wasn’t working. Bigger problems in the world, especially those in northern Florida - hope all on this board are staying safe.

[MikeElmendorf]

Well that explains it. Strangely my OTA update worked too.

Traffic is not working either for me. And, assisted driving plus (hands free) is showing “Function no longer available. License expired. Check extension in the ConnectedDrive Store. See Owner's Manual for more information.”

I assume this is because the car cannot talk to the BMW servers to validate? My car was built with driving assistant professional.

Anyone else seeing this?

[deutsch100]

Originally Posted by MikeElmendorf

Well that explains it. Strangely my OTA update worked too.

Traffic is not working either for me. And, assisted driving plus (hands free) is showing “Function no longer available. License expired. Check extension in the ConnectedDrive Store. See Owner's Manual for more information.”

I assume this is because the car cannot talk to the BMW servers to validate? My car was built with driving assistant professional.

Anyone else seeing this?

Same

[rgw]

We had a similar problem recently. You can have a disaster recovery plan but it usually takes a long time to do the plan. No telling what they’re going to have to do to handle data inconsistency. Flying hard drive copies from the SAN out to Munich? Who knows. Also changing all the DNS entries to point to the DR site is a nightmare. Not to mention if they didn’t handle propagating the alternative IP addresses to the Munich site to vendors who use those services hosted in Carolina.

[MikeElmendorf]

Well as long as I’m not the only one who last DAP, I just figure it will resolve when the servers are back. As an earlier poster said, minor in the scheme of what folks in the storm impact zone are facing.

[ToddRGuy]

Originally Posted by deutsch100

So. Carolina servers down. Most USA (and possibly Canadian) My BMW apps are non-functional. BMW is trying to re-route via Munich, but obviously this is a huge undertaking.

My BMW app has not updated since Thurs 9/26 at 3pm. I cannot send any commands, range and battery will not update, location is wrong... but cannot explain this one....OTA software came in today via the car, as the app is 100% down!

https://youtube.com/shorts/sDwkdJsO_0Y?si=8z9EWUPIXglKuWTP

Might be a good time for a cloud based solution that doesn’t rely on company specific servers based in a brick n mortar building.

[rgw]

Originally Posted by ToddRGuy

Might be a good time for a cloud based solution that doesn’t rely on company specific servers based in a brick n mortar building.

Then you can become a part of the half of US internet that goes down when AWS us-east-1 has downtime.

[ToddRGuy]

Originally Posted by rgw

Then you can become a part of the half of US internet that goes down when AWS us-east-1 has downtime.

We have healthcare related Clinical Hematology systems through Sysmex America that are on AWS. In 1.5 years, we've had 1 one downtime, but perhaps Healthcare related systems have more redundancy.

[wingwizard]

Are folks myBMW app working? I noticed today I wasn't getting any updated info for a couple days, and I've spent the past hour restarting the head unit and app and logging out/in....then I saw this thread lol. I'm guessing this is the reason I'm not getting any updates or control through the app?

[SkykingUSA]

Originally Posted by wingwizard

Are folks myBMW app working? I noticed today I wasn't getting any updated info for a couple days, and I've spent the past hour restarting the head unit and app and logging out/in....then I saw this thread lol. I'm guessing this is the reason I'm not getting any updates or control through the app?

Likely true.

[AiredaleDad]

Look at it as a good thing. They are able to see their weakness and fix it. And at least nobody got stranded without being able to use their car. Can you imagine if your car would not run at all unless it was able to talk to the servers? Chaos! They need to build more server farms and have them running in parallel. Including one via Satellite link from Germany.

[MikeElmendorf]

Is traffic information down for others too?

Suspect it is all related, but as this coincides with me getting the OTA yesterday, it makes you wonder if some things aren’t just messed up as a result.

[ntailor]

It was down for me last night/early AM

[MikeElmendorf]

Chiming in to answer my own question here, but took the X5 out this morning and no traffic there either. So, definitely related.

[kb1749kc]

Yup. Same issues here. Hoping for a quick resolution.

[ToddRGuy]

Originally Posted by AiredaleDad

Look at it as a good thing. They are able to see their weakness and fix it. And at least nobody got stranded without being able to use their car. Can you imagine if your car would not run at all unless it was able to talk to the servers? Chaos! They need to build more server farms and have them running in parallel. Including one via Satellite link from Germany.

Most companies on the west coast seem to chose benign States that aren’t usual subject to severe weather risk, like Nevada, New Mexico or Arizona, for alternate datacenter locations. But in BMWs case multiple countries would strategically seem wise. Maybe an alternate in Canada?

[rgw]

BMW definitely needs a better disaster recovery plan. I would’ve expected it to take half a day for everything to stabilize on the switchover not 24 hours or more.

[MiGs550e]

I hope BMW NA and Group are learning some lessons here on DR and BCP planning.... When you have a highly connected product that relies on back-end infrastructure you better think five 9's, RTO's, and have business continuity plans to react and recovery from disasters. IMO this is kind of ridiculous on a multi-billion dollar company. Just saying it should be embarrassing to them.

Any datacenter director of operations should have performed risk assessments and identified that yeah SC may not be the best location without having warm sites waiting in other locations or other hot sites using global traffic managers to automatically route traffic.

[rgw]

Auto makers are going to have to start thinking like major tech companies if they’re going to integrate as much networked technology in their products. Either that or they punt significant pieces of their core product at this juncture to Apple, Google, or Microsoft.

[TurtleBoy]

Unlikely this is all tied to the hurricane since some services, such as RTTI and Spotify, have been down for some owners most of the week. Why would BMWFS have their servers in SC? In many folks opinion, there is something else going on and the hurricane is being used as the reason.

[dubb13]

I Noticed my ESIM IS broken too when check the status in the app tells me it can't validate my subscription