Facebook says cause of huge outage is ‘faulty configuration change’

Facebook Inc blamed a “faulty configuration change for a nearly six-hour outage on Monday that prevented the company’s 3.5 billion users from accessing its social media and messaging services such as WhatsApp, Instagram and Messenger.

The company in a late Monday blog post did not specify who executed the configuration change and whether it was planned.

Several Facebook employees who declined to be named had told Reuters earlier that they believed that the outage was caused by an internal mistake in how internet traffic is routed to its systems.

The failures of internal communication tools and other resources that depend on that same network in order to work compounded the error, the employees said. Security experts have said an inadvertent mistake or sabotage by an insider were both plausible.

Facebook, Whatsapp and Instagram logos are displayed through broken glass in this illustration taken October 4, 2021. REUTERS/Dado Ruvic/Illustration

“We want to make clear at this time we believe the root cause of this outage was a faulty configuration change,” Facebook said in the blog.

The Facebook outage is the largest ever tracked by web monitoring group Downdetector.

The outage was the second blow to the social media giant in as many days after a whistleblower on Sunday accused the company of repeatedly prioritizing profit over clamping down on hate speech and misinformation.

As the world flocked to competing apps such as Twitter and TikTok, shares of Facebook fell 4.9%, their biggest daily drop since last November, amid a broader selloff in technology stocks on Monday. Shares rose about half a percent in after-hours trade following resumption of service.

“To every small and large business, family, and individual who depends on us, I’m sorry,” Facebook Chief Technology Officer Mike Schroepfer tweeted, adding that it “may take some time to get to 100%.”

“Facebook basically locked its keys in its car,” tweeted Jonathan Zittrain, director of Harvard’s Berkman Klein Center for Internet & Society.

Small toy figures are seen in front of displayed Facebook, Whatsapp and Instagram logos in this illustration taken October 4, 2021. REUTERS/Dado Ruvic/Illustration

Twitter on Monday reported higher-than-normal usage, which led to some issues in people accessing posts and direct messages.

In one of the day’s most popular tweets, video streaming company Netflix shared a meme from its new hit show “Squid Game” captioned “When Instagram & Facebook are down,” that showed a person labeled “Twitter” holding up a character on the verge of falling labeled “everyone.”

Inside a Facebook group for ad buyers, one member wisecracked after service returned that “lots of people searched today ‘how to run Google ads for clients.'”

Facebook, which is the world’s largest seller of online ads after Google, was losing about $545,000 in U.S. ad revenue per hour during the outage, according to estimates from ad measurement firm Standard Media Index.

Past downtime at internet companies has had little long-term affect on their revenue growth, however.

Facebook’s services, including consumer apps such as Instagram, workplace tools it sells to businesses and internal programs, went dark noon Eastern time (1600 GMT). Access started to return around 5:45 pm ET.

Soon after the outage started, Facebook acknowledged users were having trouble accessing its apps but did not provide any specifics about the nature of the problem or say how many users were affected.

The error message on Facebook’s webpage suggested an error in the Domain Name System (DNS), which allows web addresses to take users to their destinations. A similar outage at cloud company Akamai Technologies Inc took down multiple websites in July.

On Sunday, Frances Haugen, who worked as a product manager on the civic misinformation team at Facebook, revealed that she was the whistleblower who provided documents underpinning a recent Wall Street Journal investigation and a U.S. Senate hearing last week on Instagram’s harm to teen girls.

Haugen was due to urge the same Senate subcommittee on Tuesday to regulate the company, which she plans to liken to tobacco companies that for decades denied that smoking damaged health, according to prepared testimony seen by Reuters.

(Reporting by Eva Mathews and Subrat Patnaik in Bengaluru; Additional reporting by Tiyashi Datta, Nivedita Balu, Aakriti Bhalla in Bengaluru, Joseph Menn and Paresh Dave in San Francisco and Sheila Dang in Dallas; Editing by Uttaresh.V, Shailesh Kuber, Anil D’Silva, Sonya Hepinstall and Sriraj Kalluvila)