So what can Rogers do to prevent a future outage? In other words, if a Rogers phone cant connect to Rogers towers, it can fall back to other carriers towers through local roaming to access the emergency network. The @RogersHelps Twitter account shared its first update over four hours into the outage on July 8th. The CRTC said on Twitter Friday that its phone lines were affected by the outage. The Rogers network outage also affecting Fido and Chatr continues to impact customers nationwide. Cookies allow us to optimise your use of our website. Traffic dropping at egress of source network due to unavailable Internet route, Figure 4. Well get into BGP more in a moment, but first, its worth noting that MobileSyrup understands Bell and Telus operate all-IP networks as well. Representatives of Telus Corp. T-T and BCE Inc.s BCE-T Bell Canada said their networks were operating properly, but that connections to and from the Rogers network were disrupted. When you visit any website, it may store or retrieve information on your browser, mostly in the form of cookies. "I've said very clearly and openly that I will not allow the wholesale transfer of licences from Shaw to Rogers, and I think this is well understood," he said. The outage also disrupted emergency services across the country, with several police services saying on Twitter that callers were having problems reaching 911. A Rogers spokesperson called the move a first step, in a statement, though didn't indicate how much, on average, each customer could expect to receive back. Since Rogers continued to advertise at least some of its customers prefixes, conditions within Rogers network could continue to be observed. But without stable internet at his hotel, which relies on Rogers for service, he was unable to monitor the situation and was having difficulty renting a car. But the issues at Interac affected some debit-card transactions, and banks and their customers reported other sporadic issues. Government services reported disruptions because phone lines were down. Unfortunately, many will likely be on the receiving end of vitriol from customers frustrated with how the company handled the outage. Personal finance contributor Christopher Liew explains how long taxpayers have to pay the CRA back and what they need to do to avoid any consequences. And it highlighted Rogerss prevalence in Canada at a moment when the company is attempting to convince regulators that its proposed $26-billion takeover of Shaw Communications Inc. SJR-A-X would not harm consumers by reducing competition in the telecom industry. Share. They are usually only set in response to actions made by you which amount to a request for services, such as setting your privacy preferences, logging in or filling in forms. Why Rogers Network is Down. What do senior citizens need to do to age in place? In other words, a router could be considered a gateway, but a gateway cant always be considered a router. Look, an all-IP network I dont think is necessarily a bad thing if its implemented in a resilient way, explained Ian Rae in an interview with MobileSyrup. The company says it has restored services to the "vast majority" of its customers, although reports of continued outages and poor connections persisted over the weekend. All the while, Rogers is still not saying what is causing the outage or when it might be resolved. Ideas shared with MobileSyrup include reviewing why updates need to be applied, and how those updates spread through the companys network. Visa Canadas credit-card network was not affected, though some merchants were unable to use payment terminals that rely on Rogerss network to process credit-card transactions, according to Visa spokesperson Jessica Culp. Canadians didnt know how good they had it until it was gone. Government services reported disruptions because phone lines were down. RogersHelps (@RogersHelps) July 8, 2022. A source familiar with networks, and who asked not to be named, explained all-IP as like an FM radio. Beginning at 08:44 UTC on July 8th, 2022, Rogers Communications, one of the largest Internet service providers in Canada, experienced a significant disruption that rendered its network unavailable for long periods of time over the course of approximately 24 hours. TORONTO/OTTAWA, July 8 (Reuters) - Rogers Telecommunications said its network was beginning to recover late on Friday after a 19-hourservice outage at one of Canada's biggest telecom. Rae also notes that Rogers may use internal BGP (IBGP) for communication within its own network, which could also potentially be a point of failure. It works for major services like Interac which announced it would add a supplier to increase redundancy following the Rogers outage. 2:50 Rogers network down across much of Toronto and parts of Canada. This will happen if you use a single vendor for the core network, this is not good practice and it is always beneficial two rely on two vendors for the core network, as if one has a meltdown as it happened at Rodgers, the others vendor's router should be able to handle the rest of the network traffic, if the core network was designed correctly. Anil Bissa, who owns the Sport Clips Haircuts salon in Orillia, Ont., said he was forced to send his staff home early because his clients, who usually rely on debit and credit, had no way to pay. Rogers Communications experienced a wide-scale internet and wireless service outage across Canada on July 8. Like everyone else, employees couldnt access services, couldnt make payments, and couldnt call 9-1-1. A list of what is affected, Far-reaching implications of Rogers outage shows need for competition: Expert. By continuing to use our website, you acknowledge the use of cookies. The information does not usually directly identify you, but it can give you a more personalized web experience. My thoughts on Telecom in Canada and how we as a nation continue to miss the mark. Based on ThousandEyes broad visibility into Internet networks, we observed the following: Last week, in the early hours of July 8th (04:44 EDT / 08:44 UTC), ThousandEyes began observing BGP routing instability caused by the withdrawal of large numbers of Rogers Communications (AS 812) prefixes. As it is, we are struggling to stay afloat due to the rising costs of everything, Mr. Bissa said. They havemultiple WiFi hotspots including at the Distillery District. With the outage also knocking down Interac services, businesses struggled to take payments from customers, who in the end were forced to take out cash. The update structure is. Regardless of the underlying cause, from a customer standpoint, impact is of greater importance. Traffic successfully reaching a destination via Rogers network at approximately 11:10 UTC, Figure 5. Champagne said in a statement, adding that the government will use any tools at our disposal to ensure Canadians stay connected and the company meets the high standard that Canadians deserve., Ashraf Khan, second from left, and Shehreen Mahbub, right, who both work in sales work from the food court inside Fairview Mall in Toronto due to the Rogers outage on July 8.Yader Guzman/The Globe and Mail. Please don't call "support numbers" posted below most probably it's a scam. These cookies are necessary for the website to function and cannot be switched off in our systems. Published July 9, 2022 4:51 a.m. PDT. Sign up today. Rogers says it was Ericsson's fault: We have identified the root cause of the service issues and pinpointed a recent Ericsson software update that affected a piece of equipment in the central part of our wireless network. However, its currently unclear how best to do that, considering that the way Rogers network failed prevented traffic from routing to fallback measures. Mr. Staffieri said in a statement late Friday that the telecom has made meaningful progress towards bringing our networks back online and that many wireless customers are seeing their services return. But its never that simple. We welcome the community to use our [WiFi] access during this service disruption,"said Lucia Connor, Vice President Retail Marketing, Oxford Properties. Route withdrawals occur multiple times throughout the incident period (blue chart), which has a corresponding impact on prefix reachability (green chart), Figure 11. Maybe more frequent, smaller updates instead of singular, major updates is the key. After traversing multiple service provider networks, traffic drops mid-flight at the edge between service providers and Rogers network, Figure 3. CTVNews.ca takes a look at why this is happening. If you were previously notified about fibre network enhancements in your neighbourhood, visit More fibre-power is coming your way. Rogers customers in Toronto and the rest of Canada arestill dealing with a lack of internet, cell service and WiFi as the communication provider deals with a major nationwide outage. The thing thats interesting about [the outage] to me is that [Rogers] already shared that this is in their core network, Rae said. Use of this Website assumes acceptance of Terms & Conditions and Privacy Policy, Stay up to date on the latest, breaking news, it was aware of issues affecting the network, one-quarter of Canada's observable connectivity, he suspected that a cyberattack was not the reason, experienced a similar all-day service outage in April 2021, met with Industry Minister Francois-Philippe Champagne on Monday. Over 48 hours later, with some customers still reporting issues despite Rogers claiming it restored the vast majority of service, calls for an investigation were ringing loud. Transit systems, such as Ontario's Metrolinx, also reported issues with fare payments. @FP_Champagne pic.twitter.com/v1oANjIoo1, Samer Bishay (@SBishayIRIS) July 13, 2022. "We disconnected the specific equipment and redirected traffic, which allowed our network and services to come back online over time as we managed traffic volumes returning to normal levels," he said. Reports of cellular and internet service interruptions appear to be coming in from large parts of Canada this Friday morning as carriers like Telus, Rogers, and Fido are experiencing outages. . They may be used by those companies to build a profile of your interests and show you relevant adverts on other sites. Most Canadian seniors would prefer to stay in their homes for as long as possible, what is referred to as aging in place, rather than in an assisted living facility, according to recent studies that have come out this year. With the holidays approaching, financial expert Robyn Thompson advises that now is the time to use old gift cards as rising inflation affects their purchasing power. On Saturday, Rogers president and CEO Tony Staffieri told CTV News Channel "pretty close to 100 per cent" of the company's network had returned online, with "less than one per cent" of customers still experiencing "intermittent issues.". These cookies may be set through our site by our advertising partners. Up to 50 percent of Canadians may be without internet or mobile during a Rogers outage on Friday. It doesnt sound like, from what [Rogers] is saying, that it was a major change architecturally those tend to be much riskier activities.. Rogers outage started with a faulty update, which means increasing the number of routers wont solve the problem if they all receive a faulty update, they all break. Calls and texts between Bell customers or to other providers were not impacted, the company said. In all of this, its easy to forget that Rogers employees were also affected. This week in Canadian telecom: Rogers takeover of Shaw hits another roadblock [Oct. 22-28], Heres how the new iPad (2022) compares to its predecessor, Heres the content coming to CBC Gem in November 2022, Streaming in Canada on Amazon Prime Video, Apple TV+, Crave, Disney+ and Netflix [Oct. 24-30], How to watch Jake Paul vs Anderson Silva in Canada, Two key tips for making videos with Apples iPhone, Lost your AirPods again? Meanwhile, the extended outage is raising questions about the need for more competition in Canada's telecom industry. He added that he expects the telecom will be reimbursed by its software and network vendors for the bill credits it provides to its customers. So, Rogers should focus on updating the way it handles updates to mitigate the potential for outages of this magnitude. This behavior suggests an internal network control plane issue may have been an underlying factor in the incident rather than strictly due to external BGP route withdrawals, which has been widely reported. And if Rogers did stage the update, how did the issue slip through? These cookies do not store any personally identifiable information. That could come from anywhere governments, hackers, competitors. Internet, TV and phone The Rogers network being down across Canada on Friday impacted debit for millions of Canadians who don't carry cash. That being said, we do not expect any material or sustained financial implications from this outage, he said. Champagne also promised a CRTC investigation into the outage, and on July 12th, the commission ordered Rogers to answer questions about what happened within ten days. And, as is so often pointed out with government attempts to gain access to encryption, if a backdoor exists, it becomes a target for exploitation. The approval process for updates should also be considered. There's. Moreover, while Rogers carries significant blame, no critical service in Canada or anywhere should be wholly dependent on a single telecom company. Rogers is the largest telecommunication company in the country. Walter Tufford, who owns an auto detailing shop in Port Elgin, Ont., said Fridays outage made his business nearly impossible to run, because it knocked out his credit and debit machine, as well as the companys phone line. Some customers reported ongoing problems over the weekend, including into Sunday. The following brief analysis is designed to provide insight into the incident for Infrastructure and Operations professionals, as well as the interested general public. Telecom networks have moved in this direction over the last several years, enabling some innovations. Losing a day hurts us tremendously.. Of course, its never that simple theres still the process of figuring out what went wrong, where it went wrong, and how to fix it. Travellers also faced challenges, such as not having access to GPS for navigation or being unable to pay for gas. Its important to understand that no solution should be off the table. Rogers may examine whether it should implement check systems to warn of potential issues and prevent wide rollouts of broken updates. By the end of the trading day Friday, Rogers shares were down 73 cents at $61.54 on the Toronto Stock Exchange, Reuters reported. Financial institutions, including TD Canada Trust, BMO and Royal Bank said the outage had disrupted their operations. Toronto libraries also have WiFi for residents, though many have reportedslow connectivity. See if Rogers is down or having service issues today 0 Reports in last 20 minutes Not Working For Me! Youre going to have a change management plan, youre going to have an approval process, youre going to have a backout plan. But some of them were overpaid. Roughly 36 hours later, Rogers CEO and president Tony Staffieri publicly revealed the cause of the outage: a maintenance update in the companys core network. Have the Top Business Headlines newsletter conveniently delivered to your inbox in the morning or evening. They help us to know which pages are the most and least popular and see how visitors move around the site. Outages are inevitable and no provider is immune to them, including operators of the largest networks and services, such as Facebook, Google, and AWS. Telus also issued a similar statement. The incident appeared to be triggered by the withdrawal of a large number of Rogers prefixes, rendering their network unreachable across the global Internet. However, there are vulnerabilities too for example, a whole-network outage like what we saw on July 8th. We expressed how important it is that this matter be resolved as soon as possible and for the company to provide prompt and clear communication directly to those impacted, Mr. Montreal-based law firm LPC Avocat announced Monday that it has requested authorization to bring a class-action lawsuit against the telecom company. To start, we need to understand how Rogers network operates youll need to bear with me through this, as its a bit of a slog (I promise its worth it). However, outage impact can vary widely depending on whether enterprises have taken steps to reduce their risk and increase their responsiveness.