hi all
nice dicrepance from swisscom side:
official ticket from 12:15:
[Work progress:] BBCS Services available again, we are still investigating the reason. If there is just a voice problem pending (doppel belegung, übersprechen) then your customer have to reset his Adsl modem.
[Approximately expected repair time:] Next Update 16:00 am
bluewin states: http://de.bluewin.ch/kundencenter/index.php/headlines_article_de/23 ADSL Störung behoben 14.04.2005 Die ADSL-Störung ist behoben. Wir entschuldigen uns für die daraus entstandenen Unannehmlichkeiten und danken für Ihr Verständnis. Ihr Bluewin Team
and swisscom: http://www.swisscom.com/solutions/en/index/stoerungs_meldung.htm?code=111 "Der Fehler konnte isoliert werden, so dass er keinen Einfluss mehr auf das operative Netz hat. Das Datennetz ist mit dieser Isolationsmassnahmne stabil. Die genaue Ursache wird noch im Detail analysiert."
hmm.. do they know the problem or not??? i'm confused ;-)
lets guess what we have here:
the facts: - about 50% of the adsl network went down, the rest was online without problems since weeks - layer1 link was down (from CPE side) - i suspect that the BBCS backbone is based on IPSS since IPSS customers were offline also during that period (best efford? ,-)) - we miss still some customers. swisscom advised to tell the customers to reboot the router. we saw sometimes that this doesn't helped -> opening a ticket resolves that problem.
sooo... now the big questions: what was the problem? did swisscom had a problem on the DSLAMs? routing problem within IPSS?
anyone from swisscom able/willing/allowed to give some technical informations?
greetings
-steven
Hello
the facts:
- about 50% of the adsl network went down, the rest was online without
problems since weeks
- layer1 link was down (from CPE side)
If we have a short look on the Protocol Stack for BBCS ( Swinog #3 Page 14 [1] ) only the DSLAM could have this type of error. Because it is a link failure between the CPE and the DSLAM.
The next tool which could have an impact on all DSLAM's in about 2 hours ( not every layer1 was down on the same time) is either the monitoring tool or the configuration deployment tool.
As a side note: We still do not have access to the DSLAM Monitoring Tool which is a requirement to make firstlevel support !
At the moment we still have customers complaining.
Theorie1: Someone wrote a "new" deployment script for the new BBCS release which includes ***classified ***.
Unfortunatly all DSLAM's were affected by this change.
Any comments ?
Regards Erich
[1] http://www.swinog.ch/meetings/swinog3/BBCS_Swinog.ppt
Erich Hohermuth wrote:
Hello
the facts:
- about 50% of the adsl network went down, the rest was online without
problems since weeks
- layer1 link was down (from CPE side)
If we have a short look on the Protocol Stack for BBCS ( Swinog #3 Page 14 [1] ) only the DSLAM could have this type of error. Because it is a link failure between the CPE and the DSLAM.
Indeed.
The next tool which could have an impact on all DSLAM's in about 2 hours ( not every layer1 was down on the same time) is either the monitoring tool or the configuration deployment tool.
Very likely. Or the new deployment tool triggered a bug in the Alcated DSLAMs.
As a side note: We still do not have access to the DSLAM Monitoring Tool which is a requirement to make firstlevel support !
At the moment we still have customers complaining.
Theorie1: Someone wrote a "new" deployment script for the new BBCS release which includes ***classified ***.
I guess dynamic switching of DSL line speeds is not the best idea... One problem more to solve before all three things will play together.
Unfortunatly all DSLAM's were affected by this change.
Guess what happens when the MPLS core breaks down. All the new stuff runs over the same core network (IPSS, BBCS and new CES). What will happen when the next SQL-Slammer strikes and blasts millions of packets into all these networks? Or there is a bug with MPLS or label distribution...
Too many eggs in one baset if you ask me. At least the phone network will continue to work because at the moment it is based on TDM and SDH circuits. But for how long?
-
Andre Oppermann -
Erich Hohermuth -
Steven Glogger