Shopping Cart

No products in the cart.

BSI PD IEC TR 61850-90-12:2020

$215.11

Communication networks and systems for power utility automation – Wide area network engineering guidelines

Published By Publication Date Number of Pages
BSI 2020 264
Guaranteed Safe Checkout
Category:

If you have any questions, feel free to reach out to our online customer service team by clicking on the bottom right corner. We’re here to assist you 24/7.
Email:[email protected]

This part of IEC 61850, which is a Technical Report, is intended for an audience familiar with electrical power automation based on IEC 61850 and related power system management, and particularly for data network engineers and system integrators. It is intended to help them to understand the technologies, configure a wide area network, define requirements, write specifications, select components, and conduct tests.

This document provides definitions, guidelines, and recommendations for the engineering of WANs, in particular for protection, control and monitoring based on IEC 61850 and related standards.

This document addresses substation-to-substation communication, substation-to-control centre, and control centre-to-control centre communication. In particular, this document addresses the most critical aspects of IEC 61850 such as protection related data transmission via GOOSE and SMVs, and the multicast transfer of large volumes of synchrophasor data.

The document addresses issues such as topology, redundancy, traffic latency and quality of service, traffic management, clock synchronization, security, and maintenance of the network.

This document contains use cases that show how utilities tackle their WAN engineering.

PDF Catalog

PDF Pages PDF Title
2 undefined
4 CONTENTS
14 FOREWORD
16 INTRODUCTION
18 1 Scope
2 Normative references
23 3 Terms, definitions, abbreviated terms, acronyms, and symbols
3.1 Terms and definitions
27 3.2 Abbreviated terms and acronyms
36 3.3 Network diagram symbols
37 Figures
Figure 1 – Symbols
38 4 Wide area communication in electrical utilities
4.1 Executive summary
40 4.2 Network and application example: ENDESA, Andalusia (Spain)
Figure 2 – Substation locations in Andalusia
41 Figure 3 – Topology of the Andalusia network
42 4.3 Typical interface between a substation and the WAN
Figure 4 – Cabinet of a substation edge node
43 4.4 WAN characteristics and actors
Figure 5 – Communication interfaces in a SEN
44 4.5 Smart Grid Architecture Model (SGAM) Mapping
Figure 6 – Communicating entities
45 Figure 7 – SGAM communication model
46 4.6 Network elements and voltage level
Figure 8 – Principle of grid voltage level and network technology
47 4.7 WAN interfaces in substation automation (IEC 61850-5)
Figure 9 – Communication paths and interfaces
48 4.8 Logical interfaces and protocols in the architecture in IEC TR 62357-200
Figure 10 – IEC TR 62357 Interfaces, protocols, and applications
49 4.9 Network traffic and ownership
50 5 WAN metrics
5.1 Traffic types
5.2 Quality of Service (QoS) of TDM and PSN
5.3 Latency calculation
5.3.1 Latency components
51 5.3.2 Propagation delay
5.3.3 Residence delay
5.3.4 Latency accumulation
5.3.5 Example: latency of a microwave system
Figure 11 – Composition of end-to-end latency in a microwave relay
52 5.3.6 Latency and determinism
5.3.7 Latency classes in IEC 61850-5
Figure 12 – Example of latency in function of traffic
53 Tables
Table 1 – Latency classes in IEC 61850-5
Table 2 – Latency classes in IEC TR 61850-90-1
54 5.4 Jitter
5.4.1 Jitter definition
Figure 13 – Jitter for two communication delay types
Table 3 – Latency classes for WANs
55 5.4.2 Jitter classes in IEC 61850
5.5 Latency symmetry and path congruency
5.6 Medium asymmetry
Table 4 – Jitter classes in IEC TR 61850-90-1
Table 5 – Jitter classes for WAN
56 5.7 Communication speed symmetry
5.8 Recovery delay
5.9 Time accuracy
5.9.1 Time accuracy definition
Table 6 – Recovery delay classes for WAN
57 5.9.2 Time accuracy classes
Figure 14 – Precision and accuracy definitions
Table 7 – IEC TR 61850-90-1 time accuracy classes
58 5.10 Tolerance against failures
5.10.1 Failure
Table 8 – IEC 61850-5 time accuracy classes for IED synchronization
Table 9 – WAN time synchronization classes
59 5.10.2 Reliability
5.10.3 Redundancy principles
60 5.10.4 Redundancy and reliability
Figure 15 – Redundancy of redundant systems
61 5.10.5 Redundancy checking
5.10.6 Redundant layout: single point of failure
Figure 16 – Redundancy calculation
Figure 17 – Redundancy layout with single point of failure
62 5.10.7 Redundant layout: cross-redundancy
Figure 18 – Redundancy layout with cross-coupling
63 5.10.8 Maintainability
5.10.9 Availability
Figure 19 – Availability definitions
65 5.10.10 Integrity
Figure 20 – Residual error rate as a function of BER
66 5.10.11 Dependability
5.10.12 Example: Dependability of GOOSE transmission
67 6 Use cases and WAN communication requirements
6.1 List of generic use cases
68 6.2 Teleprotection (IF2 & IF11)
6.2.1 Teleprotection schemes
6.2.2 Teleprotection data kinds
6.2.3 Current differential teleprotection for multi-terminal transmission line
69 6.2.4 Teleprotection communication requirements
Figure 21 – Network configurations for multi-terminal line protection
70 Table 10 – Latency for line protection
Table 11 – Summary of operational requirements of line protection
71 6.3 Wide area monitoring system (IF13)
6.3.1 WAMS overview
Table 12 – Summary of communication requirements for teleprotection
72 6.3.2 WAMS topology
73 Figure 22 – Principle of synchrophasor transmission
74 6.3.3 WAMS communication requirements
Figure 23 – PMUs and data flow between TSO and regional data hubs
75 Table 13 – Summary of synchrophasor requirements
76 6.4 Wide area monitoring, protection, and control (WAMPAC) IF13
6.4.1 Functional description
Figure 24 – Target phenomena for WAMPAC
Table 14 – Summary of communication requirements for wide area monitoring
77 Figure 25 – Example of main function and general information flow
78 6.4.2 WAMPAC communication requirements
6.5 Fault Location
6.5.1 Functional description
Table 15 – Typical communication requirements for WAMPAC
79 Figure 26 – Network configuration for a fault locator system
80 6.5.2 Fault location communication requirements
6.6 Distribution Automation
6.6.1 Functional description
Table 16 – Requirements for fault location
81 6.6.2 Distribution automation communication requirements
Figure 27 – System configuration for distribution automation
Table 17 – Requirements for distribution automation communication
82 6.7 Condition monitoring and diagnostics (CMD) and asset management (IF7)
6.7.1 Functional description
6.7.2 CMD communication requirements
Figure 28 – Network configurations for CMD and asset management
Table 18 – Communication requirements for CMD
83 6.8 Telecontrol (SCADA)
6.8.1 Functional description
6.8.2 Telecontrol communication requirements
Figure 29 – Logical network configuration for telecontrol (SCADA)
84 6.9 Control centre to control centre (IF12)
6.9.1 Functional description
Table 19 – Communication requirements for CC to SS/PS
Table 20 – Latency and timing requirements from IEC TR 61850-90-2
85 6.9.2 Inter control centre communication requirements
Figure 30 – Network configurations for inter-control centre
Table 21 – Communication requirements for inter-control centre communications
86 6.10 Smart metering / advanced metering infrastructure
6.10.1 Functional description
6.10.2 Smart metering communication requirements
Figure 31 – System configuration for smart metering
Table 22 – Requirements for smart metering communication
87 6.11 WAN communication requirements summary
Table 23 – Classification of communication requirements
88 7 Wide-area and real-time network technologies
7.1 General
7.2 Topology
Table 24 – Communication requirements of wide-area applications
89 7.3 Overview
Figure 32 – Network ring topology example
90 Table 25 – Communication technologies
91 7.4 Layer 1 (physical) transmission media
7.4.1 Summary
7.4.2 Installation guidelines
7.4.3 Metallic lines
Table 26 – Physical communication media
92 Table 27 – DSL communication over twisted pairs
Table 28 – Trade-offs in copper cable communication
93 7.4.4 Power line carrier (PLC)
Table 29 – Power Line Telecommunication advantages and disadvantages
94 Table 30 – HF spectrum allocated for HV/MV PLC systems
Table 31 – HF spectrum used for narrowband LV PLC and associated standards
95 Figure 33 – Narrowband channel plans for LV PLC Europe vs. North America
Figure 34 – HF allocated frequency spectrum plans for LV BPL
96 Figure 35 – Narrowband spectrum usage vs. standards and regulation areas [57]
97 Table 32 – Characteristics of common NB-PLC standards
98 Figure 36 – HV PLC link building blocks
99 Figure 37 – Phase-to-ground coupling for PLC
Figure 38 – HV PLC coupling with suspended line traps
100 Figure 39 – Phase-to-phase signal coupling for PLC
Figure 40 – Phase-to-phase signal coupling
101 Figure 41 – Power line carrier, line traps
103 7.4.5 Radio transmission
Table 33 – HV/MV APLC/DPLC/BPL technology performance
104 Figure 42 – Terrestrial microwave link
105 Figure 43 – Layer 2 transport on microwave radio systems
Table 34 – Microwave link performance
106 Table 35 – Terrestrial microwave advantages and disadvantages
Table 36 – Terrestrial mobile radio technologies
107 Table 37 – Terrestrial radio advantages and disadvantages
108 Figure 44 – DMR (Digital Mobile Radio)
Table 38 – DMR advantages and disadvantages
109 Table 39 – Satellite radio advantages and disadvantages
110 Figure 45 – LoRaWANTM Protocol Stack
112 Table 40 – LPWAN technology capabilities
113 Table 41 – Wireless technologies used for customer-side communications in Japan
114 7.4.6 Fibre optics
115 Figure 46 – ADSS fibre cable
Figure 47 – ADSS installation with splicing box
116 Figure 48 – OPGW in ground cable
Figure 49 – OPGW with two “C”-tubes each with 32 fibers
117 Figure 50 – OPGW fibers
118 Figure 51 – Splicing box
119 Figure 52 – WDM over one fibre
Figure 53 – OCh optical components
120 7.4.7 Layer 1 redundancy
Table 42 – Optical fibres: advantages and disadvantages
121 7.4.8 Application example: diverse redundancy against extreme contingencies (Hydro-Quebec)
Figure 54 – Optical link with microwave back-up
122 7.4.9 Layer 1 security
7.5 Layer 1,5 (physical) multiplexing
Figure 55 – Photograph of a partially destroyed 735 kV line
123 7.6 Layer 2 (link) technologies
7.6.1 Telephony technologies
124 Figure 56 – E1 and E2 channels
Figure 57 – Digital transmission hierarchy (T-standards)
125 7.6.2 SDH/SONET
Figure 58 – Digital transmission hierarchy (E-standard)
126 Figure 59 – Example of an SDH network for utilities
127 Figure 60– SONET multiplexing hierarchy
Figure 61 – SDH multiplexing hierarchy
128 Table 43 – SONET and SDH hierarchies
129 Figure 62 – SDH/SONET with point-to-point topology
Figure 63 – SDH/SONET with linear topology
131 Figure 64 – BLSR/BSHR topology in normal conditions (from A to D)
Figure 65 – BLSR/BSHR topology in failure conditions
132 Figure 66 – SNCP/UPSR topology in normal conditions
133 Figure 67 – SNCP/UPSR topology in failure conditions
135 7.6.3 Optical Transport Network
Table 44 – Summary of SDH/SONET
136 Figure 68 – Example of information flow relationship in OTN
137 7.6.4 Ethernet
Figure 69 – IEEE 802.3 (Ethernet) frame format
Table 45 – Ethernet physical layers
138 Figure 70 – IEEE 802.3 (Ethernet) topology with RSTP switches
139 Figure 71 – IEEE 802.1Q-tagged Ethernet frame format
140 Figure 72 – Direct Ethernet with VLAN in substation-to-substation transmission
141 Figure 73 – Substation-to-substation Layer 2 transmission tunnelled over IP
142 Figure 74 – PRP structure (within and outside a substation)
143 Figure 75 – HSR ring connecting substations and control centre
144 Figure 76 – MACsec frame format
145 Figure 77 – IEEE 802.1X principle
146 7.6.5 Ethernet over TDM
Figure 78 – Ethernet for substation-to-substation communication
147 Figure 79 – Packets over TDM
Table 46 – Payload mapping using SDH/SONET and Next Generation SDH/SONET
148 7.6.6 Carrier Ethernet
149 7.6.7 Audio-video bridging
7.6.8 Provider Backbone Bridge (PBB)
Table 47 – Carrier Ethernet summary
150 Figure 80 – IEEE 802.1Q/ad/ah network configuration
151 7.6.9 Multiprotocol Label Switching (MPLS)
152 Figure 81 – Basic MPLS architecture
Figure 82 – Example of MPLS frame format with IPv4 payload
153 Figure 83 – MPLS building blocks
155 Figure 84 – MPLS network architecture for utilities
156 Figure 85 – IP/MPLS and MPLS-TP features
Table 48 – IP/MPLS characteristics
157 Table 49 – MPLS-TP characteristics
158 Figure 86 – MPLS-TP redundant routing
Table 50 – MPLS summary
159 7.7 Layer 3 (network) technologies
7.7.1 Internet Protocol (IP)
Figure 87 – Ethernet frame with IP network header
160 Figure 88 – Mapping of IPv4 to Ethernet frames
163 Figure 89 – Mapping of IPv6 to Ethernet frames
164 Figure 90 – IPv6 unicast address structure
165 Figure 91 – IPv6 ULA address structure
Figure 92 – IPv6 link local address structure
166 Table 51 – Differences between IPv4 and IPv6
167 Table 52 – IPv6 vs IPv4 addresses (RFC 4291)
168 Figure 93 – Mapping of IPv4 to IPv6 addresses
169 7.7.2 IP QoS
171 Figure 94 – DiffServ codepoint field
Table 53 – List of DiffServ codepoint field values
172 7.7.3 IP multicast
Figure 95 – Unidirectional protocol independent multicast
173 7.7.4 IP redundancy
7.7.5 IP security
Figure 96 – Bidirectional protocol independent multicast
174 Figure 97 – Frame format for IPsec (authenticated)
Figure 98 – Frame format for IPsec (encrypted)
175 7.7.6 IP communication for utilities
Figure 99 – Layer 3 direct connection within same address space
176 Figure 100 – Connecting substations to SCADA by a NAT
177 7.7.7 IP summary
Figure 101 – Substation to SCADA connection over ALG
Table 54 – IP Summary
178 7.8 Layer 4 (transport) protocols
7.8.1 Transport layer encapsulation
7.8.2 UDP
Figure 102 – Ethernet frame with UDP transport layer
179 7.8.3 TCP
Figure 103 – UDP header
Figure 104 – TCP header
180 7.8.4 Layer 4 redundancy
7.8.5 Layer 4 security
7.9 Layer 5 (session) and higher
7.9.1 Session layer
181 7.9.2 Routable GOOSE and SMV
7.9.3 Example: C37.118 transmission
Figure 105 – Session and presentation layers for MMS
Figure 106 – Session and presentation layers for R-GOOSE
182 7.9.4 Session protocol for voice and video transmission
7.9.5 Application interface redundancy
Figure 107 – IEEE C37.118 frame over UDP
Figure 108 – Redundant network transmission handled by the application layer
183 7.9.6 Application device redundancy
7.10 Protocol overlay – tunnelling
7.10.1 Definitions
184 7.10.2 Tunnelling principle
7.10.3 Tunnelling Layer 2 over Layer 3
Figure 109 – Tunnelling in IEC TR 61850-90-1
185 7.10.4 Application Example: Tunnelling GOOSE and SMV in IEC 61850
Figure 110 – L2TP transporting Layer 2 frames over IP
186 7.11 Virtual private networks (VPNs)
7.11.1 VPN principles
7.11.2 L2VPNs
Figure 111 – Tunneling SMV over IP in IEC TR 61850-90-5
187 Figure 112 – L2VPNs VPWS and VPLS
188 7.11.3 L2VPN multicast on MPLS
7.11.4 L3VPN
Figure 113 – L3VPN
190 7.11.5 VPN mapping to application
Figure 114 – Emulation of L3VPN by L2VPN and global router
191 Table 55 – VPN services
192 Figure 115 – Tele-protection over VPWS
Figure 116 – WAMS over VPLS
193 Figure 117 – VPN for IP-based SCADA/EMS traffic
194 7.12 Cyber security
7.12.1 Security circles
195 7.12.2 Network security
196 Figure 118 – VPN deployment options
197 7.12.3 Access control
7.12.4 Threat detection and mitigation.
198 Figure 119 – IP network separator
201 7.12.5 Security architecture
202 7.12.6 Application (end-to-end) communication security
Figure 120 – Security architecture (using segmentation and perimeter security)
203 7.12.7 Security for synchrophasor (PMU) networks (IEC TR 61850-90-5)
Table 56 – IEC 62351 series
204 7.12.8 Additional recommendations
7.13 QoS and application-specific engineering
7.13.1 General
7.13.2 SDH/SONET QoS and SLA
7.13.3 PSN QoS and SLA
205 7.13.4 Application and priority
7.13.5 QoS chain between networks
Table 57 – Example of simple application priority assignment
206 7.13.6 QoS mapping between networks
Figure 121 – QoS chain
207 7.13.7 QoS engineering
208 7.13.8 Customer restrictions
7.13.9 Clock services
7.14 Configuration and OAM
7.14.1 Network configuration
7.14.2 OAM
210 7.15 Time synchronization
7.15.1 Oscillator stability
Table 58 – Typical oscillator stability
211 7.15.2 Mutual synchronization
7.15.3 Direct synchronization
Figure 122 – Timing pulse transmission methods of legacy teleprotection devices
212 7.15.4 Radio synchronization
7.15.5 GNSS synchronization
7.15.6 Frequency distribution
213 Figure 123 – SyncE application
Figure 124 – Synchronous Ethernet architecture
214 7.15.7 Time distribution
215 Figure 125 – SNTP clock synchronization and network delay measurement
218 Figure 126 – Model of GMC, two BCs in series and SC over Layer 3
Figure 127 – Timing diagram of PTP (end-to-end, 2-step, TC and BC)
219 Figure 128 – Timing diagram of PTP (peer-to-peer, 2-step TCs)
Table 59 – IEC 61588 option comparison
220 7.15.8 PTP telecommunication profiles
221 7.15.9 PTP over MPLS
7.15.10 Comparison of time distribution profiles based on IEC 61588
Table 60 – Precision time distribution protocols based on IEC 61588
222 7.15.11 Application example: synchrophasor time synchronization
223 7.15.12 Application example: Atomic clock hierarchy
Figure 129 – Substations synchronization over WAN
224 8 Technology mapping to applications
8.1 Overview
8.2 Current differential teleprotection for multi-terminal transmission lines
8.2.1 General
Figure 130 – Example of synchronization network
225 8.2.2 Deterministic fibre-optic PDH loop network
8.2.3 Dedicated Gigabit Ethernet network
Figure 131 – Distributed loop configuration for HV multi-terminal line protection
226 8.2.4 Carrier Ethernet with wide-area time synchronization
Figure 132 – Current differential teleprotection for HV multi-terminaltransmission line using Layer 2 network
227 8.2.5 MPLS based wide area network
Figure 133 – Configuration of wide area current differential primary and backup teleprotection system employing Carrier Ethernet and IEC 61588 time synchronization
228 Figure 134 – Current differential protection communication via MPLS network
229 8.3 Wide area monitoring, protection, and control (WAMPAC)
8.3.1 General
8.3.2 Wide area stabilizing control using legacy network
230 Figure 135 – System configuration for wide area stabilizing control system
Figure 136 – Appearance of typical CCE cubicle
231 8.3.3 PMU-based WAMPAC using time-synchronized Layer 2 and Layer 3 network
Table 61 – Main system specifications for wide area stabilizing control system
233 8.4 Fault location
Table 62 – Main system specifications for PMU-based WAMPAC system
234 8.5 SCADA and facility maintenance
Figure 138 – IEEE 802.1Q/ad utility network
235 Figure 139 – Mixed SDH/MPLS network for SCADA and facility maintenance services
Table 63 – Requirements for the YONDEN IP network
Table 64 – Technologies for the YONDEN IP network
236 8.6 Distribution automation
8.7 Smart metering
Figure 140 – Wired technology solutions for distribution automation
Figure 141 – Wireless technology solutions for distribution automation(Radio network in feeder automation)
237 Figure 142 – Multi-hop wireless system
Figure 143 – NB-PLC system
Figure 144 – Cellular services used for a low-density residential area
238 Figure 145 – WAN communication protocols for smart metering
239 9 Network migration
9.1 TDM to packet switched network
9.1.1 General
9.1.2 Overview
9.1.3 Drivers for network migration
240 9.1.4 Considerations for network migration
242 9.1.5 Migration concepts
245 Figure 146 – Migration path from TDM to Packet in the Power Utility Operational Network
246 Figure 147 – Ethernet or MPLS beside SDH over separate fibre or wavelength
Figure 148 – Ethernet or MPLS-TP and SDH in a Hybrid platform
248 9.1.6 Implementation details
249 Figure 149 – Pseudo-wire principle
250 Figure 150 – Non-IP voice communication over PSN
251 Figure 151 – Circuit emulation over PSN
252 9.2 From IPv4 to IPv6
9.2.1 IPv4 to IPv6 evolution
9.2.2 IPv4 to IPv6 migration
Figure 152 – IPv6 evolution
Table 65 – Pseudowire protocols
253 9.2.3 IEC 61850 stack with IPv4 and IPv6
Figure 153 – IEC 61850 stack with IPv4 and IPv6 (doubly attached)
254 Annex A (informative)Future promising or upcoming technologies
A.1 5G
A.1.1 General
255 A.1.2 Different performance requirements
Figure A.1 – Software network technologies in 5G overall architecture
256 Figure A.2 – 5G Conceptual Diagram – NGMN
257 Figure A.3 – NB-IOT deployment models
Table A.1 – 3GPP machine type communications
258 A.2 Deterministic networking technologies
259 Bibliography
BSI PD IEC TR 61850-90-12:2020
$215.11