1. Advances in Communications & Reliability of Power and Control Systems
Presented by
John S. Levine, P.E.
Levine Lectronics and Lectric, Inc.

2. Are you frustrated? Ever had problems getting on the network?
Ever had problems getting on the web?
How can a person with an Apple Computer send you an when you use Microsoft Outlook?
Why can’t I talk to these relays?

3. This is all part of Communications!
All these questions will hopefully be answered and more because:
This is all part of Communications!

4. Overview of Topics to be covered
Basics
Ethernet
Protocols
HMI

5. Basics Introduction Parallel Serial Parity Error Network Standards
OSI Model

6. Introduction Simplex – One direction only
½ Duplex – either direction but only one at a time
Full Duplex – both directions at the same time

7. Formatting Word – Could be 16,32, or 64 bits Group Address Description
Current Phase A Current
Phase B Current
Phase C Current
030D Phase A Differential
030E Phase B Differential
030F Phase C Differential
ASCII (American Standard Code for Information Interchange), is a character encoding based on the English alphabet. ASCII codes represent text in computers, communications equipment, and other devices that work with text. Most modern character encodings—which support many more characters—have a historical basis in ASCII.
ASCII was first published as a standard in 1967 and was last updated in It currently defines codes for 128 characters. 33 are non-printing, mostly obsolete control characters that affect how text is processed, and the other 95 printable characters are as follows (starting with the space character):

8. Parallel
Printer port LPT1 is an example of this.

9. Serial
Asynchronous uses a start bit and a timer and measures the time to the center of each pulse. The Parity bit is used to check and make sure the data is correct and the stop bit is use to tell you the end of byte. You also have a Master and Slaves
Baud Rate – A measure of how fast serial data is moving between devices per second. 2 common levels are 19, 200 BPS and 9,600 BPS and now 115,200 BPS

10. Serial Communications
Physical Layer
RS 232
RS 485
USB

11. RS 232
DTE Data Terminal Equipment DCE Data Communication Equipment
15 meters (45 feet) or less, baud rate of 19,200 or less
Slew Rate – Speed we can go from -25 V to 25 V, limits baud rate DTE Data Terminal Equipment DCE Data Communication Equipment

12. conductors are electrically floating
Up to 32 Devices, up to 3000 feet or 1000 meters, conductors are electrically floating which is why you can get the longer distances, only looking at difference so one may be at 100 V and the other at 106 volts, have a master and slaves. Since you only talk to one device at a time, it is suggested you limit to 6 to 8 devices.
conductors are electrically floating

13. Universal Serial Bus (USB) Port
Up to 127 devices can connect to the host, either directly or by way of USB hubs.
Individual USB cables can run as long as 5 meters; with hubs, devices can be up to 30 meters away from the host.
With USB 2.,the bus has a maximum data rate of 480 Mb per second.
With USB 3.,the bus has a maximum data rate of 4.80 Gb per second.
A USB cable has two wires for power (+5 volts and ground) and a twisted pair of wires to carry the data.
On the power wires, the computer can supply up to 500 milliamps of power at 5 volts.
Type A
USB type A and B
Type B

14. Universal Serial Bus (USB) Port
USB type A and B

15. IEEE 1394 Interface
The IEEE 1394 interface is a serial bus interface standard for high-speed communications and isochronous real-time data transfer, frequently used in a personal computer (and digital audio and digital video). The interface is also known by the brand names of FireWire (Apple Inc.), i.LINK (Sony), and Lynx (Texas Instruments). Though not as widely used, the 1394 standard also defines a backplane interface.
Firewire 400-Speeds from 100, 200, or 400 Mbits/s half-duplex
Firewire S3200-Speeds up to Mbits/s half-duplex
S3200 is a 9 pin connector or now can use Cat 5e Cable, isochronous (iso means same, chronous is time),

16. Network

17. Network

18. Network Topologies
The network topology defines the way in which computers, printers, IEDs and other devices are connected
A network topology describes the layout of the wire and devices as well as the paths used by data transmissions.
Commonly, referred to as a linear bus, all the devices on a bus topology are connected by one single cable.

19. PRP Parallel Redundant Protocol

20. Standards

21. 2008 Proposed IEEE C37-2 Revision presented at Georgia Tech Relay Conference
Copy at
www.
L-3.com/IEEE

22. OSI Model
Developed in 1978, the Open System Interconnection has 7 layers each performing part of the communications.
the physical level controls the physical connections between devices, network topology, voltage levels to define 0’s and 1’s.RS232 and RS485 are 2 examples
Data link level provides framing
network determines optima routing
transport level guarantees delivery and is error free -TCP / IP (Transport Control Protocol / Internet Protocol) is at transport level
session mechanism for the establishment of a communications session between applications
presentation – correct translation of data
application – provides the facilities or interface to allow the application protocols or drivers such as Modbus or DNP

23. Developed in 1978, the Open System Interconnection has 7 layers each performing part of the communications.
The physical level controls the physical connections between devices, network topology, voltage levels to define 0’s and 1’s.RS232, RS485, and USB are 3 examples
Data link level provides framing
Network determines optima routing – IP of TCP/IP is based on this
Transport level guarantees delivery and is error free – the TCP of TCP / IP (Transport Control Protocol / Internet Protocol) is at transport level
Session mechanism for the establishment of a communications session between applications
Presentation – correct translation of data
Application – provides the facilities or interface to allow the application protocols or drivers such as Modbus or DNP

24. Ethernet
Introduction
10/100/1000 Base T
Hubs and Switches
Fiber

25. Introduction
Relays are now available with Ethernet connectors and IP addresses built in.

26. Ethernet in Devices
When devices come with an Ethernet port, you assign a fixed IP address in the Relay.
Relays do not use DHCP - Dynamic Host Configuration Protocol

27. 10/100 Base T Max distance 100 meters or 328 feet
Max distance is 100 meters or 328 feet.
Max distance 100 meters or 328 feet

28. 10/100/1000 Base T Cat 5 Cable Cat 5e Cable
If you have a computer talking directly to another computer or device you may need a cross over cable. Most new computers have autosensing.
Cat 5 Cable
Cat 5e Cable
Cat 6 Cable (up to 250 Mhz)
Cat 6A (Augmented-up to 500 Mhz)

29. Power over Ethernet (POP)How does it work?
Note:
Which pin-out to use is determined by an interrogation between the switch and the end device.
All wiring is STANDARD EtherNet.
Basically standard 4 pair EtherNet cabling is used for PoE. The only special requirements are on the switch and device end. If they are compliant to the standard 802.3af / at then they will auto-negotiate the power requirements (Plug and Play)
RJ45 Socket Pin-out
RJ45 Connector Pin-out
Source -

30. Fiber
Power budget is the signal transmitter rated power minus the attenuation (cable, connections, splices, and cable aging) and the receiver’s sensitivity
Power Budget

31. Single and Multi Mode Fiber
Multi mode has a shinny mirrored surface. Single mode keeps redirecting the light to the center, The center of multi mode is “doped” to slow down the signal so the reflected light gets there at the same time as what goes through the center.

32. Single and Multi Mode Fiber
125 micrometers
62.5 micrometers and now 50 micrometers

33. Common Fiber Connectors
SC-Subscriber Connector
ST-Straight tip
Primary
Ethernet Port
LC-Lucent Connector
GE Multilin uses the ST as standard
Redundant
Ethernet Port

34. Traditional Switchyard Construction
Traditional Breaker Wiring
Traditional Cable Trench
Thousands of Copper Wires from Switchyard
Labor Intensive Copper Wiring on Relay Panels

35. Hard Fiber Eliminating Complexity
Using IEC Process bus, you can not use one fiber where you use to use multiple cables.
40 less cabling with no terminations required
Eliminates 33 of breaker terminations
Eliminate 90 of control building terminations
1,000’s of wires replaced with few communication cables

36. Hubs and Switches
Switches can buffer the message so there are no collisions like a hub. Ours are Utility hardened, have output contact and dual power supply, can use on a ring topology.

37. Managed Switches
Simple Network Management Protocol (SNMP): a set of protocols for managing network performance, finding and solving network problems, and planning for network growth
Internet Group Management Protocol (IGMP): configures broadcast message behavior
Virtual LAN (VLAN): a network of computers that behave as if they are connected to the same wire even though they may actually be physically located on different segments of a LAN
Quality of service (QoS): Allows prioritization of packets to occur or improve performance for key channels
Rapid Spanning Tree Protocol (RSTP): algorithm to prevent wiring topology mistakes or create redundancy in a network
Key features of a managed switch, There is a buffer in a switch. The QoS can bypass the buffer.

38. Industrial Switches for the Plant Floor

39. Hubs and Switches
Has Normal and alternate port, managed and unmanaged, operating temperature of -40o C to +80o C

40. Wireless
This is where the future is. Products are now being designed with Wireless build into the device.
Regulated and unregulated frequencies
900 Mhz
2400 Mhz
1800 / 3650 / 5800 Mhz
Different speeds depending on the application
As the Frequency goes up, the distance goes down

42. Router
Definition from Wikipedia - A router is a computer networking device that forwards data packets across a network toward their destinations, through a process known as routing. Routing occurs at Layer 3 (the network layer i.e. Internet Protocol (IP) of the OSI seven-layer protocol stack.
Side note – Wikipedia and Linux are written collaboratively by volunteers and are “open source” and free.
Wikipedia and Linux are written collaboratively by volunteers and are “open source” and free.

43. Other Computer Networking Devices
Gateway: device sitting at a network node for interfacing with another network that uses different protocols. Works on OSI layers 4 to 7.
Bridge: a device that connects multiple network segments along the data link layer. Works on OSI layer 2.
Repeater: device to amplify or regenerate digital signals received while setting them from one part of a network into another. Works on OSI layer 1.

44. Other Terms
PRP – Parallel Redundancy Protocol – Two completely separate Lans going to the same device
Bandwidth – max data transfer rate
Server - computer programs running to serve the requests of other programs, the "clients“
VPN – Virtual Private Network
RSTP - Rapid Spanning Tree Protocol – determines the path the message will take between 2 nodes

45. Other Terms IRIG-B – Time code accurate to 10 ms
SNTP – Simple Network Time Protocol – typically 1 to 2 ms
PTP (Presion time Protocol) time distribution technologies sub-microsecond accuracy
QoS- Quality of Service – Overall performance of the network

46. Proxy, Firewall, and Port
Proxy: computer network service which allows clients to make indirect network connections to other network services
Firewall: a piece of hardware or software put on the network to prevent some communications forbidden by the network policy
Computer port (hardware) - a physical interface between a computer and other computers or devices (COM1)
Computer port (software) - a virtual data connection between computer programs possibly through a computer network
A proxy server is a computer that offers a computer network service to allow clients to make indirect network connections to other network services. A client connects to the proxy server, then requests a connection, file, or other resource available on a different server. The proxy provides the resource either by connecting to the specified server or by serving it from a cache. In some cases, the proxy may alter the client's request or the server's response for various purposes.

47. Firewalls
From a Linksys router
From a Linksys router

48. Relays at L-3 Wan I.P Firewall Port Technology LAN IP LAN Port
Slave Address
Device
502
Relays
254
F60
503
Multinet 1
PQM II 3
SPM 45
745 89
489
504
242
469
505
243
760
506
249
MM300
507 13
T60
508 2
369
509
350

49. Serial to Ethernet Converters
Multinet acts as a master for the 485 slave relays

50. Serial to Ethernet Converters
Converter may just change from serial to Ethernet or may also be a gateway and change from one protocol to another. You assign an IP address to the converter.

51. Adding Devices to a Network
Static IP address for device
Subnet for network
Go to Network and Sharing Center
Change adapter settings
Right click for properties
If you want to talk to a device with a static IP, you may have to change the IP on your computer to the same network. Make all the numbers the same except the last group on the IP address.

52. Adding Devices to a Network
If you are going wireless you will want to leave it as obtain an IP address automatically. The DNS server will convert a name like to an IP address. DNS was started in There are 32 Master DNS servers where all domains start from.
DNS - Domain Name System, Internet system to translate names into IP addresses
IP v4 and IP v6 (8 groups of 4 hex digits 0db8:2001:85a3:0000:0000:8a2a:0370:7334)

53. Checking IP Address
cmd will bring up the dos prompt

54. Checking IP Address
In the example above, I have two IP addresses. The wireless was DHCP assigned and the local was manually assigned by me.

55. Other useful Dos Command
ipconfig /release
ipconfig /renew
ipconfig /all (gives you IP and MAC address)
ping -t
tracert
exit
You can hit F3 to go to the previous dos command
Or you can hit the up arrow to go back to previous dos commands

56. ping
Disconnect relay and check ping to make sure 2 devices do not have the same IP address. TTL stands for time to live

57. tracert Black list and White list Gray list
If you hit a request time out before the trace is compete it may be due to a black list. Black list is blocked. White list is allowed. Gray list is blocked the first time, but allowed the second time. Designed to greatly reduce spam. If you send that person an first, then it gets white listed and you do not have to wait for the second broadcast, if it comes from the same server.
Black list and White list
Gray list

58. Useful Internet Sites and Programs
- can use to find if a web site is getting blocked or who owns it.
- Can use for a speed test
– Can use to check for leaks in your firewall
get the IP address for a I.P. name.
– your WAN IP
Wireshark -

60. Wireshark
Wireshark is a free program to monitor the traffic over an ethernet network. You can see who is broadcasting and determine the amount of bandwidth required.

61. Protocols Modbus Modbus Plus DNP DeviceNet and EtherNet/IP
Profibus and Profinet
Direct I/O
IEC 61850
Hart
BACnet
EtherCat
Protocol Converters

62. Modbus
Can be communicated via RS 232, RS485, 10/100 Base T, and 10/100 Base F
Is half-duplex serial in all configurations
Uses a master and slaves
Data is stored in registers
Data is stored in a hex register. In order to get all the data with one read command we have a user map where we store the data we want consecutively. Excellent for data. Terrible for control.

63. Modbus Plus Proprietary protocol
Can be communicated via RS485. Uses a peer-to-peer token exchange type network. Multi-Master.
Global data can be sent with the token.
64 nodes per network, can Bridge networks.
Speeds up to 1 MB
Up to 1800 meters with repeaters

64. Digital Network Protocol (DNP 3)
Developed by GE Harris – can time stamp data
Scalable
Has Client (computer) and server (device)
Also called Master and Slave
Can poll for change
Can set up for Unsolicited messaging from server
Can provide only changed values.
Can Prioritize messages
Server is serving up the data. Client is the one that wants to receive the data.

65. Digital Network Protocol (DNP 3)

66. DeviceNet (serial) EtherNet/IP (Ethernet Industrial Protocol)
Based on the Controller Area Network protocol (CAN)
Managed by the Open DeviceNet Vendors Association
Bus Topology at 24 VDC
Baud rates of 125, 250, and 500 Kbps
Can have up to 64 nodes on a single local network
DeviceNet uses abstract OOT (Object-Oriented Technique)
objects
class
instances
attributes
Designed for control not data collection. Must be on smaller network.

67. DeviceNet

68. Profibus (serial) Profinet (ethernet)
Profibus (Process Field Bus)
Profibus-DP (Decentralized Periphery)
Profibus -FMS (Fieldbus Message Specification)
Profibus -PA (Process Automation)
Profinet – Ethernet based Field network

69. Profibus

70. Profibus

71. Profibus

72. Direct I/O 4 interface standards can be used
IEEE 37.94, Fiber, RS422, and G.703

73. Direct I/O Great for a Main – Tie – Main application
In the 750 relay you have to tie 11 of the 14 inputs to the other 2 relays. If one of the wires gets broken or miswired you probably will not know till it is too late. If the fiber get cut you will know in 8 msec or less. Can have redundant channels.

74. IEC 61850 Designed as a universal plug and play between manufactures
Uses descriptions instead of registers
Generic Object Oriented Substation Event –Messaging (GOOSE Messaging)
Ethernet is required as part of IEC 61850
The phrase “sixty-one-eight-fifty”
has become a designator for the next generation substation secondary system with a higher degree of integration, reduced cost, greater flexibility, communication networks replacing hard-wired connections, plug-and-play functionality, reduced construction and commissioning time, and other advantages

75. IEC 61860
We have an example where we are sending a goose message from one relay to another relay that is 100 miles away and are making the second breaker trip within 8 ms.

76. Nodes will turn green when active

77. IEC 61850 Applications Breaker Failure Initiate to Other Breaker
Broadcast a Trip Message to All Feeder Breakers
(Bus Differential)
High Speed Bus Transfer (M-T-M)
Switching Set Groups
Upstream Relay Tripping & Blocking
Bus Protection
Relay Voting
Reclose Initiation
Load Shedding
KW or KVA Load Shedding
Underfrequency Load Shedding
Transfer Tripping
Remote Start/Stop Commands

78. Hart
HART (Highway Addressable Remote Transducer) Protocol is the global standard for sending and receiving digital information across analog wires between smart devices and control or monitoring system.

79. BACnet
BACnet (Building Automation and Control) was developed in 1987 by a group of HVAC and Building Automation professionals as a standard, open protocol specifically for the building automation industry.  It is an ASHRAE, ANSI, and ISO standard protocol.
Protocol
The BACnet protocol defines a number of services that are used to communicate between building devices. The protocol services include Who-Is, I-Am, Who-Has, I-Have, which are used for Device and Object discovery. Services such as Read-Property and Write-Property are used for data sharing. The BACnet protocol defines a number of Objects that are acted upon by the services. The objects include Analog Input, Analog Output, Analog Value, Binary Input, Binary Output, Binary Value, Multi-State Input, Multi-State Output, Calendar, Event-Enrollment, File, Notification-Class, Group, Loop, Program, Schedule, Command, and Device.

80. EtherCat
EtherCat is an Ethernet based fieldbus system designed for extremely fast data update times in the range of < 100 µs.
The Standard Ethernet packet or frame is no longer received, interpreted, and copied as process data at every node. The EtherCAT slave devices read the data addressed to them while the telegram passes through the device, processing data "on the fly". Similarly, input data are inserted while the telegram passes through. A frame is not completely received before being processed; instead processing starts as soon as possible. Sending also is conducted with a minimum delay of small bit times.

81. Protocol or Gateway Converters

82. Universal Gateway
There are Universal Gateways and controllers that collects metering, status, event, and fault report data from serial or LAN based Intelligent substation devices. The Gateways summarizes data from the substation devices and makes it available locally/remotely through a standard secure web browser (HTTPS).

83. Human Machine Interface (HMI)
Overview
Plug and Play
One-Line Viewer
Annunciator
OPC / DDE Server

84. HMI Overview SCADA – Supervisory Control And Data Acquisition
RTU – Remote Terminal Unit
It is now extremely easy and cost effective to view your devices without having to be in front of the relays.

85. Plug and Play Viewpoint Monitoring
Can use to sync all the clocks.

86. Dashboard

87. One-Line Viewer

88. One-Line Editor

89. Annunciator

90. Automatic Event and Waveform Retrieval

91. Trending Reports

92. Comtrade Files

93. OPC
The OPC Foundation is an industry consortium that creates and maintains standards for open connectivity of industrial automation devices and systems. The OPC standards specify the communication of industrial process data, alarms and events, historical data and batch process data between sensors, instruments, controllers, software systems and notification devices.
The OPC Foundation started as a task force comprised of five industrial automation vendors with the purpose of creating a basic OLE for Process Control specification. OLE is a technology developed by Microsoft Corporation for the MS Windows operating system. The task force released the OPC standard in August The OPC Foundation was chartered to continue development of interoperability specifications and includes manufacturers and users of devices, instruments, controllers, software and enterprise systems.
OPC Standards and Specification Groups
OPC Data Access 
This group of standards provides specifications for communicating real-time data from data acquisition devices such as PLC's to display and interface devices like Human-Machine Interfaces (HMI). The specifications focus on the continuous communication of data
OPC Alarm and Events 
Standards for communicating alarm and event data on demand, as opposed to the continuous communications in the OPC Data Access group
OPC Batch 
Standards to address the needs of batch processes
OPC Data exchange 
This group of standards addresses server to server communications across industrial networks. The standards also address remote configuration, diagnostics, monitoring and management communications
OPC Historical Data Access 
Standards for communicating stored data
OPC Security 
Standards for controlling client access to OPC compliant devices and systems
OPC XML-DA 
Builds on the OPC Data Access specifications to communicate data in XML. Incorporates SOAP and Web services
OPC Complex Data 
Standards for specifying the communication of complex data types such as binary data and XML documents
OPC Commands 
Standards for communicating control commands to devices and systems
OPC Unified Architecture 
An entirely new set of standards that incorporates all of the functionality of the above standards (and more), but does so using cross platform web services and other modern technology. OPC Unified Architecture

94. DDE
Dynamic Data Exchange (DDE) is a technology for communication between multiple applications under Microsoft Windows and OS/2.
Microsoft Excel has a DDE server – you can open a Microsoft Excel spreadsheet and fill it with data, by opening a DDE conversation with Excel and sending it DDE commands.
Dynamic Data Exchange was first introduced in 1987 with the release of Windows 2.0. Although still supported in even modern Windows versions, it has mostly been replaced by its much more powerful successors OLE, COM, and OLE Automation. However, it is still used in several places inside Windows, e.g. for Shell file associations.
DDE allows one application to open a session with another, send commands to the server application and receive responses. However, it does not enable the server application's graphical user interface to be incorporated into the client application's; it did not support incorporation of server application data into client application files (i.e. structured storage); and in order to use DDE, one has to know the DDE commands that the server supports, which were generally not standardized (although some standards do exist, e.g. the Spyglass specification for web browsers). Thus, in order to use DDE fully, special code must be added to each client application for each server application it wants to control, or the client application must provide a scripting language or macro facility.

95. OPC / DDE Server
One example is where we have GE Multilin Relays and Group Schneider PLC’s being fed into the OPC server and the information is being read by an Allen Bradley HMI program.

96. Sources of Information
GE Multilin Communications Training CD
Most of these sites have free tutorial on how the protocol works.

97. Website:

98. Thank You

99. C:\Users\john.L3.000>netstat -an | find "LIS"
TCP : : LISTENING
TCP : : LISTENING
TCP : : ESTABLISHED
TCP : : LISTENING
TCP : : ESTABLISHED
TCP : : ESTABLISHED
TCP : : ESTABLISHED