1. OpenSG and Conformity Bruce Muschlitz EnerNex Corporation Knoxville 19-22 October 2009

2. UCAIug Org Chart 2009

3. IEC 61850 (Edition 1) Part 4 : System and Project Management –Clause 7 : Quality Assurance 7.3.5 : Conformance Test Part 10 : Conformance Testing –Clause 5 Conceptual test model Use of SCL files –Clause 6 : 61850 Abstract server tests –Clause 7 : Performance tests –Annex A : Detailed test procedure templates

4. IEC 61850ug Committee TISSUE database Maintain 61850 portion of the Quality Assurance Program (QAP) –Test Architecture (network based) –Conformance Building Blocks (CBBs) –Test report requirments Recommend extensions to standards Write “application notes”

5. Testing Committee Maintain lists : –Accredited testers –Conformance tested devices Maintain documents –Quality Assurance Program (basic) –Accreditation Procedure –Platform testing –Detailed Test procedures (ex: 61850 servers) Resolve interoperability disputes Accredit (and annually re-accredit) testers

6. Testing Procedures sub-committee Collect testing needs from users/vendors Assist with abstract tests creation –61850-10 has basic server abstract tests –Ex : “Verify can extract data dictionary” Create detailed tests from abstract tests –61850-10 provides a template Name and purpose of test References to standard clause(s) Expected results Test description

7. 61850 Testing – What’s missing? Performance Testing : timing, accuracy, etc Inter-operability testing Plug-fests: but what is the purpose? –Technology demonstrations (this stuff works) –Vendor marketing (our stuff works) System (end-to-end) testing Environmental testing (EMC, etc.) Regulatory tests (ex: FCC emission tests)

8. Conformance vs. Inter-operabilty testing Definitions –Conformance : Does it meet every item in spec? –Inter-operability : Can it work with ANY Conformance Certified device? Conformance != Inter-operability

9. Conformance vs. Inter-op testing (cont.) Conformance Closed test Negative Test 1 “synthetic” others Environmental testing (EMC, temp, etc.) Easy to prove result Interoperabilty Open test Negative test Many “real” others Human environment Result dependent on “when” test was run Both Conformance and Inter-op are needed –First verify each device Conformance

10. How 61850 can help OpenSG 61850 has already paved the path Templates –QAP addendum for 61850 exists –Abstract Conformance test procedures –Detailed Conformance test procedures –Distribute “the good word on tested products” Unfortunately, no interop testing done –UCAIug can assist with plug-fests –Virtual plug-fests?

11. Next Steps We are not starting from scratch Abstract / detailed tests already exists Re-organized to fit UCAIug mold? –Synergies between OpenSG and 61850 exist –This will involve additional work –Industry will see as a positive move –If we move, CIM may follow (good for UCAIug)

12. Questions? Contact information: Bruce Muschlitz - bruce@ucausersgroup.orgbruce@ucausersgroup.org Kay Clinnard - kay@ucausersgroup.orgkay@ucausersgroup.org Testing documents: http://www.ucaiug.org/org/TechnicalO/ Testing/default.aspx -UCAI Testing Quality Assurance Program -Current IEC 61850 Testing Procedures