1. Automate Translation Quality Control Vicky Liu Joey Chai Caroline Ouyang Copyright © 2011 Intel Corporation. All rights reserved. Intel and the Intel logo are trademarks of Intel Corporation in the United States and/or other countries.

2. Agenda What Process is Commonly Used? What is Our Idea? What Do We Add to Each Step? Summary Q&A

3. What Process is Commonly Used? Option A: QA Audit & Update Directly Translation Management System Translator Completes Translation QA Audits & Updates Translation Bug Tracking Tool QA Records Bugs Bug Tracking Tool QA Generates Translation Quality Evaluation Report Advantage : Process is simple and quick. Disadvantage : Lack of communication between QA and translator. Simple But Lack of Strict Quality Control

4. What Process is Commonly Used? Option B: Translation Management System Bug Tracking Tool Translator Completes Translation QA Audits & Records Bugs TL Sends Report to Translator to Fix Bugs QA Sends Bug Report to TL Bug Tracking Tool QA Generates Quality Evaluation Report Advantage : QA and translator come to agreement on final translation. Disadvantage : Process is comparatively long and some processes rely on human efforts. Strict Quality Control But Longer Process

5. What is Our Idea? Our Idea: Translator Completes Translation Translation Management System QA Highlights Updated Text & fills in Bug Comments Translation Management System Translator Accepts / Declines the Updated Text Automatic Function Send Bug Report …… Automatic Function …… Automatic Function Generate & Send Reports Automatic Function Send Updated Bug Report Translation Management System TL Finalizes Translation Final Bug Report Updated Translation Report Translation Quality Evaluation Report Simple & Strict Quality Control

6. What do We Add to Each Step? – QA highlights the updated translation. – Error Category / Severity and comments can be added. – All updated information will be recorded in the system. Translation Management System QA Highlights Updated Text & fills in Bug Comments Thank you for your feedback! 感谢你的回答反馈！ 0 QA Comments User Stage Time Error Category (Severity) Translation is wrong.lauyang Language Review 11/09/2011 Accuracy (Critical) Accuracy (Major) Accuracy (Minor) Consistency (Critical) Consistency (Major) Consistency (Minor) Country (Critical) Accuracy (Critical) Accuracy (Major) Accuracy (Minor) Consistency (Critical) Consistency (Major) Consistency (Minor) Country (Critical) Close

7. What do We Add to Each Step? No. File/ Location Status Source Text Translated Text Suggested Text Error Category (Severity) QA Comments Time Translator Comments Time 1 XXXOpen Thank you for your feedback ！ 感谢你的回 答！ 感谢你的反 馈 ! Accuracy (Major) Translation is wrong 11/09/ 2011 2 3 4 5 Automatic Function Send Bug Report

8. What do We Add to Each Step? Translation Management System Translator Accepts / Declines the Updated Text Accuracy (Major) Thank you for your feedback! 感谢你的回答反馈！ 0 QA Comments User Stage Time Error Category (Severity) Translation is wrong.lauyang Language Review 11/09/2011 Close Translator Comments User Stage Time Acceptccuri Engineeri ng 13/09/2011 Close Accept Decline Thank you for your feedback! 感谢你的反馈！ 0

9. What do We Add to Each Step? Translation Management System Translator Accepts / Declines the Updated Text Accuracy (Major) Thank you for your feedback! 感谢你的回答反馈！ 0 QA Comments User Stage Time Error Category (Severity) Translation is wrong.lauyang Language Review 11/09/2011 Close Translator Comments User Stage Time Original translation is more accurate in this context.ccuri Engineeri ng 13/09/2011 Close Accept Decline Close and timely communication between QA and Translator.

10. What do We Add to Each Step? Automatic Function Send Updated Bug Report No. File/ Location Status Source Text Translated Text Suggested Text Error Category (Severity) QA Comments Time Translator Comments Time 1 XXXClose Thank you for your feedback! 感谢你的回 答！ 感谢你的反馈！ Accuracy (Major) Translation is wrong 11/09/ 2011 2 XXXOpen Thank you for your feedback! 感谢您的反 馈！ 感谢你的反馈！ Accuracy (Minor) Translation is not proper 11/09/ 2011 original translation is proper in this context 13/09/ 2011 3 4 5 The disputed bugs will be highlighted.

11. No. File/ Location Status Source Text Translated Text Suggested Text Error Category (Severity) QA Comments Time Translator Comments Time 1 XXXClose Thank you for your feedback! 感谢你的回 答！ 感谢你的反馈！ Accuracy (Major) Translation is wrong 11/09/ 2011 2 XXXOpen Thank you for your feedback! 感谢您的反 馈！ 感谢你的反馈 Accuracy (Minor) Translation is not proper 11/09/ 2011 original translation is proper in this context 13/09/ 2011 3 What do We Add to Each Step? Translation Management System TL Finalizes Translation TL makes final decision and only be involved when necessary. Close cooperation between team members.

12. What do We Add to Each Step? Each role can benefit from the process by generating different reports by the system automatically. Final Bug Report QA lead Translation Quality Evaluation Report Final Bug Report Updated Translation Report PM/TL Final Bug Report Updated Translation Report Translator

13. What do We Add to Each Step? All bugs closed Final Bug Report No. File/ Location Status Source Text Translated Text Suggested Text Error Category (Severity) QA Comments Time Translator Comments Time 1 XXXClose Thank you for your feedback! 感谢你的回 答！ 感谢你的反馈！ Accuracy (Major) Translation is wrong 11/09/ 2011 2 XXXClose Thank you for your feedback! 感谢您的反 馈！ 感谢你的反馈 Accuracy (Minor) Translation is not proper 11/09/ 2011 original translation is proper in this context 13/09/ 2011 3

14. What do We Add to Each Step? Translation Quality Evaluation Report Quality Assurance Form Language:xxxReviewer:xxxDate:xxxResult:Pass Client Name xxxProject Numberxxx Project NamexxxProject Managerxxx Number of words500 Minor1 point Max error points allowed31 Major5 points Criticalmax. error points + 1 Error Category Number of Errors - MINOR Number of Errors - MAJOR Number of Errors - CRITICAL Total Error Points Scored Max. Error Points Allowed Result Terminology310810 Pass Language 1217 Pass Grammar20022 Pass Semantics20023 Pass Spelling310810 Pass Punctuation00002 Pass Style10012 Pass Country00002 Pass Total11202131 Pass

15. What do We Add to Each Step? Updated Translation Report Project Name: xxx SR Number: xxx Project Manager: xxx TL Name: xxx Translation Vendor: xxx Drop/Package Number: xxx Total word count: xxx Language: xxx QA tester: xxx Source TextTranslated Text Updated Translation Text Update TimeModifier Thank you for your feedback! 感谢你的回答！感谢你的反馈！ 11/09/2011xxx

16. Summary  Efficiency: Leverage automatic functions.  Quality: Closer and more timely cooperation.  Advantageous to project management. Translator Completes Translation Translation Management System QA Highlights Updated Text & fills in Bug Comment Translation Management System Translator Accepts / Declines the updated Text Automatic Function Send Bug Report …… Automatic Function …… Automatic Function Generate & Send Reports Automatic Function Send Updated Bug Report Translation Management System TL Finalizes Translation Final Bug Report Updated Translation Report Translation Quality Evaluation Report