Presentation is loading. Please wait.

Presentation is loading. Please wait.

CJK Kernel Regression Tests Project Hiro Yoshioka/CTO Miracle Linux Corporation.

Similar presentations


Presentation on theme: "CJK Kernel Regression Tests Project Hiro Yoshioka/CTO Miracle Linux Corporation."— Presentation transcript:

1 CJK Kernel Regression Tests Project Hiro Yoshioka/CTO Miracle Linux Corporation

2 209/01/06 Copyright © MIRACLE LINUX CORPORATION All rights reserved  Misson  Goals  Plan  Communities Agenda

3 309/01/06 Copyright © MIRACLE LINUX CORPORATION All rights reserved Mission  We need a systematic way to find a regression of the Linux Kernel.  Motto: Test Early, Test Often

4 409/01/06 Copyright © MIRACLE LINUX CORPORATION All rights reserved Goals  Build Kernel Regression Tests  CJK (China/Japan/Korea) co- development Project  Community Alliance  Test Summit At San Francisco  autotest  ABAT (http://test.kernel.org)  LTP

5 509/01/06 Copyright © MIRACLE LINUX CORPORATION All rights reserved Non Goals  Certification Tests  e.g., POSIX  Performance Tests  e.g., Benchmarks

6 609/01/06 Copyright © MIRACLE LINUX CORPORATION All rights reserved Kernel Regression Tests  Find a regression between Linux Kernels  Regression: Binary Incompatibility between versions.  We’d like to find regressions of the implementation defined and dependent features as well as the standard defined features.

7 709/01/06 Copyright © MIRACLE LINUX CORPORATION All rights reserved If we have regression tests,  We can find a regression as soon as bug is introduced.  Patch submitter may be required to run the regression tests to make sure that it introduces no incompatibility.

8 809/01/06 Copyright © MIRACLE LINUX CORPORATION All rights reserved Plan  CJK Co-development Project  North East OSS Promotion Forum  WG1 agreed as a co-development project  Schedule:  Kickoff, November, 2006  Regression Test Framework V0.1. March, 2007

9 909/01/06 Copyright © MIRACLE LINUX CORPORATION All rights reserved Web Interface RDB Regression test framework Server Interaction (TBD) Server (test.kernel.org) SUT (System Under Test) LTP CJK regression test sparsemem Testing cycle Each test Proposal

10 1009/01/06 Copyright © MIRACLE LINUX CORPORATION All rights reserved What we will build  Regression Test Framework  invoke regression tests  compare the results and the expected results  report NG if the result has a difference, OK if output is the same.

11 1109/01/06 Copyright © MIRACLE LINUX CORPORATION All rights reserved  Regression Tests  a program which calls a Linux Kernel System call.  Positive tests: The expected result does not have the error condition.  Negative tests: The expected result has an error condition

12 1209/01/06 Copyright © MIRACLE LINUX CORPORATION All rights reserved  Regression Tests  Black Box Test: Tester uses only the external API information to make tests.  White Box Test: Tester uses the source code information to make tests.

13 1309/01/06 Copyright © MIRACLE LINUX CORPORATION All rights reserved  Kernel Coverage Profiling Tool  It profiles a branch coverage.  We can use it as the test coverage information which is needed on the white box tests.

14 1409/01/06 Copyright © MIRACLE LINUX CORPORATION All rights reserved Regression Tests as CJK project  easy to divide the project  The Linux Kernel has about 300 system calls  e.g., CJK each region covers about 100 system calls.  Regression Test Framework and the Kernel Branch Coverage tool will be developed by Japan.

15 1509/01/06 Copyright © MIRACLE LINUX CORPORATION All rights reserved Community Alliance is Key  We need to cooperate with communities.

16 1609/01/06 Copyright © MIRACLE LINUX CORPORATION All rights reserved Todo  Make The Development Plan  Schedule  Specification  We need a project nickname. KRT (kernel Regression Test) is *not* sexy. Name Does Matter.  Set up the project portal.  e.g., sourceforge is OK for us.

17 1709/01/06 Copyright © MIRACLE LINUX CORPORATION All rights reserved  Future Works  sysfs/procfs/ioctl etc interface tests  Meta test framework  Test analysis tools  Test and Specifications

18 1809/01/06 Copyright © MIRACLE LINUX CORPORATION All rights reserved Communities  OSDL BRT  LTP - Linux Test Project  Kernel Autotest  Test Tools Wiki(OSS Testing Summit)


Download ppt "CJK Kernel Regression Tests Project Hiro Yoshioka/CTO Miracle Linux Corporation."

Similar presentations


Ads by Google