1. RANJAN BHAMBROO Experimental Investigation of Effectiveness of Logical Expressions Using t-way Testing

2. Introduction Experimental Evaluation of logical expressions. Same idea but continued on new path. T – way testing instead of pair-wise testing. New tool for generating logical expressions. New tool from NIST to construct t-way test sets.

3. T-way Testing T-way Pair – wise = 2-way T-way where t=2,3,4,5,6. T- way more effective than pairwise. But test cases not enough need more test cases.

4. T-way Testing Example: For 15 variables total number of combinations = 2 15 2 15 = 32768 combinations T-way valuesTest Cases 2-way10 3-way24 4-way58 5-way131 6-way296

5. Tools Used Boolean Expression Generator – ECU( Developed by Ranjan Bhambroo) Advanced Combinatorial Testing System(ACTS) for constructing t-way combinatorial test sets – NIST Fault Evaluator – ECU

6. Boolean Expression Generator(New Tool) Generates Logical Expressions Automatically. Simple and user friendly interface. Different Modes to generate Expressions: a)Random Number of variables. b)Fixed Number of variables. c)Interval of variables Can Control complexity of expressions. Allows user to save expressions in a text file.

7. Experimental Results Of T-way Testing Fault Evaluator Boolean Expression Generator Advanced Combinatorial Testing System Logical Expressions T-way Test Sets Effectiveness

8. Experimental Results Of T-way Testing Note Using Pair Wise Test Cases 10 expressions/setVNFORFVRF(ENF)ASF All Fault Types (weighted avg.) Set136.2545.5824.9660.2774.5130.34 Set224.6739.5717.946.5554.8422.32 Set328.5743.1819.5445.787524.54 Set428.0646.9921.6955.9562.7926.96 Set530.6739.8620.3862.0760.9825.3 Average29.64443.03620.89454.12465.62425.892 Std. Deviation3.8232.9742.3766.8017.9092.678

9. Experimental Results Of T-way Testing Note Using 3-Wise Test Cases 10 expressions/setVNFORFVRF(ENF)ASF All Fault Types (weighted avg.) Set140.8848.0327.6163.938033.27 Set226.3942.5420.6248.2172.4125.22 Set328.9745.1922.0453.2371.8826.88 Set432.2452.1126.0259.776.4731.52 Set536.2253.8529.1268.7586.6734.47 Average32.9448.34425.08258.76477.48630.272 Std. Deviation5.1574.2013.2487.3395.4573.611

10. Experimental Results Of T-way Testing Note Using 4-Wise Test Cases 10 expressions/setVNFORFVRF(ENF)ASF All Fault Types (weighted avg.) Set143.0753.5436.1163.939540.79 Set233.3351.4927.3255.3668.9731.96 Set339.3154.8130.1658.0693.7535.49 Set434.8752.8230.4662.6988.2435.55 Set550.3966.6741.6679.1796.6747.07 Average40.19455.86633.14263.84288.52638.172 Std. Deviation6.145.5085.1258.26610.1795.267

11. Experimental Results Of T-way Testing Note Using 5-Wise Test Cases 10 expressions/setVNFORFVRF(ENF)ASF All Fault Types (weighted avg.) Set147.4555.9139.2567.2197.543.97 Set238.1959.733.8462.589.6638.77 Set339.7357.0431.5758.0696.8836.69 Set442.7669.8636.3564.1894.1241.55 Set550.3970.9445.0581.2596.6750.11 Average43.70462.6937.21266.6494.96642.218 Std. Deviation4.6016.4234.687.8812.8934.653

12. Experimental Results Of T-way Testing Note Using 6-Wise Test Cases 10 expressions/setVNFORFVRF(ENF)ASF All Fault Types (weighted avg.) Set148.1855.9142.467.2197.546.44 Set241.6760.4539.3862.610043.56 Set342.0760.7436.7959.6896.8841.43 Set440.7960.5637.2965.6710042.31 Set553.5470.9448.7381.2510053.29 Average45.2561.7240.91867.28298.87645.406 Std. Deviation4.9024.9534.3777.4491.3914.29

13. Experimental Results Of T-way Testing 2-way 3-way

14. Experimental Results Of T-way Testing 4-way 5-way

15. Experimental Results Of T-way Testing

16. THANK YOU