Slide title In CAPITALS 50 pt Slide subtitle 32 pt Multi-component KPI:s ETSI/STQ_Mobile(08)18TD10
Top right corner for field-mark, customer or partner logotypes. See Best practice for example. Slide title 40 pt Slide subtitle 24 pt Text 24 pt Bullets level pt 2 Two different methods Method 1 “Separate” Attach, PDPcontext, FTP ... Attach, PDPcontext, FTP Method 2 “Sequence” Attach, PDPcontext, FTP ... Attach, PDPcontext, FTP New attach or PDPcontext only if lost during test
Top right corner for field-mark, customer or partner logotypes. See Best practice for example. Slide title 40 pt Slide subtitle 24 pt Text 24 pt Bullets level pt 3 Question Calculate –Attach success ratio –PDP context success ratio (when attached) –FTP download success ratio (when having PDP context) Question –Will the results for these three KPI:s be the same for both method 1 and method 2?
Top right corner for field-mark, customer or partner logotypes. See Best practice for example. Slide title 40 pt Slide subtitle 24 pt Text 24 pt Bullets level pt 4 Make some model assumptions If Attach, PDPcontext and FTP are totally statistically independent then both methods should give the same results However, it is reasonable to assume that at least the radio environment (the “radio quality”) to some extent affects each of the KPI:s Use the simplified model approach that only the radio quality affects the KPI:s Test a number of simulated radio environments and see how the KPI:s behave from a statistical point of view
Top right corner for field-mark, customer or partner logotypes. See Best practice for example. Slide title 40 pt Slide subtitle 24 pt Text 24 pt Bullets level pt 5 Simplified radio quality model Three different radio models tested –Decreasing radio quality (e.g. moving away from base) –Constant radio quality –Increasing radio quality (moving towards base) Assume starting “radio quality” gives 50% success ratio –Not realistic, but reduces simulation time –Change target radio quality over time –Use a random probability process corresponding to the current target quality for each test activity (Attach, PDP, FTP) to see if activity succeeds or not Assume that Attach and PDPcontext are relatively fast compared to the FTP time –Thus change the target radio quality only after each FTP
Top right corner for field-mark, customer or partner logotypes. See Best practice for example. Slide title 40 pt Slide subtitle 24 pt Text 24 pt Bullets level pt 6 Example radio environments Method 1 “Separate” ActionRadio quality target Attach50% PDPcont50% FTP50% Attach45% PDPcont45% FTP45% Attach40% ... Method 2 “Sequence” ActionRadio quality target Attach50% PDPcont50% FTP50% FTP45% FTP40% FTP35% ...
Top right corner for field-mark, customer or partner logotypes. See Best practice for example. Slide title 40 pt Slide subtitle 24 pt Text 24 pt Bullets level pt 7 Example radio enviroment Decresing radio quality target test sequence simulations made for each data point E.g. X=8 shows the average success ratio for test sequences were 8 FTPs are tried for each test sequence
Top right corner for field-mark, customer or partner logotypes. See Best practice for example. Slide title 40 pt Slide subtitle 24 pt Text 24 pt Bullets level pt 8 Other radio environments Increased or unchanged radio quality
Top right corner for field-mark, customer or partner logotypes. See Best practice for example. Slide title 40 pt Slide subtitle 24 pt Text 24 pt Bullets level pt 9 Conclusions The simplified model shows that the results differ between the two methods if the radio quality has a changing trend during the measurements To get the same results for both methods, at least one of the following three requirements must be satisfied –The KPI:s must be totally independent from each other (and thus also from the radio environment) –The radio environment must be constant during the measurements –The radio environment must vary so fast during the measurements that consecutive actions can be assumed to have a totally independent radio environment