VQEG Joint Effort Group Berlin meeting A. Bourret- K. Brunnström P. Le Callet.

Slides:



Advertisements
Similar presentations
PhUSE 2010 Unit Testing and Code Coverage Assessment with SASUnit - Key Technologies for Development of reliable SAS Macros - HMS Analytical Software.
Advertisements

Usage statistics in context - panel discussion on understanding usage, measuring success Peter Shepherd Project Director COUNTER AAP/PSP 9 February 2005.
ANNOUNCEMENTS Please any technical issues to CHANGE OF LOCATION: – Days 1 and 2 will now BOTH be held at the Washington DC.
S&I Framework Testing HL7 V2 Lab Results Interface and RI Pilot Robert Snelick National Institute of Standards and Technology June 23 rd, 2011 Contact:
International Telecommunication Union Committed to connecting the world Trondheim, 21 June ITU (International Telecommunication Union) ITU-T (Telecommunication.
Comparison of subjective test methodologies VQEG Berlin meeting June 2009 P. Le Callet, R. Pépion.
(JEG) HDR Project Boulder meeting January 2014 Phil Corriveau-Patrick Le Callet- Manish Narwaria.
XStreamer Modular Multimedia Streaming Nicolas Staelens INTEC Broadband Communication Networks.
1 ITU Workshop on “Quality of Service and Quality of Experience of Multimedia Services in Emerging Networks” (Istanbul, Turkey, 9-11 February 2015) Overview.
Video Quality IBCN. 2  Real-time Video Quality Monitoring/Testing  Monitor Probe  Virtual Wall  Video Quality Metrics  Full Length Movie.
Real-time traffic Dr. Abdulaziz Almulhem. Almulhem©20012 Agenda RT traffic characteristic RT traffic profiles RT traffic requirements RT Architecture.
Astrix Technology Group Extending The LIMS To Benefit External Stakeholder Groups Robert D. Walla Presented At Pittcon 2006 Orlando, FL.
ITU Workshop on “Quality of Service and Quality of Experience of Multimedia Services in Emerging Networks” (Istanbul, Turkey, 9-11 February 2015) Overview.
1.
Results of the ATIS/T1A1.1 Ad Hoc Group on Full-Reference Video Quality Metrics (FR-VQM) VSF Meeting October 3, 2001 John Pearson Sarnoff Corporation
1 Hybrid Bit-Stream Models (June 22-26, 2009 Berlin)
‘One Sky for Europe’ EUROCONTROL © 2002 European Organisation for the Safety of Air Navigation (EUROCONTROL) Page 1 VALIDATION DATA REPOSITORY Overview.
Visualisation and Analysis of Real Time Application Behaviour in a Simulated Network (!Temporal Databases  K. Maciunas) Evan Bourlotos Supervisors Cheryl.
NTT Confidential Test plan for evaluation of video quality models for use with stereoscopic three-dimensional television content Taichi Kawano (NTT)
” Particulates „ Characterisation of Exhaust Particulate Emissions from Road Vehicles Key Action KA2:Sustainable Mobility and Intermodality Task 2.2:Infrastructures.
1 Hybrid Bit-stream Models. 2 Hybrid bit-stream model: Type 1  Pros: Simple. All we need are open-source codecs.  Cons: May lose some available information.
1 Hybrid Bit-Stream Models (January 24-26, 2009 San Jose)
1 Hybrid Bit-Stream Models (January 25-29, Boulder)
1 Hybrid Bit-Stream Models (January 24-26, 2009 San Jose)
1 Hybrid Bit-Stream Models (September 25, 2008 Ghent) FINAL.
AGH and Lancaster University. Assess based on visibility of individual packet loss –Frame level: Frame dependency, GoP –MB level: Number of affected MBs/slices.
AGH, NTIA, Intel, IRCCyN, Opticom, Technicolor.  Wide Range of Quality ◦ Original—Heavily Compressed  VGA  60 clips  10 SRC ◦ 50% English Language.
1 JEG hybrid model Iñigo Sedano June, Three years working at Tecnalia Technology Corporation, Telecom Unit, Broadband networks group, Spain (
Towards a unique subjective experiment dataset for 3DTV – « 3DTV phase 1 » Marcus Barkowsky.
PRJ566 Project Planning & Management Work Breakdown Structure.
Video QoE and Standards Sales Training 05-Nov-2007.
Targets for project progress 2015: graduation review – clear documentation and PoC implementation specify general framework and API requirements gap analysis.
Discussion for JEG in Ghent Marcus Barkowsky. July 2013 Marcus Barkowsky - 2 -
JEG-Hybrid. JEG Full database AGH database with additional packet loss HRCs AGH database of coding conditions JEG264HMIX1.
Patient Care Coordination Domain Update Tone Southerland, Greenway Medical Technologies Laura H Langford, Intermountain Healthcare.
Proposal for a project to develop full reference media-layer objective metric for stereoscopic three-dimension video NTT Service Integration Laboratories,
VQEG HDTV Scene Pool 3 Summary Acreo Ghent University – IBBT NTIA.
1. hybrid - bitstream models VQEG Berlin Meeting June 2009 for Discussion Jens Berger, Silvio Borer.
Discussion for JEG in Singapore Marcus Barkowsky.
1 Hybrid Bit-Stream Models (June 28 – July 2, Krakow)
1 Hybrid Bit-Stream Models (September 2008 Ghent).
Joint Effort Group Ghent meeting A. Bourret P. Le Callet.
1 Hybrid Bit-Stream Models (June 28 – July 2, Krakow)
Software Testing Process
3DTV Work Group VQEG meeting Krakow 28 June – 2 July 2010.
QoE Standardization Issues QoMex September 9, 2011 Mechelen, Belgium Arthur Webster, NTIA/ITS Co-Chair of VQEG Chair of ITU-T SG9 1.
News and Miscellaneous UPO Jan Didier Contardo, Jeff Spalding 1 UPO Jan Workshop on Upgrade simulations in 2013 (Jan. 17/18) -ESP in.
1 Hybrid Bit-Stream Models (June 28 – July 2, Krakow)
NTT Confidential Test plan for evaluation of video quality models for use with stereoscopic three-dimensional television content Taichi Kawano (NTT)
1 Hybrid Bit-stream Models (Sep 2007 Ottawa). 2 Basic Ideas Using information extracted from bit- stream data, it may be possible to develop better perceptual.
Quality Assessment Recognition Tasks (QART) – Recent Results Mikołaj Leszczuk, Lucjan Janowski, Łukasz Dudek, Sergio Garcia AGH – University of Science.
Alberto Pasquini – Deep Blue Safety Assessment in MFF ASAS TN2 3-5 April 2006, Rome MENU: COVER | SUMMARY | OVERVIEW | TASKS | ALLOCATIONSCOVER SUMMARY.
Proposal for a project to develop full reference media-layer objective metric for stereoscopic three-dimension video NTT Service Integration Laboratories,
Moving from HDTV-1 to HDTV-2 VQEG agreed to use the HDTV Phase 1 test plan for the first draft of HDTV Phase 2 test plan The question for this meeting.
Hybrid Projects VQEG Rennes, June Four proponents: DT, OPTICOM, SwissQual, Yonsei Models were submitted on June 6. Next steps –Source selection.
Student Financial Assistance. Session 21-2 Session 21 Quality Analysis Tool: The Sharpest Tool in the Shed.
ELIS – Multimedia Lab Marcus Barkowsky Lucjan Janowski Glenn Van Wallendael VQEG JEG-Hybrid.
Pier Giorgio Marchetti EOP-GSR ESA UNCLASSIFIED – For Official Use Workshop Linked Open Data & OpenSearch – motivation The HMA Architecture Working.
Monitoring of Audio-Visual Quality by Key Indicators (MOAVI) Mikołaj Leszczuk, Jakub Nawała and Kais Rouis.
IMPACT OF CAMERA PIXEL COUNT AND MONITOR RESOLUTION PERCEPTUAL IMAGE QUALITY Michele A. Saad 1, Margaret H. Pinson 2, David G. Nicholas 3, Niels Van Kets.
1 Hybrid Bit-stream Models. 2 Hybrid bit-stream model: Type 1  Pros: Simple. All we need are open-source codecs.  Cons: May lose some available information.
ITU Regional Standardization Forum for Africa Livingstone, Zambia March 2016 QoS and QoE for Multimedia Services Related Work in Q14/12 Christian.
ITU Workshop on QoS and QoE of Multimedia Applications and Services Haarlem, The Netherlands 9-11 May 2016 Standards for video QoE assessment Paul Coverdale.
1 Hybrid Bit-Stream Models (January 25-29, Boulder)
Leveraging R and Shiny for Point and Click ADaM Analysis
Workshop on Distributed Embedded Systems, Lorentz Center, 21–24 Nov.05
Overview of objective assessment methodologies for multimedia services
European Commission, DG Environment, Marine Unit
Chapter PREDICTION AND ASSESSMENT OF RESOURCES
Nursing bioinformatics
Presentation transcript:

VQEG Joint Effort Group Berlin meeting A. Bourret- K. Brunnström P. Le Callet

JEG summary First scope: Hybrid NR-H264 o Profile:  At least : Stream at NAL level  Possibility to define extended profile to cover protocol level parameters (UDP, RTP, DVB, bluray …) o Level: from QCIF to HD Main goals and benefits o Joint Effort based on scientific exchange o no needs for secret database !  Common Working Dataset WD (known by contributors) to test the contributions  Possibility to present analysis based on non public dataset Goal : identify limits of contribution for further improvement  Possibility to constantly feed the database with new conditions …we can work on the database in parallel with model development Interested groups so far: o Acreo, NTIA, Ghent, Opticom, Ericsson, Tlabs, Intel, Verizon, BT, NTT

Progress First Call for evidence and contributions released Objectives of the call This meeting will initiate JEG NR hybrid H264 activities through technical presentation followed by technical discussions sessions. Topics of technical presentation should cover: o Models: architecture for NR hybrid model, approaches and results o Software: PVS generation, bitstream analyser, objective metric tools (parametric, or perceptual) o QA results o Quality assessment methodologies and set up o Use case scenarios of NR hybrid QA metrics o Source material (reference videos): creation and existing materials The following technical discussion session will cover: metric framework, software integration and subjective QA campaign.

Berlin meeting JEG Agenda Wenesday Technical presentations Technical dicussions Thursday morning Technical discussions Followed by action points

Suggested action points between meetings Use case scenarios consequently : o evidence on subjective QA methodologies o dataset: SRC collection / creation o HRC design: technology overview, first HRCs creation o First dataset o metric's building blocks and software o validation process o First call for proponents ?

Technical presentation No-Reference Dropped Frame Detector, Margaret Pinson, NTIA IPTV-Interface, Kjell Brunnström, Acreo Task-based Video Quality Update, Carolyn Ford, NTIA Coffee break xStreamer, Nicolas Staelens, Ghent University AGH and ULANCS past experience and current activities, Lucjan Janowski, AGH University of Science and Technology Krakow Lunch Source Video Sequences, Availability and Selection,, Margaret Pinson, NTIA Study of Rating Scales for Subjective Video Quality Assessment Using Single-Stimulus Presentation, Quan Huynh-Thu, Psytechnics Subjective methodologies and available datasets, Patrick Le Callet, University of Nantes, IRCCyN