Estimation-Quantization Geometry Coding using Normal Meshes

Slides:



Advertisements
Similar presentations
Shape Compression using Spherical Geometry Images
Advertisements

Pattern Recognition and Machine Learning
Surface Compression with Geometric Bandelets Gabriel Peyré Stéphane Mallat.
Coherent Multiscale Image Processing using Quaternion Wavelets Wai Lam Chan M.S. defense Committee: Hyeokho Choi, Richard Baraniuk, Michael Orchard.
Consistent Mesh Parameterizations Peter Schröder Caltech Wim Sweldens Bell Labs Emil Praun Princeton.
Geometry Image Xianfeng Gu, Steven Gortler, Hugues Hoppe SIGGRAPH 2002 Present by Pin Ren Feb 13, 2003.
Multiscale Representations for Point Cloud Data Andrew Waters Manjari Narayan Richard Baraniuk Luke Owens Ron DeVore.
Kernel-based tracking and video patch replacement Igor Guskov
Discrete Geometry Tutorial 2 1
MATHIEU GAUTHIER PIERRE POULIN LIGUM, DEPT. I.R.O. UNIVERSITÉ DE MONTRÉAL GRAPHICS INTERFACE 2009 Preserving Sharp Edges in Geometry Images.
Multiscale Representations for Point Cloud Data Andrew Waters Manjari Narayan Richard Baraniuk Luke Owens Daniel Freeman Matt Hielsberg Guergana Petrova.
Frédéric Payan PhD Thesis Supervisor : Marc Antonini
CSE 589 Applied Algorithms Spring 1999 Image Compression Vector Quantization Nearest Neighbor Search.
1 Displaced Subdivision Surfaces Aaron Lee Princeton University Henry Moreton Nvidia Hugues Hoppe Microsoft Research.
1 Wavelets and compression Dr Mike Spann. 2 Contents Scale and image compression Signal (image) approximation/prediction – simple wavelet construction.
Application of Generalized Representations for Image Compression Application of Generalized Representations for Image Compression using Vector Quantization.
Shape Modeling International 2007 – University of Utah, School of Computing Robust Smooth Feature Extraction from Point Clouds Joel Daniels ¹ Linh Ha ¹.
Digital Days 29/6/2001 ISTORAMA: A Content-Based Image Search Engine and Hierarchical Triangulation of 3D Surfaces. Dr. Ioannis Kompatsiaris Centre for.
Visualization and graphics research group CIPIC January 30, 2003Multiresolution (ECS 289L) - Winter MAPS – Multiresolution Adaptive Parameterization.
Losslessy Compression of Multimedia Data Hao Jiang Computer Science Department Sept. 25, 2007.
Scalable Wavelet Video Coding Using Aliasing- Reduced Hierarchical Motion Compensation Xuguang Yang, Member, IEEE, and Kannan Ramchandran, Member, IEEE.
Frederic Payan, Marc Antonini
Bernd Girod: Image Compression and Graphics 1 Image Compression and Graphics: More Than a Sum of Parts? Bernd Girod Collaborators: Peter Eisert, Marcus.
1 Computation on Arbitrary Surfaces Brandon Lloyd COMP 258 October 2002.
Spectral Processing of Point-sampled Geometry
EE569 Digital Video Processing
Representation and Compression of Multi-Dimensional Piecewise Functions Dror Baron Signal Processing and Systems (SP&S) Seminar June 2009 Joint work with:
(1) A probability model respecting those covariance observations: Gaussian Maximum entropy probability distribution for a given covariance observation.
Geometry Videos Symposium on Computer Animation 2003 Hector M. Briceño Collaborators: Pedro V. Sander, Leonard McMillan, Steven Gortler, and Hugues Hoppe.
Lossy Compression Based on spatial redundancy Measure of spatial redundancy: 2D covariance Cov X (i,j)=  2 e -  (i*i+j*j) Vertical correlation   
Context-Based Adaptive Entropy Coding Xiaolin Wu McMaster University Hamilton, Ontario, Canada.
Besov Bayes Chomsky Plato Richard Baraniuk Rice University dsp.rice.edu Joint work with Hyeokho Choi Justin Romberg Mike Wakin Multiscale Geometric Image.
 Coding efficiency/Compression ratio:  The loss of information or distortion measure:
Frame by Frame Bit Allocation for Motion-Compensated Video Michael Ringenburg May 9, 2003.
Manuel Mesters - Subdivision Surfaces computer graphics & visualization Seminar Computer Graphics Geometric representation and processing: Subdivision.
Medical Image Analysis Image Enhancement Figures come from the textbook: Medical Image Analysis, by Atam P. Dhawan, IEEE Press, 2003.
Distributed Wavelet Analysis for Sensor Networks: COMPASS Update Raymond Wagner Richard Baraniuk Hyeokho Choi Shriram SarvothamVeronique Delouille COMPASS.
3D Geometry Coding using Mixture Models and the Estimation Quantization Algorithm Sridhar Lavu Masters Defense Electrical & Computer Engineering DSP GroupRice.
Semi-regular 3D mesh progressive compression and transmission based on an adaptive wavelet decomposition 21 st January 2009 Wavelet Applications in Industrial.
Adaptive Rate Control for HEVC Visual Communications and Image Processing (VCIP), 2012 IEEE Junjun Si, Siwei Ma, Xinfeng Zhang, Wen Gao 1.
UMR 5205 C. ROUDETF. DUPONTA. BASKURT Laboratoire d'InfoRmatique en Image et Systèmes d'information UMR5205 CNRS/INSA de Lyon/Université Claude Bernard.
Single Image Super-Resolution: A Benchmark Chih-Yuan Yang 1, Chao Ma 2, Ming-Hsuan Yang 1 UC Merced 1, Shanghai Jiao Tong University 2.
Spectral Compression of Mesh Geometry (Karni and Gotsman 2000) Presenter: Eric Lorimer.
1 Wavelets on Surfaces By Samson Timoner May 8, 2002 (picture from “Wavelets on Irregular Point Sets”) In partial fulfillment of the “Area Exam” doctoral.
Mesh Coarsening zhenyu shu Mesh Coarsening Large meshes are commonly used in numerous application area Modern range scanning devices are used.
Embedded Image coding using zero-trees of Wavelet Transform Authors: Harish Rajagopal Brett Buehl.
Geometric Modeling using Polygonal Meshes Lecture 3: Discrete Differential Geometry and its Application to Mesh Processing Office: South B-C Global.
Entropy Coding of Video Encoded by Compressive Sensing Yen-Ming Mark Lai, University of Maryland, College Park, MD
1 Source Coding and Compression Dr.-Ing. Khaled Shawky Hassan Room: C3-222, ext: 1204, Lecture 10 Rate-Distortion.
Global MINMAX Interframe Bit Allocation for Embedded Video Coding Michael Ringenburg Qualifying Project Presentation Advisors: Richard Ladner (CSE) and.
Image Processing Architecture, © Oleh TretiakPage 1Lecture 4 ECE-C490 Winter 2004 Image Processing Architecture Lecture 4, 1/20/2004 Principles.
3-D WAVELET BASED VIDEO CODER By Nazia Assad Vyshali S.Kumar Supervisor Dr. Rajeev Srivastava.
CASA 2006 CASA 2006 A Skinning Approach for Dynamic Mesh Compression Khaled Mamou Titus Zaharia Françoise Prêteux.
EE591f Digital Video Processing
Medical Image Analysis
Pyramid Vector Quantization
Statistical Methods Michael J. Watts
Statistical Methods Michael J. Watts
FHTW Wavelet Based Video Compression Using Long Term Memory Motion-Compensated Prediction and Context-based Adaptive Arithmetic Coding D.Marpe, H.L.Cycon,
Digital Communications Chapter 13. Source Coding
Multiscale Representations for Point Cloud Data
Directional Multiscale Modeling of Images
Burrows Wheeler Transform In Image Compression
A Brief History of 3D MESH COMPRESSION ORAL, M. ELMAS, A.A.
Context-based Data Compression
Special Topics In Scientific Computing
Wyner-Ziv Coding of Video - Towards Practical Distributed Coding -
Finite Element Surface-Based Stereo 3D Reconstruction
Wavelet-based Compression of 3D Mesh Sequences
Embedded Image Coding Based on Context Classification and
Presentation transcript:

Estimation-Quantization Geometry Coding using Normal Meshes Sridhar Lavu Hyeokho Choi Richard Baraniuk Rice University

3D Surfaces Applications Video games Animations 3D Object modeling e-commerce

3D Mesh Representation Mesh representation Problem Goal 3D scan Point clouds Polygon mesh Problem Massive data size Michelangelo’s statue of David: > billion triangles Connectivity 0 1 2 2 3 1 0 1 4 1 2 4 2 3 4 3 0 4 Geometry 0.0 0.0 0.0 1.0 0.0 0.0 1.0 1.0 0.0 0.0 1.0 0.0 0.5 0.5 1.0 Goal Compression

Multiscale Representation Regular or semi-regular meshes Connectivity  Base mesh connectivity

Wavelet Transform Prediction residuals Wavelet transform 3D coefficients (x,y,z)

Normal Meshes Normal mesh representation 3D (x,y,z)  1D normal coefficient

Wavelet Coefficients Normal wavelet coefficients Tangential wavelet coefficients Goal Model + Encode

Wavelet Coefficient Model Statistical model for normal mesh wavelet coefficients Expectation-Quantization model [Lopresto, Orchard, Ramchandran], DCC 1997 ni ~ N(0,sigmai2) sigmai2 = local variance large  rough region small  smooth region

Details Causal neighborhood Quantized coefficients Estimate sigmai2 Modified model Generalized Gaussian density Fixed shape at each scale Estimate variance for each vertex

Vertex Scanning Order Each scale Each base triangle

Vertex Neighborhood

Estimate-Quantization Steps Estimate step Shape parameter Variance parameter R-D optimized quantize step Rate = - log probability Distortion = MSE of coefficient Pick a lambda R-D operating point Entropy code Arithmetic coder

Summary

Error Metrics Different surfaces MSE Metro Original mesh surface Normal re-meshing EQ algorithm coded mesh MSE Metro “average distance between two meshes” Hausdorff distance

PSNR Plots 0.5 – 1dB gain over zero-tree coder [Guskov, Vidimce, Sweldens, Schroder], SIGGRAPH 2000 Similar results with other data sets

Conclusions 0.5 – 1dB gain Over state-of-the-art mesh zerotree coder 3D surfaces much easier to compress than 2D images Very smooth (continuous) Worst case: sharp crease Future research More appropriate distortion metrics in normal mesh wavelet domain