3 Tangent SpaceObject SpaceWorld SpaceEye SpaceClip SpaceTBN MatrixModel MatrixView MatrixProjection MatrixTangent SpaceIn order to understand bump mapping it is firstly necessary to understand tangent space.Common coordinate spaces (and transforms) are as shown opposite.The view matrix converts from world space to view space, with the projection matrix converting view eye space into clip space.After clip space, coordinates undergo perspective divide and a viewport transformation, ultimately resulting in “window coordinates”.
4 Tangent SpaceTangent space is the coordinate space local to the surface of the model.For a single quad, tangent space is the coordinate space formed by the two tangent vectors along the S and T axis, and the surface normal.
5 Tangent SpaceA TBN matrix converts from object space to tangent space. It is build as:(where S and T are the tangents and N the normal).Aside: TBN is short for: Tangent, Binormal, Normal, where Binormal is another name for the tangent (sometimes known, arguably more senisbly, as a bitangent).
8 Introduction to Bump Mapping Bump mapping is a technique which adds surface ‘roughness’, improving the visual fidelity of minute surface detail which would otherwise require a large number of polygons to model.A bump map is a form of texture that holds bump information. Commonly , a bump map stores a height field (e.g. A greyscale image where the brightness of each pixel holds the intended surface height)Bump mapping techniques operate by changing how a particular pixel is lit or textured based on the view angle and the stored height information.
9 Introduction to Bump Mapping Within standard rendering, the object’s geometric surface normal is calculated for each pixel to be rendered. This normal controls how light interacts with the object (e.g. within Phong shading).A bump map can be used to calculate the surface normal of the height map, modifying the calculated normal and effecting how the pixel is lit. The height map may also be used to control which part of a diffuse texture is used to texture the pixel.
10 Introduction to Bump Mapping A range of different types of bump mapping algorithm exist.Normal mapping offers the most simple form of bump mapping technique.Parallax mapping offers a slightly more complex approach.Relief mapping (or parallax occlusion mapping) is a more complex form of parallax mapping using simple ray tracing.Displacement mapping is a more true form of bump mapping that modifies the position of vertices.Simple forms of bump mapping only perturb the surface normals. The more complex forms of bump mapping provide bumpy silhouettes and realistic shadows.
11 Normal MappingA normal map holds (in the RGB channels) the X, Y and Z coordinate tangent space normals.The normal map is used to provide a more accurate per- pixel normal when calculating the intensity of the light on that surface.This provides the illusion of considerably more fine surface detail.
12 Parallax MappingParallax mapping (also called offset mapping) extends basic normal mapping and provides more apparent depth. There are several different types of parallax mapping, including:Offset and Offset with LimitingIterative parallaxParallax occlusionReliefCone stepSteep parallaxBasic parallax mapping (offset and iterative) is a single step process which does not take into account occlusion. Later extensions incorporate iterative approaches which permit occlusion and accurate silhouette rendering. However, it is only now that such approaches are becoming feasible on current hardware.
13 Parallax MappingParallax mapping changes the texture lookup coordinates by introducing a displacement based on the tangent space viewing angle and the height space value.At steeper view-angles, the texture coordinates are displaced more, giving the illusion of depth due to parallax effects as the view changes.Basic parallax mapping looks good on any relatively large surface viewed from non- oblique angles (e.g. walls and floors). It's not good for steep edges, because of the distortion
15 Relief Mapping / Parallax Occlusion Mapping Relief mapping is one name (also including steep parallax mapping and parallax occlusion mapping) for a class of algorithms that trace rays against a height field.The basic approach is to walk along a ray which has entered the height field's volume and find the first point of intersection with the height field.
16 Relief Mapping / Parallax Occlusion Mapping Various techniques have been proposed to speed up the ray trace by taking variable step sizes.Relief mapping is capable of providing surface self- occlusion, self-shadowing, view-motion parallax and silhouettes.
20 Displacement MappingDisplacement mapping modifies the actual geometric position of points over a textured surface (typically along the surface normal).It provides self-occlusion, self- shadowing and silhouettes. However, it is also a costly mapping process as additional geometry must be introduced as part of an adaptive tessellation (increasing the number of rendered polygons) to produce a more highly detailed mesh.
22 Directed reading: Bump Mapping Read Displacement Mapping on the GPU — State of the Art – for an excellent overview of different displacement mapping techniques (bump, parallax, displacement, etc.).Read Detailed Shape Representation with Parallax Mapping – for the initial formulation of parallax mappingRead ShaderX3 - Parallax Occlusion Mapping – for the initial formulation of parallax occlusion mappingRead Displacement Mapping – for coverage of true displacement mapping
23 Directed reading: Bump Mapping For a selection of interesting papers on advanced approaches for parallax mapping read:Prism Parallax Occlusion Mapping with Accurate Silhouette GenerationReal-Time Relief Mapping on Arbitrary Polygonal SurfacesRelief Mapping of Non-Height-Field Surface DetailsDynamic Parallax Occlusion Mapping with Approximate Soft ShadowsGPU Gems 2 - Per-Pixel Displacement Mapping with Distance FunctionsGPU Gems 3 - Relaxed Cone Stepping for Relief Mapping
24 To do: Summary Read the directed reading Today we explored:Different types of bump/ displacement mapping.To do:Read the directed readingThink if you would like to provide bump / displacement mapping techniques within your project