Image Based Lighting

Overview

Image Based Lighting is a rendering technique where complex lighting is stored in a environment map which is projected onto the scene. In simple words, a light probe or environment map is just an image on a sphere. The following figures show an unwrapped environment map in the longitude/latitude format but other unwrapping methods are popular as well:

If the range of the image colors is within some small defined range (e.g. 0..255 for monitor display), the content is only LDR (low dynamic range). With HDR (high dynamic range) content some rendering effects will become more apparent and correct (e.g. DOF, motion blur, bloom, dark materials, global illumination). The preferred graphics card representation of such images is the cubemap. Depending on the content and compression requirements, various texture formats can be useful. The following image shows the 6 sides of a cubemap with it's mip-maps (useful for blurry reflections and to reduce aliasing):

Diffuse lighting can be approximated very well by convolving an environment map (diffuse convolution) which can be stored as a cube map again. Because of bilinear filtering, the texture can be quite low resolution. Mip maps are not required and the result with mip maps can actually look worse as ordinary mip mapping on the GPU is computed for each 2x2 pixel block and 2x2 block artifacts can become noticeable.

Different Materials

The following image shows how different materials react differently to the same lighting conditions.

  1. Green diffuse, white specular, high glossiness (specular power, affects how polished the material appears).
  2. Grey diffuse, gray specular, high glossiness.
  3. Light gray diffuse, black/no specular (complete Lambert material but note that there are still shades on the part facing away from the sun).
  4. Bright gray diffuse, gray specular, medium glossiness (appears more dull).
  5. Red diffuse, red specular (even reflections are colored now, this could be even a different color), high glossiness.
  6. Dark diffuse, bright specular, high glossiness.
  7. Gray diffuse, dark specular, high glossiness.
  8. Same as 5 but additionally with a normal map.
  9. Dark diffuse, dark specular, high glossiness, normal map.

Light Contributions

The following images show IBL diffuse lighting only (top left), diffuse and IBL specular (top right) and diffuse and specular with added sun specular and diffuse (bottom).


Different Light Probes

Depending on the light probe, the lighting can be more ambient or harsh or even colored. The following images show some examples (including sun which casts shadow):