Difference between revisions of "Lesson 6 - prime directive"

From Bo3b's School for Shaderhackers
Jump to: navigation, search
m (Protected "Lesson 6 - prime directive" ([Edit=Allow only administrators] (indefinite) [Move=Allow only administrators] (indefinite)))
 
(8 intermediate revisions by one user not shown)
Line 7: Line 7:
 
<br>
 
<br>
 
<br>
 
<br>
[http://youtu.be/gR2FKk1hz4c <u>Video Walkthrough on YouTube, pt 1</u>] ...   
+
[http://youtu.be/FwaakXn13pI <u>Video Walkthrough on YouTube</u>] ...   
[http://sg.bo3b.net/Lesson%205%20pt%201.mp4 <u>Video Walkthrough direct download link, pt 1</u>]
+
[http://sg.bo3b.net/Lesson%206%20-%20prime%20directive.mp4 <u>Video Walkthrough direct download link</u>]
<br>
+
[http://youtu.be/68C5x4A81uk <u>Video Walkthrough on YouTube, pt 2</u>] ... 
+
[http://sg.bo3b.net/Lesson%205%20pt%202.mp4 <u>Video Walkthrough direct download link, pt 2</u>]
+
 
<br>
 
<br>
 
<br>
 
<br>
Line 21: Line 18:
  
 
==== Quiz====
 
==== Quiz====
Fix the water shader at the end of the game.
+
Fix the oil shader in mid-game lava room.
  
  
Line 33: Line 30:
  
 
----
 
----
We'll step back into The Ball for a minute to get a first glimpse of the 3D formula I'm calling the ''prime directive''.
+
We'll step back into The Ball for a minute to get a first glimpse of the 3D formula I'm calling the ''prime directive''&sup1;.
  
 
Let's not worry about the details yet, just see how it's applied.
 
Let's not worry about the details yet, just see how it's applied.
Line 50: Line 47:
 
[http://www.nvidia.com/content/GTC-2010/pdfs/2010_GTC2010.pdf http://www.nvidia.com/content/GTC-2010/pdfs/2010_GTC2010.pdf]
 
[http://www.nvidia.com/content/GTC-2010/pdfs/2010_GTC2010.pdf http://www.nvidia.com/content/GTC-2010/pdfs/2010_GTC2010.pdf]
  
It seems like everyone in this class is going to have a reasonably good idea for the basic principles of stereoscopy, so I'm not going to go into those basics.  It would still be worth reading this paper for a refresher and to get the terminology that NVidia uses.
 
  
[[File:Prime_directive.JPG|200px|center]]
+
* Take a look at how 3D Vision works, so that we all use NVidia's terminology.
 +
*# Starts with the basics of two offset images.
 +
*# How to think about shader rendering, including coordinate space.
 +
*# What is stereo projection, separation, convergence.
 +
*# Max separation.
  
 +
 +
It's worth reading the rest of this paper for other good tidbits, like why convergence is locked under 'advanced.'
 +
 +
 +
* Looking at the prime directive.
 +
*# Slide 49.
 +
*# Eyesign is automatically applied by driver.
 +
 +
 +
[[File:Prime_directive.JPG|200px|center]]
  
 
The ''prime directive'' from that slide: <br>
 
The ''prime directive'' from that slide: <br>
<code>clipPos.x += EyeSign * Separation * ( clipPos.w – Convergence )</code>
+
<code>
 +
 
 +
clipPos.x += EyeSign * Separation * ( clipPos.w – Convergence )
 +
 
 +
</code>
  
  
* Experiment on lava shaders.
+
* How does this translate to code: [[Canonical_Stereo_Code]]
*# Inspect and experiment on lava in PS.
+
*# In pixel shader, try changing each texld to invisible.
+
*# Those don't work, look next at the input section with interesting stereo fix.
+
*# See that v1 is an input location.
+
*# Experiment by changing v1 to null.
+
*# Fix lava by killing one texture instead of the entire shader.
+
*# optional: Fix the lava from the VertexShader output side, where v1 is created.
+
  
  
 
----
 
----
With that background, let's go back to the Lava, but fix it from the VertexShader this time.
+
With that background, let's go back to the Lava, but fix it from the VertexShader this time.  
  
The
+
In general, we can fix effects from either the VertexShader or the PixelShader, because the output of one is the input of the other.  Given a choice, we'd rather fix location problems like skybox or HUD in the VertexShader.  If we are going to disable an effect, it's better to use the PixelShader. And some complicated effects like shadows can generally only be fixed in PixelShaders.
  
  
Line 79: Line 86:
 
*# Shader hunt for the VertexShader this time. Note the non-obvious shader makes it all dark.
 
*# Shader hunt for the VertexShader this time. Note the non-obvious shader makes it all dark.
 
*# Exit out and move the found shader to ShaderOverride.
 
*# Exit out and move the found shader to ShaderOverride.
*# Edit the shader
+
*# Edit the shader, and comment out the o3 to find the problem texture.
 +
*# Edit the shader, and add our stereo correction to o3.
  
  
 
----
 
----
  
Quiz: Go to the end of the demo, and fix the broken water using the prime directive.
+
Quiz: In the middle of the demo, fix the broken oil effect using the prime directive.
  
* Fix the water shader at the last level.
+
* Fix the oil effect in the lava and bomb room.
*# Play through to the giant worm at the end, it's not far.
+
*# Play through to the lava room, it's shortly after first lava.
*# See the water has double-imaging like the water in the hall earlier.
+
*# See the oil has annoying double-imaging like the lava and fog did.
*# Find the shader for the water effect.
+
*# Find a way to apply a stereo correction, it's similar to lava.
*# Disable it. Note that it's really not good enough disabled.
+
*# Experiment with it to fix it to where it's acceptable.
+
 
*# Save a screenshot to your personal page.
 
*# Save a screenshot to your personal page.
 +
  
 
<br>
 
<br>
 +
 +
&sup1;''prime directive'' is not used by NVidia, I just made that up because it's more fun than ''stereo correction''.

Latest revision as of 01:18, 3 October 2014

Summary

Now it's time to talk about how stereo 3D is created, and the math behind it.


Level of difficulty: Easy
Time required: 30 minutes

Video Walkthrough on YouTube ... Video Walkthrough direct download link

Objective

Review and understand the principles behind stereoscopy.
Learn about the prime directive formula, and how to apply it.

Quiz

Fix the oil shader in mid-game lava room.



For effects that are important for game play, the best solution is of course to fix them, not disable them. We can fix a surprisingly large number of broken effects with different techniques that we will learn in future Lessons.

Let's start by fixing an easy one in The Ball, where there is already stereo fix code to guide us. This is the Lava effect. This will be our first actual fix, as opposed to disabling them.

As a general idea, we probably would not fix this effect, because the version with one layer disabled is perfectly acceptable. It's always worth keeping an eye on how much time a given effect is worth, because there are always more games.



We'll step back into The Ball for a minute to get a first glimpse of the 3D formula I'm calling the prime directive¹.

Let's not worry about the details yet, just see how it's applied.


  • Fix Lava effect, not just disable it.
    1. Lava in The Ball is perfectly usable now, but we noticed the Unreal fix earlier.
    2. Unreal fix did not function, but we can make it work, using HelixMod inputs.
    3. Edit shader file to use HelixMod stereo texture, instead of game based one.
    4. Fixed in 3D, not just disabling a piece of it.



The best background for how 3D works is a presentation from NVidia for GTC2010.

http://www.nvidia.com/content/GTC-2010/pdfs/2010_GTC2010.pdf


  • Take a look at how 3D Vision works, so that we all use NVidia's terminology.
    1. Starts with the basics of two offset images.
    2. How to think about shader rendering, including coordinate space.
    3. What is stereo projection, separation, convergence.
    4. Max separation.


It's worth reading the rest of this paper for other good tidbits, like why convergence is locked under 'advanced.'


  • Looking at the prime directive.
    1. Slide 49.
    2. Eyesign is automatically applied by driver.


Prime directive.JPG

The prime directive from that slide:

clipPos.x += EyeSign * Separation * ( clipPos.w – Convergence )




With that background, let's go back to the Lava, but fix it from the VertexShader this time.

In general, we can fix effects from either the VertexShader or the PixelShader, because the output of one is the input of the other. Given a choice, we'd rather fix location problems like skybox or HUD in the VertexShader. If we are going to disable an effect, it's better to use the PixelShader. And some complicated effects like shadows can generally only be fixed in PixelShaders.


  • Fix Lava effect using the prime directive.
    1. Run TheBall, and load up a Lava level.
    2. Shader hunt for the VertexShader this time. Note the non-obvious shader makes it all dark.
    3. Exit out and move the found shader to ShaderOverride.
    4. Edit the shader, and comment out the o3 to find the problem texture.
    5. Edit the shader, and add our stereo correction to o3.



Quiz: In the middle of the demo, fix the broken oil effect using the prime directive.

  • Fix the oil effect in the lava and bomb room.
    1. Play through to the lava room, it's shortly after first lava.
    2. See the oil has annoying double-imaging like the lava and fog did.
    3. Find a way to apply a stereo correction, it's similar to lava.
    4. Save a screenshot to your personal page.



¹prime directive is not used by NVidia, I just made that up because it's more fun than stereo correction.