Whither Potential Market?

Info/Law has a nice post on fair use factor number 4 - the effect on the potential market or value of the work - and highlights some problems with the law as it stands (madness and confusion). The questions needing answering is "what markets is the fourth fair use factor concerned with?" because there are 3 different approaches that courts have taken in the last couple months alone.