No One Peer-Reviews Scientific Software
1st December 2009
Most climatology papers submitted for peer review rely on large, complex and custom-written computer programs to produce their findings. The code for these programs is never provided to peer reviewers and even if it was, the peer climatologists doing the reviewing lack the time, resources and expertise to verify that the software works as its creators claim.
Even if the peer reviewers in climatology are as honest and objective as humanly possible, they cannot honestly say that they have actually preformed a peer review to the standards of other fields like chemistry or physics which use well-understood scientific hardware. (Other fields that rely on heavily on custom-written software have the same problem.)