Prosecutors Fallacy

Two years ago, I scribbled an entry into my notebook entitled Wrong Picture, Wrong Model: Why warning signals don’t look like rare events. Months later I made some off-hand remark to Alan (my Ph.D. mentor) about how transitions found in historical records, such as the Climate examples in Dakos et. al. (2008), could actually be selecting for stochastic transitions, and this selection process might make them look like traditional warning signals – i.e. mining historical cases could actually lead to false positives rather than useful benchmarks. Alan encouraged me to demonstrate this; and when I had, to write it up. He also suggested a clever title, and with his advice the offhand remark became the recently published paper, the Prosecutor’s Fallacy, (Boettiger & Hastings, 2012).

In the review process, another question came up as to whether the stationary point (minumum of the potential) can be accurately identified successfully in this situation. Instead of some handwaving statement about things we’d tried, I was able to point to the spot in my notes where I’d this same question; a post the following day entitled Correcting for the mean dynamics. A win for open notebooks.

Most of the work for this was done over a short period of time in the prosecutor branch of my earlywarning repository, often with little more than passing reference in my notebook entries. At the beginning I didn’t think of this as a separate project, hence the lack of a separate repository, notebook tags, etc. A branch seemed like a convenient way to manage the diverging code-base. The primary scripts for the analysis presented can be found there, along with the data files:

Now that it is it’s own publication, perhaps I should move this into a separate repository?

Historical Note: A draft of this post was started on 2012-09-19 to accompany the apperance of the paper in PRSB, but never finished. As I have had occassion to revisit this project recently, I have taken the opportunity today to flush out the rest of this post, as I had intended it to be. Some links and features of the notebook may thus be newer than 2012-09-19. See the sidebar for the post revision history and modification timestamps.

References

  • C. Boettiger, A. Hastings, (2012) Early Warning Signals And The Prosecutor’S Fallacy. Proceedings of The Royal Society B: Biological Sciences 279 10.1098/rspb.2012.2085
  • V. Dakos, M. Scheffer, E. H. van Nes, V. Brovkin, V. Petoukhov, H. Held, (2008) Slowing Down as an Early Warning Signal For Abrupt Climate Change. Proceedings of The National Academy of Sciences 105 10.1073/pnas.0802430105