Feb
17
Benford’s Law: Futility or Utility? from Rocky Humbert
February 17, 2012 |
SpecListers occasionally report on novel sightings of Benford's Law — both its utility and its futility.
The latest sighting is from a Journal of the Physics Society, where Mr. T.A. Mir at the Nuclear Research Laboratory, Astrophysical Sciences Division in Kashmir, India evidently had too much time (and yellow cake) on his hands, and set aside his quarks to ponder "The Leading Digit Distribution of the Worldwide Illicit Financial Flows." (sic)
The paper (which I didn't read because of poor grammar in the title) can be found here.
Not to be outdone by a physicist (an EXPERIMENTAL one, no less), I just ran the Benford's Law distribution on the monthly CPI data from both the USA and China for the last umpteen years.
Here's the distribution (using the leading digit to the right of the decimal point, since the digit to the left of the decimal is almost always zero hence I used my poetic license to move the decimal point one place to the right.):
China:
0: 8%
1: 19%
2: 17%
3: 21%
4: 11%
5: 14%
6: 13%
7: 15%
8: 11%
9: 14%
USA:
0: 8%
1: 19%
2: 21%
3: 15%
4: 22%
5: 17%
6: 18%
7: 19%
8: 11%
9: 12% (Percents don't equal 100 due to rounding.)
As any self-respecting THEORETICAL physicist can tell you, the appropriate Benford distribution should be
1: 30.1%
2: 17.6%
3: 12.5%
4: 9.7%
5: 7.9%
6: 6.7%
7: 5.8%
8: 5.1%
9: 4.6%
Alas, Mr. Benford lived in the universe of Natural Numbers and not the more restrictive Whole Number world, (which is a mathematically imprecise way of saying that he ain't got no zeros.) So, I'll take some liberty and add all of the zeros to the ones (since that's allowed using the core principle known as "Close Enough For Government Work." ) But even after I do that, it's not Benford-esque. It's much closer to a uniform distribution. So — there you have it: In 10 minutes on a boring afternoon, based on the inspiration of an EXPERIMENTAL nuclear physicist on the other side of the world, I just proved that both the USA and the Chinese are lying about their respective CPI's. Only one question remains: Will ZEROHEDGE pick up this startling conclusion and run with it?
Comments
3 Comments so far
Archives
- May 2013
- April 2013
- March 2013
- February 2013
- January 2013
- December 2012
- November 2012
- October 2012
- September 2012
- August 2012
- July 2012
- June 2012
- May 2012
- April 2012
- March 2012
- February 2012
- January 2012
- December 2011
- November 2011
- October 2011
- September 2011
- August 2011
- July 2011
- June 2011
- May 2011
- April 2011
- March 2011
- February 2011
- January 2011
- December 2010
- November 2010
- October 2010
- September 2010
- August 2010
- July 2010
- June 2010
- May 2010
- April 2010
- March 2010
- February 2010
- January 2010
- December 2009
- November 2009
- October 2009
- September 2009
- August 2009
- July 2009
- June 2009
- May 2009
- April 2009
- March 2009
- February 2009
- January 2009
- December 2008
- November 2008
- October 2008
- September 2008
- August 2008
- July 2008
- June 2008
- May 2008
- April 2008
- March 2008
- February 2008
- January 2008
- December 2007
- November 2007
- October 2007
- September 2007
- August 2007
- July 2007
- June 2007
- May 2007
- April 2007
- March 2007
- February 2007
- January 2007
- December 2006
- November 2006
- October 2006
- September 2006
- August 2006
- Older Archives
Resources & Links
- The Letters Prize
- Pre-2007 Victor Niederhoffer Posts
- Vic’s NYC Junto
- Reading List
- Programming in 60 Seconds
- The Objectivist Center
- Foundation for Economic Education
- Tigerchess
- Dick Sears' G.T. Index
- Pre-2007 Daily Speculations
- Laurel & Vics' Worldly Investor Articles
Dear Mr. Niederhoffer,
Greetings from Portugal. I am contacting you because I came with a foreign exchange formula. I tested it for the years 2011, 2010, 2009. It worked in all the executed simulations. If the formula is proven to be accurate is it of interest to you?
Kind regards,
Mony
E-mail: monyantunes@netcabo.pt
T: +(351)933 773 741
This is a fascinating post!
What are the implications of dropping the first zero though? it seems like on a logarithmic scale, it might still work (since Bedford’s law is supposed to work on various scales and we’re just multiplying by 10!), but I am not certain.
From your conclusion, is it possible to say in which direction they’re misrepresenting inflation?
~Adam
My understanding of Benford’s Law is that it works best when the data series spans several orders of magnitude. Although monthly CPI varies more than we would like, it is not dynamic / volatile enough for Benford’s Law to hold true.
Recommend re-performing your assessment if/when hyper-inflation sets in.
My $0.02.
-TR