Message from @realz

Discord ID: 776162535798997044


2020-11-11 18:36:42 UTC  

and 6

2020-11-11 18:37:05 UTC  

lol it might even be fun to make sliders for this

2020-11-11 18:47:34 UTC  

Wow yea that's the similar distribution. Very interesting.

2020-11-11 18:51:23 UTC  

OK so basically if you have a small sigma, you will be able to "see" your distribution in the Benford's law graph

2020-11-11 18:51:24 UTC  

I made sliders

2020-11-11 18:51:34 UTC  

I guess I can just make this public for anyone to play with

2020-11-11 18:57:54 UTC  

enjoy 😄

2020-11-11 18:58:01 UTC  

just play with the slidy sliders

2020-11-11 19:01:39 UTC  

I took a class in Visual Basics probably 12-14 years ago (poorly) and that's as far as I went. So this is mind blowing to me 😆

2020-11-11 19:01:51 UTC  

ha

2020-11-11 19:02:09 UTC  

I am not an expert in this stuff, observableshq is really making me look better than I am lol

2020-11-11 19:06:26 UTC  

Sorry...I didnt play with the sliders, Its fixed but im not sure if it was only for me or if other people saw it broken

2020-11-11 19:08:30 UTC  

@evildood89 what's the issue?

2020-11-11 19:09:55 UTC  

my takeways from this are:

1. you need a high sigma (a large range of order of magnitudes) to see a Benford-looking graph.

2. you need a large number of samples to reliably reproduce a Benford-looking graph (you can even find the 1s bar lower than the 2s bar at 150 samples if you repeat the simulation over and over , at 150 samples).

3. If you play around with the numbers, you can make or break the law; the law seems to apply only to certain shapes and centerings of the normal distribution

2020-11-11 19:10:43 UTC  

No issue I was just poking around since the site seem to allow me to edit, I changed 1 value then ran it, as expected it broke but I put it back. I just wanted to apologize if it affected other users.

2020-11-11 19:11:25 UTC  

oh no it can't

2020-11-11 19:11:43 UTC  

it is not collaborative, if you change it, then it is local

2020-11-11 19:11:48 UTC  

if you save, it forks to a new copy

2020-11-11 19:12:04 UTC  

Ahh similar to github ?

2020-11-11 19:12:48 UTC  

right

2020-11-11 19:13:14 UTC  

Thats neat I like the interface on mobile :)

2020-11-11 19:19:29 UTC  

I added a regenerate button to make it easy to click fast to see the variations of the bars from simulation to simulation

2020-11-11 19:24:48 UTC  

me playing with the sliders

https://cdn.discordapp.com/attachments/771201221145919499/776165551608430682/benford-sliders.gif

2020-11-11 19:26:26 UTC  

anyway

2020-11-11 19:26:57 UTC  

I think the conclusion here is: if the variance in magnitude is low, benford's doesn't indicate anything

2020-11-11 19:27:25 UTC  

I think the conclusion here is:


1. if the variance in magnitude is low, Benford's Law doesn't say anything should be expected.
2. Though perhaps one could ask question about why the variance in magnitude is low, and how does this compare to previous elections and so on; I imagine simply looking at the political history of the districts involved etc. would answer such questions.
3. But if the variance in magnitude is high, _and_ there are enough samples, then if the shape of the graph does not follow Benford, then there is something to analyze further.
4. Even in the best case, % deviation from the expected Benford graph is not as useful as it seems, unless you factor in the number of samples (the more samples, the less expected deviation).

2020-11-11 19:32:42 UTC  

All that being said, I bet Mark Nigrini knows more than me

2020-11-11 19:32:57 UTC  

I don't think he'd disagree though

2020-11-11 19:33:03 UTC  

IIRC he did use a lot of samples

2020-11-11 19:34:59 UTC  

2 hours 👀

2020-11-11 19:39:06 UTC  

YES thank you for this.

2020-11-11 20:07:39 UTC  

@realz I think you've put this Benford's law issue to rest ... I work with numbers every day and have for many decades, generally those statistical methods are good for evaluating measurements of physical processes (temperature, wind velocity, etc.) but when you look at numbers associated with human behavior then you'll find many time statistical methods don't readily apply, just take the polling predictions versus the election results both in 2016 and 2020

2020-11-11 20:08:07 UTC  

mhm

2020-11-11 20:08:18 UTC  

that is yet another issue

2020-11-11 20:09:19 UTC  

@realz agreed, that is a separate issue than Bendfords law.

2020-11-11 20:10:13 UTC  

The reason that the first digit appears in ratios is because we have a system of numbers based in 10

2020-11-11 20:11:04 UTC  

So 1 should appear more often than other numbers. It would be different than if it was evaluating the last digit that appears.

2020-11-11 20:11:22 UTC  

I imagine that benford's law actually applies in every base