I am trying to set down some thoughts on the relationship between the Binomial and the Poisson. The specific problem emerges from modelling data where I assume and . The specific problem is that I assume that and are correlated in some way, and have essentially been modelling this by assuming that and and that the correlation can be induced by assuming are bivariate Normal random variables. However the models don’t work the way I think they should.
So the first thing to look at is the variance of estimators of and for simple univariate samples. For the Binomial, and , so if we have then . For the Poisson, we have , and given that we have .
The interesting thing about this is what happens when you think about taking limits. One explanation for the Poisson suggests that if you let in the Binomial and take holding constant. If you do this you find that:
However, as , to hold constant then clearly in some way and so in the limit is identical. Given that I’m usually rather dismissive of asymptotics, it’s interesting to see just how quickly these two converge.
But look what happens if you consider the variance of the estimators.
- Derived from the Binomial (note that )
Well, I suppose one thing to say is that the limiting behaviour only applies where we have held constant where so perhaps it’s no surprise that there is a large discrepancy where .
But the speculation concerns the way the inferred Binomial has lower variance than the equivalent Poisson. As there is no such thing in real life as Poisson or Binomial random variables, this looks to me as if assuming one or the other has a bearing on the assumed precision of their estimators. In my modelling situation, assuming a Binomial will have a stronger influence on the model fit than assuming a Poisson.