Unanswered Questions
2,298 questions with no upvoted or accepted answers
25
votes
0
answers
1k
views
Is there a general expression for ancillary statistics in exponential families?
An i.i.d sample $X_1,\dots,X_n$ from a scale family with c.d.f. $F(\frac{x}{\sigma})$ has $S(X)$ as an ancillary statistic if $S(X)$ depends on the sample only through $\frac{X_1}{X_n},\cdots,\frac{X_{...
CommunityBot
- 1
12
votes
0
answers
1k
views
Why we really need the concept of "Local" Rademacher complexity?
Recently, I have been studying High-Dimensional Statistics: A Non-Asymptotic Viewpoint written by Martin J. Wainwright. In this book, the author uses a special complexity measure which is called Local ...
- 348
9
votes
0
answers
1k
views
Proof of Kolmogorov-Smirnov test
Could someone provide me a reference, preferably a book, where I can find detailed proofs and explanations of the Kolmogorov-Smirnov test (including the two-sample variant) and the derivation of the $...
9
votes
0
answers
2k
views
Taylor Series and Multivariate Delta Method
I asked this question on https://math.stackexchange.com/ but did not get any answer. Sorry for cross posting.
I'm trying to understand delta method for matrices and vectors to find the variance-...
- 84k
8
votes
0
answers
380
views
How do we call a more extreme case of fat tails than a power law?
According to Wikipedia the most extreme case of a fat tail follows a power law:
The most extreme case of a fat tail is given by a distribution whose tail decays like a power law.
That is, if the ...
CommunityBot
- 1
8
votes
0
answers
311
views
Time evolution of a Bayesian posterior
I have a question regarding the time evolution of a quantity related to a Bayesian posterior.
Suppose we have binary parameter space $\{ s_1, s_2 \}$ with prior $(p, 1-p)$,
The data generating ...
- 1,533
8
votes
0
answers
301
views
Cox's Theorem: ignorance, objective priors, and the Mind Projection Fallacy
I've been trying to understand Cox's Theorem and the problems surrounding it. There's so much information on this topic that I've become confused as to the exact state of the theorem. I've gathered ...
- 551
8
votes
0
answers
177
views
Orthogonal intersection in a Riemannian manifold
Let $S$ be the set of all probability distributions on $\mathbb{R}$ and $S_n=\{p_\theta\}$ be an $n$ dimensional submanifold of parameterized family of probability distributions on $\mathbb{R}$ where $...
- 84k
8
votes
1
answer
307
views
Finding the distribution of sample range for a Beta population
Let $X_1,X_2,\ldots,X_n$ be i.i.d random variables having density
$$f(x)=2(1-x)\mathbf1_{0<x<1}$$
I am trying to derive the distribution of the sample range $R=X_{(n)}-X_{(1)}$.
The usual way I ...
CommunityBot
- 1
7
votes
0
answers
205
views
Proof: Nearest Neighbor classifier achieves Bayes rate asymptotically on countable domains
I am trying to understand in which situations the 1-NN classifier asymptotically attains the Bayes error rate. My intuition is that if the domain is countable, then 1-NN will asymptotically do as well ...
- 356
7
votes
0
answers
77
views
Simulate correlate random variables with given marginal distribution where one is always larger
Is it possible to simulate pairs of random variables with a given marginal distribution and population correlation where one random variable is larger than the other?
More formally, I need to simulate ...
- 2,782
7
votes
0
answers
257
views
Does Fisher scoring always outperform Newton optimization?
My understanding is that Fisher scoring has several advantages over Newton raphson optimization such as
Computational efficiency: if certain conditions are met (example:During MLE estimation, if link ...
- 84k
7
votes
0
answers
158
views
Inequalities on Fisher Information / expected second derivative?
Under some regularity conditions we can compute fisher information as
$ - \mathbb{E}_{\theta_0} [\frac{\partial}{\partial \theta^2} \ln f(x;\theta_0)] $
I was wondering if there are some kind of ...
- 84k
7
votes
0
answers
495
views
Why is $X$ not an identifiable statistical model
In my textbook, Identifiablity is defined as so:
For any $\theta_1, \theta_2 \in \Theta$ , if $\theta_1 \neq \theta_2 \Rightarrow \Bbb P_{\theta_1} \neq \Bbb P_{\theta_2}$ , where $\Bbb P_{\theta}$ ...
- 84k
7
votes
0
answers
506
views
Strange connection between Bernouilli, Uniform and Geometric distributions
Final update on 11/29/2019: I have worked on this a bit more, and wrote an article summarizing all the main findings. You can read it here.
Let us consider $Z = X_1 + X_1 X_2 + X_1 X_2 X_3 +\cdots$ ...
