Unanswered Questions
2,294 questions with no upvoted or accepted answers
10
votes
0
answers
873
views
Statistical test to compare Dirichlet distributions
I want assess if two groups are statistically significantly different. I assume the data points in both groups are generated from a Dirichlet distribution - is there an appropriate test for this?
...
- 1
7
votes
0
answers
408
views
Is this popular approach to Bootstrap hypothesis testing correct?
A widely cited paper "Statistical Significance Tests for Machine Translation Evaluation" proposes usage of Bootstrap for evaluating significance of difference across systems for Machine Translation (...
- 1,298
6
votes
0
answers
1k
views
Testing difference in kurtosis between two samples
I do not know a whole lot about statistics in general and as a result I am not really sure how to go about answering this question.
I have a sample of observations that I have split into two groups ...
- 61
6
votes
0
answers
295
views
Permutation test: Exactness
I am currently reading about permutation/randomization tests and have some difficulties to understand why they are exact. More precisely, I consider two groups of random variables with means $\mu_1$ ...
- 61
5
votes
2
answers
247
views
How to include a nominal independent variable two or three times in a regression model?
So my logistic regression model aims to predict the likelihood of a severe accident (yes/no) based on the characteristics of drivers, car types and other factors. I have data which has all this ...
CommunityBot
- 1
5
votes
1
answer
123
views
Real world performance of p<0.005 compared with 0.05
Within scientific literature, there is a tentative proposal to change the significance level from p=0.05 to p=0.005
http://www.nature.com/articles/s41562-017-0189-z
I understand there is a lot of ...
- 30.4k
5
votes
0
answers
459
views
Cross model comparison of quantile regression coefficients
I am looking for a way to compare coefficients obtained from quantile regression.
The two surveyed models are nested, estimated on the same sample and for the same quantile.
$$
Y = \beta_1X+\epsilon_2\...
- 70.5k
5
votes
0
answers
1k
views
Efficient statistical test to compare two multivariate distributions
I am looking for a test to assert the "equality" of two multivariate discrete distributions, $\mathbf{A}=\{A_1,\dots,A_k\}$ and $\mathbf{B}=\{B_1,\dots,B_k\}$ for which I do observe two ...
CommunityBot
- 1
5
votes
0
answers
4k
views
Obtaining significance for variables in a linear discriminant function analysis
I have run a linear discriminant function analysis using the lda() function in the MASS library to determine which of 6 ...
- 377
5
votes
0
answers
5k
views
How to determine the significance of an interaction?
My question is simple:
How do you determine the overall significance of an interaction (i.e. the marginal effect of $X$ on $Y$ for different values of $Z$)?
But the background is a bit long-winded, ...
- 1,153
5
votes
1
answer
2k
views
Creating contrast matrix (limma) for two factorial in R
I am attempting to construct a contrast matrix that I can run in R, using the limma bioconductor package, but I am not sure that I have coded the contrast matrix correctly. A previous post and the ...
CommunityBot
- 1
5
votes
1
answer
206
views
MCMC direct comparison of difference of two parameters
Say I have run a Hierarchical Bayesian model in STAN (or JAGS or BUGS) and I have the posterior samples of two slope parameters that I want to compare: $\beta_1$ and $\beta_2$. The model appears to ...
CommunityBot
- 1
5
votes
0
answers
828
views
How to assess whether two treatments are significantly different using Cohen's d (effect size)?
Cohen's d is a measure of effect size calculated as:
$d = (x_1-x_2) / \sigma_{\text{pooled}}$
where $x_1$ is the mean of one group, $x_2$ is the mean of a second group, and $\sigma_{\text{pooled}}$ ...
- 19.4k
5
votes
1
answer
93
views
Do they use some Bayesian-frequentist amalgamate in astrophysics?
Below is a figure (highlighting is mine) from Madhusudhan et al. (2023). It caught my attention in a recent video by Becky Smethurst, where she explains some more context (but that's not necessary for ...
- 90.8k
5
votes
1
answer
1k
views
How to estimate False Discovery Rate from p-value distribution?
I have learned many models and I calculated p-values for the cross-validation errors. I want to select significant models based on the false discovery rate (FDR). How can I estimate the FDR from p-...
CommunityBot
- 1