No. Survey Reliability is determined by the answers on the survey
Statistical power is often used to determine the number of people (sample size) needed for your survey based on the overall population. So if you known the population of a city or a company or a school, you could determine the appropriate number of people you need to survey to have a representative sample of a population. However, statistical power does not determine whether your survey is reliability. The analysis only assumes your survey is reliability. On the other hand, Survey Reliability measure whether the answers to questions that make up your survey is reliability.
When testing Survey Reliability, Relicheck will treat all questions as positively worded. It means that questions can have internal consistent, but the analysis will show the negative question as having a large negative ITC (greater than -3.0). So, if you did not reverse cod questions before uploading the survey to Relicheck, keep in mind that questions with high negative ITC could be negatively worded/coded.
| 10:1 Ratio | 5:1 Ratio | |||
|---|---|---|---|---|
| # of Questions on survey | # of participants needed |
# of Questions on survey |
# of participants needed |
|
1 |
10 |
1 |
5 |
|
2 |
20 |
2 |
10 |
|
3 |
30 |
3 |
15 |
|
4 |
40 |
4 |
20 |
|
5 |
50 |
5 |
25 |
|
6 |
60 |
6 |
30 |
|
7 |
70 |
7 |
35 |
|
8 |
80 |
8 |
40 |
|
9 |
90 |
9 |
45 |
|
10 |
100 |
10 |
50 |
|
11 |
110 |
11 |
55 |
|
12 |
120 |
12 |
60 |
|
13 |
130 |
13 |
65 |
|
14 |
140 |
14 |
70 |
|
15 |
150 |
15 |
75 |
|
16 |
160 |
16 |
80 |
|
17 |
170 |
17 |
85 |
|
18 |
180 |
18 |
90 |
|
19 |
190 |
19 |
95 |
|
20 |
200 |
20 |
100 |
α = alpha (Cronbach Alpha)
Reliability scores range from 0 to 1.0, with 1.0 being the highest. A commonly-accepted rule of thumb is that a reliability score between .60 and.70 indicates acceptable reliability and .80 or higher indicates good reliability. High reliabilities (0.95 or higher) are not necessarily desirable, as this indicates that the questions may be entirely redundant. The goal a survey is that it is a reliable instrument for which scores on similar questions relate (internally consistent), but also for each questions to contribute some unique information as well.
Why is survey reliability important? Surveys provide critical information needed to make valuable decisions. However, not all surveys produce reliable answers. The questions on your survey may seem reasonable to answer. However, the questions may not make sense to the person taking the survey. Therefore the survey can produce non-reliable answers. It is important that the answers on your survey are reliable and provide relevant information you can use.
