Andyʼs working notes
About these notes
Quantum Country data analyses
Ongoing
Log: Quantum Country analysis
(archive)
Compliance changes after 2019 user journey redesign
One-shot:
2022-02-23
:
IRT parameters predict reader and question performance no better than simple recall rates
2022-02-15
:
Plots of demonstrated retention exaggerate exponential benefit of practice
2022-02-06
:
Quantum Country readers who complete first review don’t have strongly skewed in-essay accuracies
2022-01-18
:
Longer initial intervals produce much lower completion rates (among 2021 QCVC readers)
2022-01-18
:
In-essay Quantum Country question difficulties partially predict first review difficulties
2022-01-18
:
In-essay Quantum Country reader performance partially predicts first review performance
2022-01-17
:
QCVC questions are initially forgotten at very different rates
2021-11-26
:
Quantum Country’s high recall accuracy rates may mask forgetting because of cuing
2021-11-22
:
Quantum Country readers appear less likely to recover from forgetting when reviews are scheduled too late
2021-04-13
:
In-essay Quantum Country prompts boost performance on first repetition
2021-04-12
:
Retry intervention produces substantial increases in early accuracy on Quantum Country
2021-04-08
:
Quantum Country users who forget in-essay exhibit sharp forgetting curves
2021-03-25
:
Quantum Country readers forget about as many times before their first successful repetition as they do in the following half year
2021-03-25
:
95% of Quantum Country questions produce no lapses for most readers’ first half year
2021-03-25
:
After five repetitions, most Quantum Country readers reach at least 1 month of demonstrated retention for at least 95% of questions
2021-03-23
:
Accuracy rates for withheld Quantum Country questions were roughly equal at 5 days and 1 month (2020 efficacy experiment)
2021-03-22
:
Performance in-essay and in first review strongly predict a Quantum Country reader’s future performance on that question
2021-03-18
:
Half of all long-term Quantum Country lapses come from just 12% of its questions
2021-03-17
:
Withheld Quantum Country questions have highly variable accuracy rates (2020 efficacy study)
2021-03-17
:
In-essay per-question accuracies on Quantum Country don’t effectively predict which questions drive long-term lapses (but first repetition accuracies do)
2021-03-16
:
Quantum Country users rarely forget after demonstrating five-day retention
2021-03-16
:
Demonstrated retention reliably bounds future recall attempts on Quantum Country
2021-03-03
:
Quantum Country users seem to forget most prompts quite slowly
2020-03-24
:
Does studying QCVC help readers understand the subsequent Search essay?
2020-01-21
:
Shuffling questions didn’t change reader accuracy (on first two repetitions)
2019-12-14
:
In 2019H1, 29% of QCVC readers who finished the in-text level finished the 1 month level
2019-12-14
:
With each level, 2019 QCVC readers are more likely to reach the next
2019-12-14
:
It took 6+ months for 2019H1 QCVC readers to reach the 1 month level
2019-12-13
:
Quantum Country’s monthly active users steadily accumulate; retention rates are remarkably steady
2019-12-11
:
Session batching yields consistent breaks between early sessions
2019-12-10
:
(Superseded) Lapsed question accuracy remains iffy, despite retry and interval-shortening
2019-12-06
:
Quantum Country review sessions take longer than we thought because most sessions have some “slow” questions
2019-11-29
:
QCVC readers don’t have low accuracy in the first 2 questions as we had thought