Data | Window estimates | Set the alarm threshold for your bank | Monitor | Act, and record why | What does drift do to scores?
Package: driftwatch 0.1.0
Daniel Edi
driftwatch: Sequential Monitoring of Item Parameter Drift
Ongoing surveillance of item parameter drift for continuous testing programs and pre-equated item banks. Estimates item difficulty in rolling calibration windows, runs sequential cumulative sum (CUSUM) detection (Page, 1954, <doi:10.1093/biomet/41.1-2.100>; applied to testing by Veerkamp and Glas, 2000, <doi:10.3102/10769986025004373>) with change-point estimation, separates gradual drift from abrupt jumps, tunes alarm thresholds for a bank-wide false-alarm target by simulation on the program's own design, quantifies score and pass-rate impact, and records recommended actions in an audit log.
Authors:
driftwatch_0.1.0.tar.gz
driftwatch_0.1.0.zip(r-4.7-any)driftwatch_0.1.0.zip(r-4.6-any)driftwatch_0.1.0.zip(r-4.5-any)
driftwatch_0.1.0.tgz(r-4.6-any)driftwatch_0.1.0.tgz(r-4.5-any)
driftwatch_0.1.0.tar.gz(r-4.7-any)driftwatch_0.1.0.tar.gz(r-4.6-any)
driftwatch_0.1.0.tgz(r-4.6-emscripten)
manual.pdf |manual.html✨
DESCRIPTION |NEWS
card.svg |card.png
driftwatch/json (API)
| # Install 'driftwatch' in R: |
| install.packages('driftwatch', repos = c('https://edidatasolutions.r-universe.dev', 'https://cloud.r-project.org')) |
Bug tracker:https://github.com/edidatasolutions/driftwatch/issues
Pkgdown/docs site:https://edidatasolutions.github.io
Last updated from:e8bc84f2aa. Checks:9 OK. Indexed: yes.
| Target | Result | Time | Files | Syslog |
|---|---|---|---|---|
| linux-devel | OK | 99 | ||
| source / vignettes | OK | 152 | ||
| linux-release | OK | 88 | ||
| macos-release | OK | 118 | ||
| macos-oldrel | OK | 91 | ||
| windows-devel | OK | 72 | ||
| windows-release | OK | 56 | ||
| windows-oldrel | OK | 64 | ||
| wasm-release | OK | 89 |
Exports:dw_actionsdw_estimatedw_impactdw_monitordw_simulatedw_tunedw_twopoint
Dependencies:
Readme and manuals
Help Manual
| Help page | Topics |
|---|---|
| Recommended actions and audit log | dw_actions |
| Window-level item difficulty estimates | dw_estimate |
| Score and pass-rate impact of drifted items | dw_impact |
| Sequential drift monitoring | dw_monitor |
| Simulate a continuously administered item bank with known drift | dw_simulate |
| Tune the alarm threshold for a bank-wide false-alarm target | dw_tune |
| Two-point drift check (the conventional baseline) | dw_twopoint |