Particularly in the field of Human-computer interaction and Educational technology, academic work often involves creating software systems which instantiate the researchers’ ideas. This can work well for computational ideas, but when the ideas are about interfaces, these systems are typically executed at too low a fidelity to deeply understand their impact in authentic environments (contra Effective system design requires insights drawn from serious contexts of use).
I suspect there are two reasons for this: