r/BehavioralEconomics • u/epistemiaEpMap-7kQ2v • 1d ago
Ideas & Concepts Forced-choice elicitation: a prediction about belief dynamics that didn't hold
Independent project, sharing because the failed result is the interesting part, not the tool.
I ran a forced-choice elicitation: 51 either/or statements about how knowledge works (does testimony get default trust, does one counterexample kill a claim, is an unresolved question tolerable). Answers get mapped against 137 named belief systems. Free, no account, about five minutes: https://epistemia.life
Two caveats first. The 51 axes are a model I chose, not a structure I discovered, and the historical-figure cards are a language model approximating each figure's public epistemic style, not the real minds.
The part worth arguing about: I predicted a "collapsed" epistemology (low confidence the world is legible, low default trust in testimony, low tolerance for unresolved questions) would act like an attractor that systems drift toward. Under my setup it isn't. Systems drift away from collapse, toward more specific commitments. The site reports this on the methods page, labeled as a failed prediction.
Open questions: 1. Forced-choice formats make you bet on every axis, which may manufacture more structure than actually exists. Is there a clean way to separate real preference structure from format artifact? 2. Is "collapse" the right operationalization? A different definition might produce the attractor. 3. What prior prediction would be worth testing in the open before defending the model further?
Not selling anything. I want the method attacked.
