arXiv:2610.02254v1 Announce Type: new Abstract: Interpretive Structural Modeling (ISM) is a well-known process for multi-criteria decision making. The success of ISM over other methodologies is its ability to model causal relationships, the binary scale of factors, and resulting hierarchical representation. Traditionally, the modeling process is performed by repeated interactions with subject matter experts until consensus is reached. This process is tedious, labor-intense, and most importantly limits the ability of ISM to scale to studies with hundreds of variables. Drawing on existing work of causal graph discovery with large language models (LLM) as imperfect experts, this work explores an integrated LLM-ISM approach for ISM. Pairwise, k-wise, rowwise, and full graph discovery methodologies are compared and evaluated. It is shown that causal graph discovery methods for ISM perform best using rowwise (SHD=160, F1-score=0.77) and full graph methods (SHD=135, F1-score=0.73).
Overcoming Challenges of Interpretive Structural Modeling with Large Language Models
A new arXiv paper (2610.02254v1) reports that an integrated LLM-ISM approach can replace repeated subject-matter-expert interviews in Interpretive Structural Modeling, with rowwise causal graph discovery scoring an SHD of 160 and F1-score of 0.77 and full graph discovery scoring an SHD of 135 and F1-score of 0.73. The authors compared pairwise, k-wise, rowwise, and full graph discovery methods, finding rowwise and full graph approaches perform best. The work aims to let ISM scale to studies with hundreds of variables, which traditional expert-consensus modeling cannot handle.
Run your AI side-project on zahid.host
EU-based hosting, git-push deploys, automatic HTTPS, no cold starts. Free tier with a custom domain — perfect for shipping the agent you just read about.