Terms and references

The meanings of words such as scholarly intelligence, DPIM and KAC, and the literature the Scholars’ Council for AI has consulted.

What do the words the Scholars’ Council for AI uses mean?

Scholarly intelligence

A term for the combination of the content of scholarly knowledge and the judgment that handles that knowledge.

DPIM (Decision Process Intervention Model)

A research agenda that seeks to read the observable states in the judgment process of an AI team and to learn where, and with what kind of intervention, results improve.

KAC (Knowledge Action Chain)

A research concept that deals with how knowledge leads to execution and to verified outcomes.

The four social goals

Reducing harm, the right to judgment and accountability, human capability, and gaps in access and use.

The right to judgment

A term the Scholars’ Council for AI has stated it pursues together with human dignity; it is part of the right to judgment and accountability, one of the four social goals. This goal is examined through whether decisions were actually re-examined and corrected.

Joint research

Research that can be run in a way where different roles carry forward a single process of verification.

Common context

A term for the goals, terms, evidence, constraints and current state that several participants refer to in order to carry out a task together.

Intervention

An action that helps or corrects the autonomous performance of AI. Requesting missing materials, flagging conflicting evidence or having alternatives reviewed again are examples.

Measurement validity

A question of whether an indicator appropriately captures the concept it was originally meant to measure.

Operationalization

The work of deciding through which records and indicators an abstract concept is to be observed.

What literature was consulted?

  • Rahwan, I. et al. 2019. Machine behaviour. Nature, 568, 477–486.
  • Stanford Institute for Human-Centered Artificial Intelligence. About Stanford HAI.
  • Stanford HAI. AI for Organizations Grand Challenge.
  • Shi, B., Li, H., Xie, X. and Societal AI Team. 2025. Societal AI: Research Challenges and Opportunities. Microsoft Research, MSR-TR-2025-12.
  • Lewis, P. et al. 2020. Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks. NeurIPS.
  • Yao, S. et al. 2023. ReAct: Synergizing Reasoning and Acting in Language Models. ICLR. First preprint 2022.
  • Shinn, N. et al. 2023. Reflexion: Language Agents with Verbal Reinforcement Learning. NeurIPS. Conference
  • Dafoe, A., Hughes, E., Bachrach, Y., Collins, T., McKee, K. R., Leibo, J. Z., Larson, K. and Graepel, T. 2020. Open Problems in Cooperative AI. Research agenda paper.
  • Woolley, A. W., Chabris, C. F., Pentland, A., Hashmi, N. and Malone, T. W. 2010. Evidence for a collective intelligence factor in the performance of human groups. Science, 330, 686–688.
  • Vaccaro, M., Almaatouq, A. and Malone, T. 2024. When combinations of humans and AI are useful: A systematic review and meta-analysis. Nature Human Behaviour, 8(12), 2293–2303.
  • NIST. 2023. Artificial Intelligence Risk Management Framework AI RMF 1.0. NIST AI 100-1.
  • Park, W.-W. 2000. A comprehensive empirical investigation of the relationships among variables of the groupthink model. Journal of Organizational Behavior, 21(8), 873–887. Journal
  • 나미자·김효근. 2004. 조직 구성원의 지식기여도 평가 도구 개발에 관한 연구 [A Study on the Development of an Instrument for Knowledge Contribution Assessment]. 경영정보학연구 (Information Systems Review), 6(2), 113–135.
  • Park, N. K. 2023. Research on Creative Thinking Methods for Process Innovations. 경영논집, 57, 55–69. University repository
  • Cheong, M., Spain, S. M., Yammarino, F. J. and Yun, S. 2016. Two faces of empowering leadership: Enabling and burdening. The Leadership Quarterly, 27(4), 602–616.
  • College of Business Administration at Seoul National University. Profile and research of Professor Won-Woo Park.
  • Ewha Womans University. Profile and research of Professor Hyo-Gun Kim.
  • College of Business Administration at Seoul National University. Profile of Professor Namgyoo K. Park.
  • Seoul National University. Profile of Professor Seokhwa Yun for the 2023 학술연구교육상 연구부문 [Academic Research and Education Award, Research category].
  • Shapira, N. et al. 2026. Agents of Chaos. Preprint released February 23.
  • METR. 2026. Red-Teaming OpenAI’s Internal Agent Monitoring Systems. Published October 22, updated October 29. The object of evaluation was the internal monitoring system as of July 21.
  • International AI Safety Report. 2026. International AI Safety Report 2026. Released February 3.
  • Flint, A., Aiello, L. M., Pastor-Satorras, R. and Baronchelli, A. 2026. Group size effects and collective misalignment in LLM multi-agent systems. PNAS, 123(34), e2531697123. Published online August 18.
  • Bastani, H. et al. 2025. Generative AI without guardrails can harm learning: Evidence from high school mathematics. PNAS, 122(26), e2422633122.
  • Ministry of Science and ICT · National Information Society Agency. 2026. 2025디지털정보격차 실태조사 [2025 Survey on the Digital Divide]. Results released March 26. Figures are relative levels, with the general public set at 100.
  • METR. About METR and Privacy Notice. Official name, status as a US nonprofit corporation, and research scope.
  • National Academies. Press and Media. The publisher of PNAS and its character as a multidisciplinary journal. Its official name is Proceedings of the National Academy of Sciences.
  • Max Planck Institute for Human Development. Iyad Rahwan. Researcher profile and research areas.
  • Carnegie Mellon University. Anita Williams Woolley. Organizational psychology and research on team collaboration and collective intelligence.
  • Janis, I. L. 1973. Groupthink and group dynamics: A social psychological analysis of defective policy decisions. Policy Studies Journal, 2(1), 19–25.
  • National Institute of Standards and Technology. About NIST. The institution’s affiliation and mission.