Guardrails for Human-AI Ecologies: Norm-Based Coordination and Design for Predictability
Journal
MIS Quarterly
ISSN
0276-7783
Type
journal article
Date Issued
2025-12
Author(s)
Abstract
Human-AI ecologies involve human and artificial intelligence (AI) based agents that coordinate their interactions in part by following social norms. Social norms, therefore, are important for establishing the guardrails that ensure desirable interactions in a way that is consistent with essential values, such as human safety. Managing human-AI ecologies, therefore, requires specifying norms to enable coordination in known situations, but also allowing for the emergence of norms to enable coordination in unspecified, unstructured situations. We integrate predictive processing theory and social norm theory to explain how existing norms are enacted and reinforced based on agents’ predictive models and how new norms emerge as agents update their predictive models in response to prediction errors in uncertain coordination scenarios. Rooted in this perspective, we develop a design theory that emphasizes design for predictability and propose a set of design principles for managers and developers to encode norms to evolve in human-AI ecologies, monitor outcomes, and intervene when necessary.
HSG Classification
contribution to scientific community
Refereed
Yes
Volume
49
Number
4
Division(s)
File(s)![Thumbnail Image]()
Name
FL_10.25300_MISQ_2025_18058.pdf
Size
875.62 KB
Format
Adobe PDF
Checksum (MD5)
264cb9c0b09fd76a1855466c66a27bb6