University of Utrecht, The Netherlands; e-mail: M.M.Dastani@uu.nl"/> Delft University of Technology, The Netherlands; e-mail: n.yorke-smith@tudelft.nl"/> American University of Beirut, Lebanon"/>
MAP  >  The Knowledge Engineering Review
2018 Volume 33
Article Contents
Next Previous
ORIGINAL RESEARCH   Open Access    

Monitoring norms: a multi-disciplinary perspective

  • 1.

    University of Utrecht, The Netherlands; e-mail: M.M.Dastani@uu.nl

  • 2.

    DISI

  • 3.

    Delft University of Technology, The Netherlands; e-mail: n.yorke-smith@tudelft.nl

  • 4.

    American University of Beirut, Lebanon

More Information
  • Abstract: The concept of a norm is found widely across fields including artificial intelligence, biology, computer security, cultural studies, economics, law, organizational behaviour and psychology. The concept is studied with different terminology and perspectives, including individual, social, legal and philosophical. If a norm is an expected behaviour in a social setting, then this article considers how it can be determined whether an individual is adhering to this expected behaviour. We call this process monitoring, and again it is a concept known with different terminology in different fields. Monitoring of norms is foundational for processes of accountability, enforcement, regulation and sanctioning. Starting with a broad focus and narrowing to the multi-agent systems literature, this survey addresses four key questions: what is monitoring, what is monitored, who does the monitoring and how the monitoring is accomplished.
  • 加载中
  • Alberti M., Chesani F., Gavanelli M., Lamma E., Mello P., Montali M., Storari S. & Torroni P. 2006. Computational logic for run-time verification of web services choreographies: Exploiting the SOCS-SI tool. In Proceedings of the 3rd International Workshop on Web Services and Formal Methods (WS-FM'06), LNCS 4184, 58–72. Springer.

    Google Scholar

    Alberti M., Chesani F., Gavanelli M., Lamma E., Mello P. & Torroni P. 2004. The SOCS computational logic approach to the specification and verification of agent societies. In Proceedings of the International Workshop on Global Computing (GC'04), LNCS 3267, 314–339. Springer.

    Google Scholar

    Alberti M., Chesani F., Gavanelli M., Lamma E., Mello P. & Torroni P. 2008. Verifiable agent interaction in abductive logic programming: the SCIFF framework. ACM Transactions on Computational Logic 9, 29:1–29:43.

    Google Scholar

    Alberti M., Daolio D., Torroni P., Gavanelli M., Lamma E. & Mello P. 2004. Specification and verification of agent interaction protocols in a logic-based system. In Proceedings of the 19th ACM Symposium on Applied Computing (SAC'04), 72–78. ACM.

    Google Scholar

    Alberti M., Gavanelli M., Lamma E., Chesani F., Mello P. & Torroni P. 2006. Compliance verification of agent interaction: a logic-based software tool. Applied Artificial Intelligence 20, 133–157.

    Google Scholar

    Alberti M., Gavanelli M., Lamma E., Mello P., Torroni P. & Sartor G. 2006. Mapping deontic operators to abductive expectations. Computational & Mathematical Organization Theory 12, 205–225.

    Google Scholar

    Alechina N., Bassiliades N., Dastani M., Vos M. D., Logan B., Mera S., Morris-Martin A. & Schapachnik F. 2013. Computational Models for Normative Multi-Agent Systems. In (Andrighetto et al., 2013), 71–92.

    Google Scholar

    Alechina N., Dastani M. & Logan B. 2014. Norm approximation for imperfect monitors. In Proceedings of the 13th International Conference on Autonomous Agents and Multiagent Systems (AAMAS'14), 117–124. IFAAMAS.

    Google Scholar

    Alechina N., Halpern J. Y., Kash I. A. & Logan B. 2016. Decentralised norm monitoring in open multi-agent systems. In Proceedings of the 15th International Conference on Autonomous Agents and Multiagent Systems (AAMAS'16), 1399–1400. IFAAMAS.

    Google Scholar

    Alechina N., Halpern J. Y., Kash I. A. & Logan B. 2017. Incentivising monitoring in open normative systems. In Proceedings. of the 31st AAAI Conference on Artificial Intelligence (AAAI'17), 305–311. AAAI.

    Google Scholar

    Allan C., Avgustinov P., Christensen A. S., Hendren L., Kuzins S., Lhoták O., de Moor O., Sereni D., Sittampalam G. & Tibble J. 2005. Adding trace matching with free variables to AspectJ. In Proceedings of the 20th Conference on Object-oriented Programming, Systems, Languages, and Applications (OOPSLA'05), 345–364. ACM.

    Google Scholar

    Alvarez-Napagao S., Aldewereld H., Vázquez-Salceda J. & Dignum F. 2011. Normative monitoring: semantics and implementation. In Proceedings of the 6th International Workshop on Coordination, Organizations, Institutions, and Norms in Agent Systems (COIN'10), LNCS 6541, 321–336. Springer.

    Google Scholar

    An-Na’im A. A. 2011. Religious norms and family law: is it legal or normative pluralism? Emory International Law Review 25, 785–810.

    Google Scholar

    Anderson R. 2018. Making security sustainable. Communications of the ACM 61, 24–26.

    Google Scholar

    Andrighetto G., Governatori G., Noriega P. & van der Torre L. W. N. eds. 2013. Normative Multi-Agent Systems, Dagstuhl Follow-Ups 4. Schloss Dagstuhl - Leibniz-Zentrum fuer Informatik. http://drops.dagstuhl.de/opus/portals/dfu/index.php?semnr=13003

    Google Scholar

    Artikis A., Gal A., Kalogeraki V. & Weidlich M. 2014. Event recognition challenges and techniques: guest editors’ introduction. ACM Transactions on Internet Technologies 14, 1:1–1:9.

    Google Scholar

    Artikis A., Sergot M. J. & Paliouras G. 2015. An event calculus for event recognition. IEEE Transactions on Knowledge and Data Engineering 27, 895–908.

    Google Scholar

    Artikis A., Sergot M. J. & Pitt J. V. 2009. Specifying norm-governed computational societies. ACM Transactions on Computational Logic 10, 1:1–1:42.

    Google Scholar

    Axelrod R. 1986. An evolutionary approach to norms. The American Political Science Review 80, 1095–1111.

    Google Scholar

    Bacchus F. & Kabanza F. 1998. Planning for temporally extended goals. Annals of Mathematics and Artificial Intelligence 22, 5–27.

    Google Scholar

    Baier C. & Katoen J.-P. 2007. Principles of Model Checking. MIT Press.

    Google Scholar

    Balke T., Cranefield S., di Tosto G., Mahmoud S., Paolucci M., Savarimuthu B. T. R. & Verhagen H. 2013. Simulation and normas. In (Andrighetto et al., 2013), 171–189.

    Google Scholar

    Balke T., da Costa Pereira C., Dignum F., Lorini E., Rotolo A., Vasconcelos W. & Villata S. 2013. Norms in MAS: definitions and related concepts. In (Andrighetto et al., 2013), pages 1–31.

    Google Scholar

    Bauer A. & Falcone Y. 2012. Decentralised LTL monitoring. In Proceedings of the Formal Methods 2012 (FM'12), 85–100. Springer.

    Google Scholar

    Bauer A., Leucker M. & Schallhart C. 2010. Comparing LTL semantics for runtime verification. Journal of Logic and Computation 20, 651–674.

    Google Scholar

    Bauer A., Leucker M. & Schallhart C. 2011. Runtime verification for LTL and TLTL. ACM Transactions on Software Engingeering Methodologies 20, 14:1–14:64.

    Google Scholar

    Baum S. D. 2017. On the promotion of safe and socially beneficial artificial intelligence. AI & Society 32, 543–551.

    Google Scholar

    Berger J. & Hevenstone D. 2016. Norm enforcement in the city revisited: An international field experiment of altruistic punishment, norm maintenance, and broken windows. Rationality and Society 28, 299–319.

    Google Scholar

    Bicchieri C. 2006. The Grammar of Society: The Nature and Dynamics of Social Norms. Cambridge University Press.

    Google Scholar

    Bicchieri C. & Mercier H. 2014. Norms and beliefs: how change occurs. In Xenitidou and Edmonds, (2014), 37–54.

    Google Scholar

    Bicchieri C. & Muldoon R. 2014. Social norms. In The Stanford Encyclopedia of Philosophy, Zalta, E. N. (ed). https://plato.stanford.edu/cgi-bin/encyclopedia/archinfo.cgi?entry=social-norms.

    Google Scholar

    Boella G., Van Der Torre L. & Verhagen H. 2006. Introduction to normative multiagent systems. Computational and Mathematical Organization Theory 12, 71–79.

    Google Scholar

    Bragaglia S., Chesani F., Fry E., Mello P., Montali M. & Sottara D. 2011. Event condition expectation (ECE-) rules for monitoring observable systems. In Proceedings of the 5th International Conference on Rule-based Modeling and Computing on the Semantic Web (RuleML'11), LNCS 7018, 267–281. Springer.

    Google Scholar

    Bragaglia S., Chesani F., Mello P., Montali M. & Torroni P. 2012. Reactive event calculus for monitoring global computing applications. In Logic Programs, Norms and Action, LNCS 7360, 123–146. Springer.

    Google Scholar

    Bulling N., Dastani M. & Knobbout M. 2013. Monitoring norm violations in multi-agent systems. In Proceedings of the 12th International Conference on Autonomous Agents and Multiagent Systems (AAMAS'13), 491–498.

    Google Scholar

    Campenni M., Cecconi F., Andrighetto G. & Conte R. 2010. Norm and social compliance: a computational study. International Journal of Agent Technology Systems 2, 50–62.

    Google Scholar

    Castelfranchi C. 1995. Commitments: from individual intentions to groups and organizations. In Proceedings of the 1st International Conference on Multiagent Systems (Agents'95), 41–48.

    Google Scholar

    Chapman A. R. 1996. A “violations approach” for monitoring the international covenant on economic, social and cultural rights. Human Rights Quarterly 18, 23–66.

    Google Scholar

    Chesani F., Mello P., Montali M. & Torroni P. 2008. Verification of choreographies during execution using the reactive event calculus. In Proceedings of the 5th International Workshop on Web Services and Formal Methods (WS-FM'08), LNCS 5387, 55–72. Springer.

    Google Scholar

    Chesani F., Mello P., Montali M. & Torroni P. 2010. A logic-based, reactive calculus of events. Fundamenta Informaticae 105, 135–161.

    Google Scholar

    Chesani F., Mello P., Montali M. & Torroni P. 2013. Representing and monitoring social commitments using the event calculus. Autonomous Agents and Multi-Agent Systems 27, 85–130.

    Google Scholar

    Chopra A. K. & Singh M. P. 2014. The thing itself speaks: Accountability as a foundation for requirements in sociotechnical systems. In Proceedings. of the 7th International Workshop on Requirements Engineering and Law (RELAW'14), 22. IEEE.

    Google Scholar

    Clarke E., Grumberg O. & Peled D. 1999. Model Checking. MIT Press.

    Google Scholar

    Commins D. 2015. Islam in Saudi Arabia. Cornell University Press.

    Google Scholar

    Conte R., Falcone R. & Sartor G. 1999. Introduction: agents and norms: how to fill the gap? Artifical Intelligence and Law 7, 1–15.

    Google Scholar

    Cranefield S. 2006. A rule language for modelling and monitoring social expectations in multi-agent systems. In Proceedings of the 1st International Workshop on Coordination, Organizations, Institutions, and Norms in Multi-Agent Systems (COIN'05), LNCS 3913, 246–258. Springer.

    Google Scholar

    Cranefield S. & Li G. 2009. Monitoring social expectations in Second Life. In Proceedings of the 8th International Conference on Autonomous Agents and Multiagent Systems (AAMAS'09), 1303–1304.

    Google Scholar

    Cranefield S. & Winikoff M. 2011. Verifying social expectations by model checking truncated paths. Journal of Logic and Computation 21, 1217–1256.

    Google Scholar

    Dastani M., van der Torre L. & Yorke-Smith N. 2017. Commitments and interaction norms in organisations. Autonomous Agents and Multi-Agent Systems 31, 207–249.

    Google Scholar

    Davidsson P. 2001. Categories of artificial societies. In Proceedings of the 2nd International Workshop on Engineering Societies in the Agents World (ESAW'01), LNCS 2203, 1–9. Springer.

    Google Scholar

    Debar H., Dacier M. & Wespi A. 1999. Towards a taxonomy of intrusion-detection systems. Computer Networks 31, 805–822.

    Google Scholar

    Dechesne F., Di Tosto G., Dignum V. & Dignum F. 2012. No smoking here: values, norms and culture in multi-agent systems. Artificial Intelligence and Law 21, 79–107.

    Google Scholar

    Dye R. A. 1986. Optimal monitoring policies in agencies. The Rand Journal of Economics 17, 339–350.

    Google Scholar

    El-Menshawy M., Bentahar J., Kholy W. E., Yolum P. & Dssouli R. 2015. Computational logics and verification techniques of multi-agent commitments: survey. Knowledge Engineering Review 30, 564–606.

    Google Scholar

    Elster J. 2009. Social norms and the explanation of behavior. In The Oxford Handbook of Analytical Sociology, Hedström, P. & Bearman, P. (eds), 195–217. Oxford University Press.

    Google Scholar

    Esteva M., de la Cruz D. & Sierra C. 2002. ISLANDER: an electronic institutions editor. In Proceedings of the 1st International Conference on Autonomous Agents and Multiagent Systems (AAMAS'02), 1045–1052.

    Google Scholar

    Esteva M., Rosell B., Rodrguez-Aguilar J. A. & Arcos J. L. 2004. AMELI: an agent-based middleware for electronic institutions. In Proceedings of the 3rd International Conference on Autonomous Agents and Multiagent Systems (AAMAS'04), 236–243. IFAAMAS.

    Google Scholar

    Falcone Y., Mounier L., Fernandez J.-C. & Richier J.-L. 2011. Runtime enforcement monitors: composition, synthesis, and enforcement abilities. Formal Methods in System Design 38, 223–262.

    Google Scholar

    Fisher M., Bordini R. H., Hirsch B. & Torroni P. 2007. Computational logics and agents: a road map of current technologies and future trends. Computational Intelligence 23, 61–91.

    Google Scholar

    Fornara N. & Colombetti M. 2003. Defining interaction protocols using a commitment-based agent communication language. In Proceedings of the 2nd International Conference on Autonomous Agents and Multiagent Systems (AAMAS'03), 520–527.

    Google Scholar

    Fornara N. & Colombetti M. 2010. Representation and monitoring of commitments and norms using OWL. AI Communications 23, 341–356.

    Google Scholar

    Frey B. S. 1993. Does monitoring increase work effort? The rivalry with trust and loyalty. Economic Inquiry 31, 663–670.

    Google Scholar

    Gavanelli M., Alberti M. & Lamma E. 2018. Accountable protocols in abductive logic programming. ACM Transactions on Internet Technology 18, 46:1–1:20.

    Google Scholar

    Gibbs J. P. 1965. Norms: The problem of definition and classification. American Journal of Sociology 70, 586–594.

    Google Scholar

    Giblin C., Müller S. & Pfitzmann B. 2006. From regulatory policies to event monitoring rules: towards model-driven compliance automation. IBM Research Zurich, Report RZ, 3662. IBM.

    Google Scholar

    Governatori G. & Pham D. 2009. DR-CONTRACT: An architecture for e-contracts in defeasible logic. International Journal of Business Process Integration and Management 4, 187–199.

    Google Scholar

    Grefen P. W. P. J. & Widom J. 1997. Protocols for integrity constraint checking in federated databases. Distributed and Parallel Databases 5, 327–355.

    Google Scholar

    Griffin R. W. & Moorhead G. 2014. Organizational Behavior: Managing People and Organizations, 11th edition. Cengage Learning.

    Google Scholar

    Habermas J. 1985. The Theory of Communicative Action, Volume 1: Reason and the Rationalization of Society. Beacon Press.

    Google Scholar

    Havelund K. & Rosu G. 2001. Monitoring programs using rewriting. In Proceedings of the 16th Annual International Conference on Automated Software Engineering (ASE'01), 135–143.

    Google Scholar

    Haynes C., Miles S. & Luck M. 2014. Monitoring the impact of norms upon organisational performance: A simulation approach. In Proceedings of the 9th International Workshop on Coordination, Organizations, Institutions, and Norms in Agent Systems (COIN'13), LNCS 8386, 103–119. Springer.

    Google Scholar

    Helbing D. & Pournaras E. 2015. Society: build digital democracy. Nature 527, 33–34.

    Google Scholar

    Hesselius P., Johansson P. & Vikström J. 2008. Monitoring and norms in sickness insurance: empirical evidence from a natural experiment. Technical Report, 2008:8. Institute for Labour Market Policy Evaluation, Uppsala, Sweden.

    Google Scholar

    Hoffman E., McCabe K. A. & Smith V. L. 2007. Behavioral foundations of reciprocity: experimental economics and evolutionary psychology. Economic Inquiry 36, 335–352.

    Google Scholar

    Hogg M. & Vaughan G. 2014. Social Psychology, 7th edition. Pearson/Prentice Hall.

    Google Scholar

    Hollander C. D. & Wu A. S. 2011. The current state of normative agent-based systems. Journal of Artificial Societies and Social Simulation 14, 6.

    Google Scholar

    Hübner J. F., Sichman J. S. & Boissier O. 2002. MOISE+: towards a structural, functional, and deontic model for MAS organization. In Proceedings of the 1st International Conference on Autonomous Agents & Multiagent Systems (AAMAS'02), 501–502. IFAAMAS.

    Google Scholar

    Interis M. 2011. On norms: a typology with discussion. American Journal of Economics and Sociology 70, 424–438.

    Google Scholar

    Janssen M. A. & Ostrom E. 2014. Vulnerability of social norms to incomplete information. In Xenitidou and Edmonds, (2014), 161–173.

    Google Scholar

    Jennings N. R. 1993. Commitments and conventions: the foundation of coordination in multi-agent systems. Knowledge Engineering Review 8, 223–250.

    Google Scholar

    Jiang J., Dignum V., Aldewereld H., Dignum F. & Tan Y. 2013. Norm compliance checking. In Proceedings of the 12th International Conference on Autonomous Agents and Multiagent Systems (AAMAS'13), 1121–1122.

    Google Scholar

    Kafal Ö. & Torroni P. 2012. Exception diagnosis in multiagent contract executions. Annals of Mathematics and Artificial Intelligence 64, 73–107.

    Google Scholar

    Kafal Ö. & Torroni P. 2018. Comodo: collaborative monitoring of commitment delegations. Expert Systems with Applications 105, 144–158.

    Google Scholar

    Kafal Ö. & Yolum P. 2016. PISAGOR: A proactive software agent for monitoring interactions. Knowledge and Information Systems 47, 215–239.

    Google Scholar

    Kalia A. K., Nezhad H. R. M., Bartolini C. & Singh M. P. 2013. Monitoring commitments in people-driven service engagements. In Proceedings of the 10th IEEE International Conference on Services Computing (SCC'13), 160–167. IEEE.

    Google Scholar

    Kameda T., Takezawa M. & Hastie R. 2003. The logic of social sharing: An evolutionary game analysis of adaptive norm development. Personal Social Psychology Review 7, 2–19.

    Google Scholar

    Kelsen H. 1991. General Theory of Norms. Clarendon Press.

    Google Scholar

    Kemmerer R. & Vigna G. 2002. Intrusion detection: a brief history and overview. IEEE Computer 35, 27–30.

    Google Scholar

    Kirrane S., Mileo A. & Decker S. 2017. Access control and the resource description framework: a survey. Semantic Web 8, 311–352.

    Google Scholar

    Kishon A., Consel C. & Hudak P. 1991. Monitoring semantics: a formal framework for specifying, implementing and reasoning about execution monitors. In Proceedings of the 4th ACM SIGPLAN Conference on Programming Language Design and Implementation (PLDI'91), 338–352. ACM.

    Google Scholar

    Kowalski R. A. & Sergot M. J. 1985. A logic-based calculus of events. In Foundations of Knowledge Base Management (Xania Workshop 1985), 23–55. Springer.

    Google Scholar

    Lewis D. 1969. Convention: A Philosophical Study. Harvard University Press.

    Google Scholar

    Ligatti J., Bauer L. & Walker D. 2005. Edit automata: enforcement mechanisms for run-time security policies. International Journal of Information Security 4, 2–16.

    Google Scholar

    Ligatti J., Bauer L. & Walker D. 2009. Run-time enforcement of nonsafety policies. ACM Transactions on Information Systems Security 12, 19:1–19:41.

    Google Scholar

    Lorini E. & Mühlenbernd R. 2018. The long-term benefits of following fairness norms under dynamics of learning and evolution. Fundamenta Informaticae 158, 121–148.

    Google Scholar

    Luckham D. 2002. The Power of Events: An Introduction to Complex Event Processing in Distributed Enterprise Systems. Addison-Wesley.

    Google Scholar

    Ly L. T., Maggi F. M., Montali M., Rinderle-Ma S. & van der Aalst W. M. P. 2015. Compliance monitoring in business processes: functionalities, application, and tool-support. Information Systems 54, 209–234.

    Google Scholar

    Mahmoud M. A., Ahmad M. S., Yusoff M. Z. M. & Mustapha A. 2014. A review of norms and normative multiagent systems. The Scientific World Journal 2014, 684587.

    Google Scholar

    Mathis R. L. & Jackson J. H. 2010. Human Resource Management, 13th edition. Cengage Learning.

    Google Scholar

    Modgil S., Faci N., Meneguzzi F. R., Oren N., Miles S. & Luck M. 2009. A framework for monitoring agent-based normative systems. In Proceedings of the 8th International Conference on Autonomous Agents and Multiagent Systems (AAMAS'09), 153–160. IFAAMAS.

    Google Scholar

    Modgil S., Oren N., Faci N., Meneguzzi F., Miles S. & Luck M. 2015. Monitoring compliance with e-contracts and norms. Artificial Intelligence and Law 23, 161–196.

    Google Scholar

    Montali M., Chesani F., Mello P. & Torroni P. 2010. Monitoring time-aware social commitments with reactive event calculus. In Proceedings of the 20th European Meeting on Cybernetics and Systems Research (EMCSR'2010), 447–452. Austrian Society for Cybernetic Studies.

    Google Scholar

    Montali M., Pesic M., van der Aalst W. M. P., Chesani F., Mello P. & Storari S. 2010. Declarative specification and verification of service choreographiess. ACM Transactions on the Web, 4, 3:–3:62.

    Google Scholar

    Montali M., Torroni P., Chesani F., Mello P., Alberti M. & Lamma E. 2010. Abductive logic programming as an effective technology for the static verification of declarative business processes. Fundamenta Informaticae 102, 325–361.

    Google Scholar

    Morales J., López-Sánchez M., Rodrguez-Aguilar J. A., Vasconcelos W. W. & Wooldridge M. 2015. Online automated synthesis of compact normative systems. ACM Transactions on Autonomous and Adaptive Systems 10, 2:1–2:33.

    Google Scholar

    Noriega P., Chopra A. K., Fornara N., Cardoso H. L. & Singh M. P. 2013. Regulated MAS: Social Perspective. In (Andrighetto et al., 2013), 93–133.

    Google Scholar

    Oracle, Inc. 2002. Triggers and stored procedures. In Oracle Migration Workbench Reference Guide for Microsoft SQL Server and Sybase Adaptive Server Migrations Release 9.2.0 for Microsoft Windows 98/2000 and Microsoft Windows NT, chapter 3. https://docs.oracle.com/cd/B10501_01/win.920/a97248/ch3.htm.

    Google Scholar

    Ostrom E. 1990. Governing the Commons. Cambridge University Press.

    Google Scholar

    Ostrom E. 2014. Collective action and the evolution of social norms. Journal of Natural Resources Policy Research 6, 235–252.

    Google Scholar

    Panagiotidi S., Álvarez-Napagao S. & Vázquez-Salceda J. 2013. Towards the norm-aware agent: bridging the gap between deontic specifications and practical mechanisms for norm monitoring and norm-aware planning. In Proceedings of the 9th International Workshop on Coordination, Organizations, Institutions, and Norms in Agent Systems (COIN'13), LNCS 8386, 346–363. Springer.

    Google Scholar

    Pesic M. & van der Aalst W. M. P. 2006. A declarative approach for flexible business processes management. In Proceedings of the BPM'06 Workshops, LNCS 4103, 169–180. Springer.

    Google Scholar

    Pitt J., Schaumeier J. & Artikis A. 2012. Axiomatization of socio-economic principles for self-organizing institutions: concepts, experiments and challenges. ACM Transactions on Autononomous Adaptative Systems 7, 39:1–39:39.

    Google Scholar

    Robertson D. 2004. A lightweight coordination calculus for agent systems. In Proceedings of the 2nd International Workshop on Declarative Agent Languages and Technologies (DALT'04), LNCS 3476, 183–197. Springer.

    Google Scholar

    Savarimuthu B. T. R. & Cranefield S. 2011. Norm creation, spreading and emergence: a survey of simulation models of norms in multi-agent systems. Multiagent and Grid Systems 7, 21–54.

    Google Scholar

    Schneider F. B. 2000. Enforceable security policies. ACM Transactions on Information Systems Security 3, 30–50.

    Google Scholar

    Schneider F. B. 2018. Impediments with policy interventions to foster cybersecurity. Communications of the ACM 61, 36–38.

    Google Scholar

    Schnoebelen P. 2002. The complexity of temporal logic model checking. In Advances in Modal Logic, Balbiani, P., Suzuki, N.-Y., Wolter, F. & Zakharyaschev, M. (eds). World Scientific, 1–44.

    Google Scholar

    Seinen I. & Schram A. 2006. Social status and group norms: indirect reciprocity in a repeated helping experiment. European Economic Review 50, 581–602.

    Google Scholar

    Shoham Y. & Tennenholtz M. 1995. On social laws for artificial agent societies: off-line design. Artifical Intelligence 73, 231–252.

    Google Scholar

    Singh M. P. 1998. Agent communication languages: rethinking the principles. IEEE Computer 31, 40–47.

    Google Scholar

    Singh M. P. 1999. An ontology for commitments in multiagent systems. Artificial Intelligence and Law 7, 97–113.

    Google Scholar

    Singh M. P., Arrott M., Balke T., Chopra A. K., Christiaanse R., Cranefield S., Dignum F., Eynard D., Farcas E., Fornara N., Gandon F., Governatori G., Dam H. K., Hulstijn J., Krueger I., Lam H.-P., Meisinger M., Noriega P., Savarimuthu B. T. R., Tadanki K., Verhagen H. & Villata S. 2013. The Uses of Norms. In (Andrighetto et al., 2013), 191–229.

    Google Scholar

    Srour F. J. & Yorke-Smith N. 2016. Assessing maritime customs process re-engineering using agent-based simulation. In Proceedings of the 15th International Conference on Autonomous Agents and Multiagent Systems (AAMAS'16), 786–795. IFAAMAS.

    Google Scholar

    Stolz V. & Bodden E. 2006. Temporal assertions using AspectJ. Electronic Notes in Theoretical Computer Science 144, 109–124. Proceedings of the 5th International Workshop on Runtime Verification (RV'05). https://www.sciencedirect.com/science/article/pii/S1571066106003069.

    Google Scholar

    Subrahmanian V. S., Bonatti P. A., Dix J., Eiter T. R., Kraus S., Ozcan F. & Ross R. B. 2000. Heterogeneous Agent Systems. MIT Press.

    Google Scholar

    Testerink B., Bulling N. & Dastani M. 2015. Security and robustness issues in collaborative runtime verification. In Proceedings of the 11th International Workshop on Coordination, Organizations, Institutions, and Normes in Agent Systems (COIN'15@IJCAI), 376–395. Springer.

    Google Scholar

    Testerink B., Dastani M. & Meyer J. C. 2014. Norm monitoring through observation sharing. In Proceedings of the 2014 European Conference on Social Intelligence (ECSI'14), 1283, 291–304. CEUR Workshop Proceedings.

    Google Scholar

    Thati P. & Rosu G. 2005. Monitoring algorithms for metric temporal logic specifications. Electronic Notes on Theoretical Computer Science 113, 145–162.

    Google Scholar

    Torroni P., Chesani F., Mello P. & Montali M. 2009. Social commitments in time: Satisfied or compensated. In Proceedings of the 7th International Workshop on Declarative Agent Languages and Technologies (DALT'09), LNCS 5948, 228–243. Springer.

    Google Scholar

    Torroni P., Yolum P., Singh M. P., Alberti M., Chesani F., Gavanelli M., Lamma E. & Mello P. 2009. Modelling interactions via commitments and expectations. In Handbook of Research on Multi-Agent Systems: Semantics and dynamics of organizational models, Dignum, V. (ed), 263–284. Information Science Reference.

    Google Scholar

    van der Aalst W. M. P. & Pesic M. 2006. DecSerFlow: towards a truly declarative service flow language. In Proceedings of the 3rd International Workshop on Web Services and Formal Methods (WS-FM'06), LNCS 4184, 1–23. Springer.

    Google Scholar

    Vázquez-Salceda J., Aldewereld H. & Dignum F. 2004. Implementing norms in multiagent systems. In Proceedings of the 2nd German Conference on Multiagent System Technologies (MATES'04), LNCS 3187, 313–327. Springer.

    Google Scholar

    Verhagen H. 2001. Simulation of the learning of norms. Social Science Computer Review 19(3), 296–306.

    Google Scholar

    Villatoro D., Sen S. & Sabater-Mir J. 2010. Of social norms and sanctioning: a game theoretical overview. International Journal of Agent Technologies and Systems 2, 1–15.

    Google Scholar

    von Wright G. H. 1951. Deontic Logic. Mind 60, 1–15.

    Google Scholar

    Warnier M., Dechesne F. & Brazier F. 2015. Design for the Value of Privacy, 431–445. Springer.

    Google Scholar

    Westergaard M. 2011. Better algorithms for analyzing and enacting declarative workflow languages using LTL. In Proceedings of the 9th International Conference on Business Process Management (BPM'11), LNCS 6896, 83–98. Springer.

    Google Scholar

    Widom J. & Ceri S. (eds) 1994. Active Database Systems: Triggers and Rules for Advanced Database Processing. Morgan Kaufmann.

    Google Scholar

    Xenitidou M. & Edmonds B. (eds) 2014. The Complexity of Social Norms. Springer.

    Google Scholar

    Yolum P. & Singh M. P. 2002. Flexible protocol specification and execution: applying event calculus planning using commitments. In Proceedings of the 1st International Conference on Autonomous Agents and Multiagent Systems (AAMAS'02), 527–534.

    Google Scholar

    Yolum P. & Singh M. P. 2004. Reasoning about commitments in the event calculus: an approach for specifying and executing protocols. Annals of Mathematics and Artifical Intelligence 42, 227–253.

    Google Scholar

    Young H. P. 1993. The evolution of conventions. Econometrica 61, 57–84.

    Google Scholar

    Young H. P. 2014. The evolution of social norms. Economics Series Working Papers 726. University of Oxford, Department of Economics.

    Google Scholar

    Zuboff S. 2015. Big other: Surveillance capitalism and the prospects of an information civilization. Journal of Information Technology 30, 75–89.

    Google Scholar

  • Cite this article

    Mehdi Dastani, Paolo Torroni, Neil Yorke-Smith. 2018. Monitoring norms: a multi-disciplinary perspective. The Knowledge Engineering Review. 33:267 doi: 10.1017/S0269888918000267
    Mehdi Dastani, Paolo Torroni, Neil Yorke-Smith. 2018. Monitoring norms: a multi-disciplinary perspective. The Knowledge Engineering Review. 33:267 doi: 10.1017/S0269888918000267
    shu
Download PDF

Article Metrics

Article views(14) PDF downloads(192)

Other Articles By Authors

ORIGINAL RESEARCH   Open Access    

Monitoring norms: a multi-disciplinary perspective

  • 1.

    University of Utrecht, The Netherlands; e-mail: M.M.Dastani@uu.nl

  • 2.

    DISI

  • 3.

    Delft University of Technology, The Netherlands; e-mail: n.yorke-smith@tudelft.nl

  • 4.

    American University of Beirut, Lebanon

The Knowledge Engineering Review  33,  Article number: e25  (2018)  |  Cite this article

Abstract: Abstract: The concept of a norm is found widely across fields including artificial intelligence, biology, computer security, cultural studies, economics, law, organizational behaviour and psychology. The concept is studied with different terminology and perspectives, including individual, social, legal and philosophical. If a norm is an expected behaviour in a social setting, then this article considers how it can be determined whether an individual is adhering to this expected behaviour. We call this process monitoring, and again it is a concept known with different terminology in different fields. Monitoring of norms is foundational for processes of accountability, enforcement, regulation and sanctioning. Starting with a broad focus and narrowing to the multi-agent systems literature, this survey addresses four key questions: what is monitoring, what is monitored, who does the monitoring and how the monitoring is accomplished.

    HTML

    Acknowledgments

    • We thank the reviewers for their suggestions which improved the article. Thanks to C. M. Karam. NYS was partially supported by grant number 102853 from the University Research Board, American University of Beirut. NYS thanks the fellowship at St Edmund’s College, Cambridge.

    • Values from religious belief can be a source of moral norms and, in the case of some religious systems, also a source of social norms (An-Na’im, 2011). The state can enshrine these norms to the status of legal norms and monitor them (Commins, 2015).

    • On the debate about privacy, monitoring of society, and security, see Helbing and Pournaras (2015); Zuboff (2015); Warnier et al. (2015); Baum (2017); Anderson (2018); Schneider (2018).

    • www.scats.com.au

    • From https://www.inf.unibz.it/montali/tools.html#ComMon.

    • We thank an anonymous reviewer for this point.

    • See for instance opentracing.io.

    Rights and permissions
    • This is an Open Access article, distributed under the terms of the Creative Commons Attribution licence (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted re-use, distribution, and reproduction in any medium, provided the original work is properly cited.
References (144)
  • About this article
    Cite this article
    Mehdi Dastani, Paolo Torroni, Neil Yorke-Smith. 2018. Monitoring norms: a multi-disciplinary perspective. The Knowledge Engineering Review. 33:267 doi: 10.1017/S0269888918000267
    Mehdi Dastani, Paolo Torroni, Neil Yorke-Smith. 2018. Monitoring norms: a multi-disciplinary perspective. The Knowledge Engineering Review. 33:267 doi: 10.1017/S0269888918000267
    shu

    • Catalog

      Return