Abstract
The Kanger-Lindahl theory of normative positions has great potential of serving as a logical foundation for normative systems for MAS, and its generality allows for great freedom when interpreting the theory. As a first step towards a typology of interpretations of the theory, the application of normative positions is studied in the context of a class of transition systems in which transitions are deterministic and associated with a single agent performing an act. By an interpretation of different types of normative positions in terms of permitting or prohibiting different state transition types in this context, lexicons for two different systems of types of normative positions are suggested and discussed. It is demonstrated that both interpretations are useful foundations for normative systems semantics in a MAS context.
Introduction
The study of norm-regulated multi-agent systems, often referred to as normative MAS, covers the formal representation and implementation of normative systems as well as applications. The ‘normative MAS roadmap’ [1] is a comprehensive introduction to and overview of the field. In many systems, the actions of an individual agent are naturally associated with transitions between different states of the system. As a consequence, the permission or prohibition of a specific action in such a system is connected to permissible or prohibited transitions between states of the system, and norms may then be formulated as restrictions on states and state transitions. Many approaches to normative systems are algebraic or based on modal logics, like temporal or deontic logic [5,6,8,27,29,31,33,34].
The Kanger-Lindahl theory of normative positions is well suited as the logical foundation for normative systems in a MAS context, since the types of normative positions are mutually exclusive and jointly exhaustive in the logical sense. From a theoretical point of view, the weak underlying assumptions makes the theory elegant and general, something which allows for great freedom when interpreting the theory. On the other hand, this may become a challenge for practical applications. The notion of agency, for example, can be understood in many quite different ways within the theory. Therefore, a kind of typology of interpretations of the theory of normative positions might be useful. This work may serve as a first step towards such a typology, by investigating how to apply the theory of one-agent normative positions in the context of a class of transition systems, in which transitions are deterministic and associated with a single agent performing an act. To study this class of systems, the notion of norm-regulated transition system situations [13,14] will be employed. Here, the permission or prohibition of actions is connected to the permission or prohibition of different types (with respect to some condition on a number of agents in a state) of state transitions. By interpreting two different extended systems of one-agent types of normative positions in terms of permitting or prohibiting different transition types, a semantics for each of these extended systems in the context of norm-regulated transition system situations will be obtained.
The paper is structured as follows. Section 1.1 gives a brief introduction to the theory of normative positions, Section 1.2 presents an algebraic approach to normative systems, and Section 1.3 presents related work, in particular an extended system of normative positions suggested by Jones and Sergot. In Section 1.4, the notion of norm-regulated transition system situations is presented, and an application to be used as a running example is introduced. Section 2, the main contribution, discusses how to map Jones and Sergot’s extended system of normative positions, as well as another extension based on an observation by Odelstad, to the set of transition type prohibition operators within norm-regulated transition system situations. Section 3 briefly discusses possible applications, and Section 5 concludes and gives some ideas for future work.
One-agent types of normative positions
One-agent types of normative positions
One-agent types of normative positions
The Kanger-Lindahl theory of normative positions is based on Kanger’s ‘deontic action-logic’; see for example [19]. The theory, further developed by Lindahl in [21], contains three systems of types of normative positions. The simplest of these systems is a system of seven ‘one-agent types’ of normative positions, based on the logic of the action operator
Each of the three statements (i)
Some further extensions of the systems of normative positions have been suggested by Jones and Sergot; see Section 1.3.1. They have explored some applications of the theory within computer science, and discussed some of its limitations in this setting.
In a series of papers, Lindahl and Odelstad have combined the theory of normative positions with an algebraic approach to normative systems. The reader is referred to [24] for a comprehensive summary. Their idea is to use the one-agent types of normative positions as operators on descriptive conditions to get deontic conditions. A ν-ary condition d can be true or false of ν agents
The free variables in
A number of different ways of classifying norms and normative systems are discussed in [2]. It is argued that when characterizing norms in MAS one should take into account the rule structure of norms, i.e., that norms usually have a conditional structure, as well as different types of norms, and other basic features of normative systems such as norm recognition and hierarchies, norm application, and norm change. Furthermore, three different definitions of normative MAS are given, as well as a number of guidelines for developing normative MAS. The first guideline, for example, is to motivate which definition is used and explain the choices made regarding the representation of norms in the system. It is noted in [2] that an attempt to address this guideline requires the clarification of the types of norms that may occur in normative systems.
A common simple classification of norms is into two broad categories, constitutive norms and behavioral norms. Norms in the former class specify, for example, the meaning of different kinds of communicative acts within a given institution, or the definitions of what kind of acts are meaningful in a certain context. Norms of the latter kind regulate behavior, by somehow specifying which actions are permitted, prohibited or even obligatory. Such norms may be further classified according to the ‘level’ on which they are effective; whether the system is viewed from the point of view of a system designer or an individual agent. See for example [6, p. 217f] or [31, Section 4]. As Sergot puts it, system norms …express a system designer’s point of view of what system states and transitions are legal, permitted, desirable, and so on. There is a separate category of individual agent-specific norms that are intended to guide an individual agent’s behaviors and are supposed to be taken into account in the agent’s implementation, or reasoning processes, in one way or another. These have a different character. [31, p. 16]
A common feature of many approaches to the representation of norms and normative systems is the idea to partition states and (possibly) transitions into two categories, for example ‘permitted’ and ‘non-permitted’. This may be accomplished with the use of if-then-else rules or constraints on the states and/or the transitions between states. The ‘agent-stranded transition systems’ framework by Craven and Sergot [5,31], the Ballroom system in [6] and the anticipatory system for plot development guidance in [20] serve as examples of this approach. Some approaches are purely algebraic or based on modal logics, for example temporal or deontic logic. Dynamic deontic logic [27] and Dynamic logic of permission [33] are two well-known examples of the modal logic approach. Other examples are the combination of temporalized agency and temporalized normative positions [8], in the setting of Defeasible logic, and Input/Output logic (see for example [26]). A more extensive account of related work on norm representation can be found in [14].
The only assumption made by Kanger regarding the logic for the action operator
An extended set of types of normative positions
Table 2 in [32]
Table 2 in [32]
Jones and Sergot [17,30,32] have generalized and further developed the Kanger-Lindahl theory of normative positions. Using a method suitable for automation, they perform a similar analysis as Lindahl. First, a set of ‘act positions’
is generated from the scheme
Note that italic P with indices is used in Section 1.4 to denote transition type prohibition operators on conditions.
If Q and R represent sets of expressions,
This is a reiteration of Table 2 in [32, p. 375], using x instead of a to denote an agent. Note that
According to [30], Lindahl’s
The notion of a norm-regulated transition system situation was originally presented in [13]. A transition system situation is intended to represent, for example, a ‘snapshot’ of a labelled transition system (LTS) in which each transition fulfills these criteria.
The algebraic representation of conditional norms is based on a systematic exploration of the possible types, with respect to some state of affairs
Now consider the transition from a state s to the following state
Basic transition types
Basic transition types
The situation part
The extra argument
The idea of assigning to state transitions different types (with regard to some state of affairs) lies behind the
A norm-regulated transition system situation is represented by an ordered pair
That is,
The set of operators
Table 1 in [13].
Table 1 in [13]: Possible combinations of basic transition types
A number of example systems, intended to illustrate how to use the notion of norm-regulated transition system situations for developing norm-regulated MAS, will be briefly presented in Section 3. To be able to focus on a single situation, a somewhat simpler example, without the dynamics of a full-fledged multi-agent system, will be constructed here. Although, admittedly, an oversimplification in many ways, the example is intended to capture some of the flavour of the ‘Ownership of an estate’ example employed in [24, Section 4.4.1]. Imagine a tiny world consisting of two neighboring estates, Whiteacre (numbered 1) and Blackacre (2). The world is populated by the three agents Alice, Bob and Charlie, and each estate is owned by one of these agents. Furthermore, each estate contains a main building that can be painted white (W) or black (B), and can be surrounded by a fence.9
In the original example, each estate may also contain cows belonging to the estate itself, and possibly also stray cows from the neighbouring estate. This aspect of the example is not modelled here.
Let
One of the agents may now be selected as the acting agent, to form a transition system situation
An adapted version of the normative system suggested in [24, Section 4.4.1], which is based on the types of normative positions in Section 1.1, will now be created:
Here,
To exemplify,
Note the subtle difference between the formulation of the condition
A first approach
There are 15 conjunctions in Jones-Sergot’s set of ‘normative act positions’ (see Section 1.3.1), and also 15 rows in Table 4 (disregarding the last row that prohibits all state transitions). Therefore, a natural interpretation of
See, e.g., [18]. For a further discussion of different ways of understanding the agency operator
Again,
In order to adhere to the notation in [13], F is represented by
It can be argued that the interpretation suggested here is both simple and fairly intuitive. One way of understanding the theory of normative positions in the context of norm-regulated transition system situations has thus been found. So why not settle for this?
Table 2 in [13]: Meaningful combinations of prohibited state transition types
The answer may be a matter of different perspectives of behavioral norms and normative systems. If, for example, one is interested in formulating system norms (i.e., norms which express a system designer’s point of view of legal/permitted/desirable states and transitions; see Section 1.3), then one could argue that the suggested understanding of normative act positions within the context of norm-regulated transition system situations is reasonable. Again considering
Table 2 in [13].
Possible interpretation of Jones-Sergot’s normative act positions (my indexation of type names)
Possible interpretation of Jones-Sergot’s normative act positions (my indexation of type names)
In the previous section, it was argued that under the interpretation of
So, the question remains whether or not it is possible to find a mapping between the set of nine transition type prohibition operators from Section 1.4 and Lindahl’s set of seven types of one-agent normative positions, which is both suitable as the basis for formulating agent-specific norms and consistent with Lindahl’s example. One attempt in this direction follows from an observation in [28], where Odelstad defines three operators
Here,
A natural understanding of the statement ‘x does not see to it that F and does not see to it that not F’ is that it expresses x’s passivity with regard to a state of affairs F, in the sense that the presence or absence of the agent does not affect the truth of F. In the norm-regulated transition system situation context, this corresponds to a behavior such that x leaves F as it is, no matter if F is true or false; in other words to a behavior characterized by the transition types I and The consistent pairs of (I)–(IV) correspond to
An extended set of types of normative positions
An extended set of types of normative positions is now constructed. It is based on the idea that
Now, relying on the tautologies
the set of extended types shown in Table 7 is obtained. As an example, consider
In the terminology of [21, p. 92],
Note that
A reduced extended set of types of normative positions
The motivation for defining the extended set of types of normative positions was to investigate the possibility of finding a mapping between the nine transition type prohibition operators from Section 1.4 and the types of one-agent normative positions. Lindahl’s original set of types of normative positions contains seven types, which is ‘too few’ in relation to the nine transition type prohibition operators. The extended set of types, on the other hand, contains ‘too many’ types, viz. 15. Therefore the following additional assumptions are made, again with the
With inconsistent types removed, the equivalences and symmetries stated in the previous subsection for the extended set of types of normative positions still hold. Again, there are four basic one-agent liberty types:

Hasse diagram for the ‘less free than’ relation.
Transition type conditions for reduced extended types
A Hasse diagram for the relation ‘less free than’ on this system of types is shown in Fig. 1. To investigate how the set of transition type operators (see Section 1.4) can form a semantics for this system, the following principles are first assumed: For all
These principles are now applied to each of the types in Table 8. Let
[
[
[
Similar arguments can be made for the remaining types. (See [12] for the details.) With appropriate renaming of the
The use of the algebraic representation of norms by Lindahl and Odelstad, briefly introduced in Section 1.2, requires the definition of condition-implication structures (cis’es) which are based on Boolean quasiorderings on descriptive and deontic conditions. The first step is to use the extended types of normative positions as operators on descriptive conditions to obtain deontic conditions. Suppose, for example, that d is a binary condition. Then
In a procedure similar to the one described in [24, Section 4.4], an ‘extended normative position cis’, np15-cis for short, is constructed such that it fulfils the requirements in the extended theory of one-agent normative positions. Let
An np15-cis over a cis if if
The first three requirements in the definition express restrictions on the relation R in an np15-algebra. They correspond to three features of extended one-agent types, viz. that the types are mutually incompatible, jointly exhaustive, and that some types are the converses of others and some are neutral. Requirements 4–6 follow from the logic of
A ‘reduced extended normative position cis’, or np9-cis, is then constructed. Let B be a set of descriptive conditions
An np9-cis over a cis if if
The algebraic representation of normative systems discussed here, together with the interpretation in terms of prohibited transition types, is intended as a generic and useful tool for the development of normative MAS. Clearly, the rule structure of norms is deeply embedded in this framework, but many of the other design choices mentioned in the ‘normative MAS roadmap’ (see Section 1.3) cannot be addressed at the level of the framework itself; it is up to the developer who uses the framework to address the different guidelines, motivate which definition of normative MAS is used, etc.
A normative system for the agents in the Estates world in Section 1.4.1 may now be formulated. Taking the ‘agent-specific norms’ perspective, the approach in Section 2.2 is adopted. For two of the types,

Screenshot from the Estates application.
Now recall the specific situation
The notation ‘
An instrumentalization of the Estates example in Section 1.4.1 and 2.2.2 has been developed, using the general-level Java/Prolog-framework from [16] with later extensions. The Estates application demonstrates how the framework handles non-elementary norms, i.e., norms whose grounds and/or consequences are boolean combinations of simpler conditions. Furthermore, by varying the different parameters, one can use the application to experiment with a large number of specific situations for the Estates world, to get an idea of how well the instrumentalized normative system captures the intention behind the system described by Lindahl and Odelstad in [24]. The screenshot in Fig. 2 shows the result of querying the system about the permissible acts (according to the normative system described in the previous section) for the acting agent Alice in the state
Assuming instead that Bob is the acting agent in the same system state, which actions are permitted for him? Selecting Bob as the acting agent and querying the system for permissible actions, gives the somewhat surprising answer that n and
A number of other applications that demonstrate the iterated use of norm-regulated transition system situations are presented in [14, Section 2.3]. The
Another application is shown in [15], where an evolutionary algorithm is used to evolve the ‘best possible’ normative systems for a class of problem-solving
The source code for the example systems mentioned here, as well as for the general-level Java/Prolog implementation of norm-regulated transition system situations, is available for download16
In the Estates application discussed in the previous section, the agent Bob was allowed to paint the main building on Whiteacre white, even though he was not the owner of this estate. This was due to the coarseness of the model: painting the building white did not change its color (since it was already white) and the normative condition in effect in the specific situation only stated that the acting agent should leave the color of the building unchanged. One may assume that the intention behind the normative system goes beyond just making sure that none other than the owner may change the color of a building; it is also to prohibit an agent from entering an other agent’s property and raising scaffolds for painting, and so on. The simple model employed here is, however, not able to capture these details. In this and many other similar domains, an obvious solution is to increase the level of granularity of the model, which in turn probably requires a more fine-grained normative system. This is probably the best solution in most cases. In some scenarios, another possibility could simply be to exclude the action ‘paint the main building on Whiteacre white’ from the set of feasible actions in all situations where the building is already white. Yet another approach could be to reformulate the normative system to explicitly prohibit individual named actions in certain situations. The normative framework discussed here does not have special treatment of such norms, with explicit support for normative consequences prohibiting named actions, but as suggested in [14, p. 92] this effect may be accomplished by incorporating into the state of the world a history of performed actions, and stating norms that prohibit the last action performed to be the undesired action. A drawback of this approach is that adding more actions (e.g., ‘paint the main building on Blackacre white’, and ‘paint the main building on Blackacre black’) to the model, requires adding more norms to the normative system. One of the features of the Lindahl-Odelstad algebraic approach to norms is precisely that it makes possible the formulation of norms which do not explicitly refer to named actions. A clear separation between norms and actions allows for the specification of the normative system to be, at least to some extent, logically analyzed and modified independently of the set of available actions.
The discussion above raises more general questions regarding the expressive power of this approach to norms. It is certainly possible to construct real-world examples that are difficult or impossible to model within this approach, but one should keep in mind that the aim of the cis model (which is the basis of the Lindahl-Odelstad algebraic approach to normative systems) was not intended as the one and only treatment of normative systems. Despite the expressive power of this approach, it still has its limitations. It is argued in [14] that one of its features is that it takes into account the idea that normative systems should express general rules where no individual names occur. The normative system correlates generic antecedents with generic normative consequents, and is combined with a mechanism to instantiate those generic antecedents and consequents. In a complex normative system, however, norms are general, with cross-references between variables in antecedents and consequents. It is noted by [23, p. 230] that the cis model has limitations, compared with predicate logic, if the primary aim is to provide an overall representation of such a complex normative system. For example, the cis model has trouble representing norms which explicitly permit certain actions, even though performing the action would lead to an ‘illegal’ system state. However, in many (if not most) cases this could probably be handled by a more careful specification of the antecedents of the norms in the system.
Another kind of norms that may occur in real-world applications is norms with deontic operators in the antecedent of norms; see, e.g., [7]. The version of the normative framework discussed here does not deal with such norms, but it should be noted that the cis model approach to norms, being an application of the general theory of joining-systems (TJS; see Section 1.2), is well suited for extension in this direction. The development of TJS was motivated by, among other things, the interest by Lindahl and Odelstad for so-called intermediate legal concepts,17
In TJS, the technical notion representing an intermediate concept is called an intervenient. Typical examples of intermediates are ownership (“being the owner of”) and citizenship (“being a citizen”).
It is sometimes argued that standard deontic logic operators used in the analysis of the normative positions are useful for static systems, but not for dynamic (transition) systems. For example, the distinction between achievement and maintenance obligations (see, e.g., [7] with references) may be challenging. The former kind of norms prescribes that its content must hold at least once during a specified time interval, e.g., that an action is to be performed before a deadline, while the latter is an obligation that its content hold for every instant during the time interval in which the normative consequence is in force. Two other (interrelated) kinds of norms that seem to occur in real-world scenarios are so-called contrary-to-duty obligations and compensatory obligations. A contrary-to-duty obligation, for example, states that an obligation (or prohibition) is in force when the opposite of an obligation (resp., prohibition) holds [7, p. 66]. How the cis model approach to normative systems can handle these specific kinds of norms remains to be thoroughly investigated, but in many settings careful specification of the antecedents of norms should be sufficient for expressing such norms in this model. It can also be remarked that the Lindahl-Odelstad ‘anti-nivelistic’18
The term ‘nivelism’, coined by Odelstad, refers to the idea to treat different kinds of information in a system on the same (logical) ‘level’; see [28, p. viii].
An investigation into how to apply the theory of one-agent normative positions in the context of a class of transition systems, in which transitions are deterministic and associated with a single agent performing an act, was performed. By interpreting two different extended systems of one-agent types of normative positions in terms of permitting or prohibiting different transition types, two lexicons were obtained for these extended systems in the context of the selected class of transition systems. It was demonstrated that both interpretations can be used as foundations for defining semantics for normative systems for MAS, depending on how the notion of agency (in the theory of normative positions represented by the action operator
A ‘system norms’ interpretation of the 15 normative act positions was suggested, as well as an ‘agent-specific norms’ interpretation of the ‘reduced extended’ system of normative positions. Is there a system norms interpretation of the extended 15-type system of normative positions? Is there a reduction of the set of normative act positions that can be given an agent-specific norms interpretation? It seems likely that the answer is yes to both questions, but a further investigation is left for future work.
Other ideas for the future are to generalize the concept of transition system situations, and study how Lindahl’s system of two-agent types of normative positions could be used to deal with simultaneous actions by two agents (including ‘actions’ by the environment) in this context. Furthermore, a deeper analysis of experiments with the Estates application might shed some more light on the benefits and limits of the approach to normative systems presented here.
As mentioned in Section 1.3, normative systems can besides regulative norms also contain constitutive norms, for example in the form of counts-as conditionals. A logical analysis of sentences like “x counts-as y in s”, where s can be a normative system, was proposed by Jones and Sergot [18]. The theory of normative positions does not deal with constitutive norms, but the general TJS framework developed by Lindahl and Odelstad is well suited to represent counts-as conditionals; see the discussion in [24, Section 6.2.1]. One line of future work is to instrumentalize the example employed in their discussion, and develop the norm-regulated transition system situation architecture as well as the general-level Java/Prolog instrumentalization, to allow for the representation of normative systems as networks of subsystems and relations between them, i.e., stratified normative systems consisting of both behavioral and constitutive norms [24, p. 631]. A similar line of work would be to accommodate for normative systems with intermediate strata such that normative conditions may occur both as the consequents of norms in some strata and as the antecedents of norms in other strata; cf. the discussion in Section 4.
Another idea is to try to instrumentalize the ideas regarding norm addition and subtraction in [24, Section 4.3], as a means of dealing with norm change, one of the basic features of normative systems mentioned in [2]. Another potential area of future research is the development of a full algebraic treatment of conditions, with the same expressive power as predicate logic. According to [22], this requires mathematical concepts like Tarski’s cylindric algebras [9,10].
Footnotes
Acknowledgements
The author would like to thank Jan Odelstad and Magnus Boman and two anonymous reviewers for very valuable ideas and suggestions, participants of IAT 2014 for discussions in relation to this paper, and the organizers of the conference for the opportunity to expand my conference paper.
