Abstract
Similarly to Maximum Satisfiability (MaxSAT), Minimum Satisfiability (MinSAT) is an optimization extension of the Boolean Satisfiability (SAT) decision problem. In recent years, both problems have been studied in terms of exact and approximation algorithms. In addition, the MaxSAT problem has been characterized in terms of Maximal Satisfiable Subsets (MSSes) and Minimal Correction Subsets (MCSes), as well as Minimal Unsatisfiable Subsets (MUSes) and minimal hitting set dualization. However, and in contrast with MaxSAT, no such characterizations exist for MinSAT. This paper addresses this issue by casting the MinSAT problem in a more general framework. The paper studies Maximal Falsifiability, the problem of computing a subset-maximal set of clauses that can be simultaneously falsified, and shows that MinSAT corresponds to the complement of a largest subset-maximal set of simultaneously falsifiable clauses, i.e. the solution of the Maximum Falsifiability (MaxFalse) problem. Additional contributions of the paper include novel algorithms for Maximum and Maximal Falsifiability, as well as minimal hitting set dualization results for the MaxFalse problem. Moreover, the proposed algorithms are validated on practical instances.
Introduction
Maximum and Minimum Satisfiability (resp. MaxSAT and MinSAT) are two well-known optimization extensions of Boolean Satisfiability (SAT) (e.g. [49,53,61]). While the goal of MaxSAT is to compute an assignment that maximizes the number of satisfied clauses, the goal of MinSAT is to compute an assignment that minimizes the number of satisfied clauses. Besides the plain versions, where all clauses are soft and so relaxable, both MaxSAT and MinSAT admit weighted versions as well as the existence of hard clauses, i.e. clauses that must be satisfied. MinSAT has been studied since the mid 1990s [8,9,46,57], with the original focus being on the computational complexity of the problem and on approximation algorithms. In recent years there has been a renewed interest in MinSAT, with the focus being on branch-and-bound and iterative algorithms, but also on encodings of MinSAT to MaxSAT [5,6,35,47,50,52,53,76].
Like MaxSAT, MinSAT finds a growing number of practical applications (e.g. [15,16,23,33,37,39,45]), and it has also been used in complexity characterizations of other problems (e.g. [3,17,30,34]). More importantly, given a MaxSAT problem where the soft clauses are all unit, complementing the soft clauses gives a MinSAT problem. As shown in recent work (e.g. [6,53] among others), the resulting optimization problems can be fairly different, and so reducing MaxSAT to MinSAT can in some settings produce problem instances that are easier to solve. As a result, one can expect the integration of MinSAT algorithms in portfolios of MaxSAT algorithms in the near future.

Clausal satisfiability problems characterization. (a) Problems related to clausal satisfiability. (b) How to characterize MinSAT? (Colors are visible in the online version of the article;
MaxSAT has been extensively studied in the context of reasoning about inconsistent sets of constraints. It is well-known that each MaxSAT solution represents a largest Maximal Satisfiable Subset (MSS) [13,56]. Intuitively, an MSS is a subset-maximal set of clauses that is satisfiable. The complement of an MSS is a Minimal Correction Subset (MCS), i.e. a subset-minimal relaxation of a formula that renders the formula satisfiable. Moreover, another well-known result is that each MCS is a minimal hitting set of the Minimal Unsatisfiable Subsets (MUSes), and each MUS is a minimal hitting set of the MCSes [11,13,56,71]. In stark contrast with MaxSAT, and despite the vast body of work on MinSAT, similar results for the case of MinSAT are non-existent. What is the equivalent of an MSS in the case of MinSAT? And of an MCS? And of an MUS? Does there exist a minimal hitting set relationship in the case of MinSAT? What are the implications of these results? Given the large body of research and applications of MSSes, MCSes and MUSes, it comes through as fundamental to conduct a similar study in the case of MinSAT. This is what this paper proposes to do. Figure 1 compares the existing comprehensive body of knowledge about clausal satisfiability, and this includes MaxSAT and related problems, to the almost non-existing body of knowledge about clausal falsifiability, for which very little is currently known. The paper addresses these fundamental questions and lays the foundation for a more comprehensive characterization of the MinSAT problem. In turn, a better understanding of the MinSAT problem is expected to motivate further practical applications inasmuch the same way as for the MaxSAT case. A recent concrete example of the practical applications of MinSAT (and related concepts) is the reduction of maximum independent set to MinSAT [37]. This paper is an extended version of [38]. Its contributions are summarized as follows. First, the paper introduces Maximal Falsifiability, which represents the problem of computing subset-maximal sets of simultaneously falsifiable clauses. As shown in the paper, maximal falsifiability enables developing for the MinSAT case concepts similar to MSSes, MCSes and MUSes in the MaxSAT setting. Second, the paper addresses MinSAT from the perspective of the largest maximal falsifiable solution based on the connection between MinSAT solutions and the so-called Maximum Falsifiability (MaxFalse) solutions. Third, the paper develops algorithms for Maximal and Maximum Falsifiability, thereby indirectly developing novel algorithms for the MinSAT problem. Moreover, and for the case of plain maximal falsifiability, the paper shows that it can be reduced to the maximal independent set problem. Thus, well-known linear time algorithms for maximal independent set [44] can be used for computing a single maximal falsifiability solution. Similarly, algorithms for the enumeration of maximal independent set [41,48] can be used for enumerating maximal falsifiability solutions. In addition, the paper also shows that a minimal hitting set relationship, which for the case of maximal satisfiability relates MCSes and MUSes [11,13,56,71], also exists for the case of maximal falsifiability. Thus, enumeration problems related with Maximal Falsifiability can be tackled by hitting set dualization, similarly to what has been done in the context of maximal satisfiability [11,56]. Finally, the paper presents some preliminary results on both Maximal and Maximum Falsifiability algorithms.
The paper is organized as follows. Section 2 introduces the basic definitions and notation used throughout the paper. Section 3 introduces the Maximal and Maximum Falsifiability problems as well as related computational problems. Theoretical results for enumeration problems and minimal hitting sets are presented in Section 4. Section 5 develops algorithms for Maximal Falsifiability, whereas Section 6 develops algorithms for Maximum Falsifiability (and so for MinSAT). Section 7 provides experimental results for Maximal and Maximum Falsifiability, and Section 8 concludes the paper.
This section provides the notation and the definitions used throughout the paper.
Boolean satisfiability
Boolean variables are represented by
Maximum satisfiability
The standard definition of the well-known optimization generalization of Boolean satisfiability called maximum satisfiability (or MaxSAT) is used, which is presented below.
Given a CNF formula
The following definitions also apply.
Sets
(Minimal unsatisfiable subset).
A set
MUSes and MCSes of a CNF formula are connected by the concept of minimal hitting set defined below.
(Minimal hitting set).
Given a collection Γ of sets from a universe
The minimal hitting set duality between MUSes and MCSes is well known (e.g. see [13,56,71]).
(Minimal hitting set duality).
Given a CNF formula
A subset
A subset
The reader is referred to [13,56,71] for further details on MUSes and MCSes, as well as the minimal hitting set duality between them.
Additionally, in the context of partial MaxSAT, a formula
Graph problems
The paper also considers a number of optimization problems in graphs. Given an undirected graph
The maximum independent set (MIS) problem consists in computing a maximum size IS of a graph. This problem can be generalized to the case when a weight is associated with each vertex. More importantly, given the above relationships between ISes, VCes and cliques, a solution of the MIS problem for graph
Cardinality-optimality vs. subset-optimality
Regarding the considered optimization problems in propositional logic and also in graphs where one deals with cardinality-optimal solutions (i.e. with solutions of the largest/smallest possible size), it is common to refer to these problems with respect to optimum (i.e. maximum/minimum) solutions, e.g. maximum satisfiability, maximum independent set, minimum vertex cover, maximum clique, etc. Alternatively, one can opt to optimize with respect to subset-optimal (i.e. maximal/minimal) solutions when it is needed to compute a subset that cannot be increased (or decreased) anymore. For example and regarding MaxSAT, a problem of computing one MSS/MCS of a CNF formula is called the maximal satisfiability problem. Regarding the mentioned optimization problems in graphs, namely MIS, MVC and MaxCLQ, the problems of computing a subset-maximal independent set, a subset-minimal vertex cover, and a subset-maximal clique are called maximal independent set (MxIS), minimal vertex cover (MnVC) and maximal clique (MxCLQ), respectively.
Note that a subset-optimal solution for any of the considered problems is usually seen as an approximation of the cardinality-optimal solutions and is known to be much easier to compute. As an example, a well-known result is that a maximal independent set (and, hence, a maximal vertex cover as well as a maximal clique) can be computed in linear time [44] while the maximum independent problem is known to be NP-complete [29,43]. Additionally, the topic of enumeration of subset-maximal solutions in different contexts has been extensively studied, e.g. for MaxSAT [10,58,60,64], as well as for MIS [1,41,48,75].
Maximal and maximum falsifiability
This section starts by introducing the plain maximal and maximum falsifiability problems. In this case,
(All-falsifiable).
A set of clauses
A set of clauses
Let
Let all the literals of
Given a formula For any subformula
Note that analogously to maximal satisfiable subsets (MSSes) in the context of MaxSAT, a formula can have many maximal falsifiable subsets. Thus, one might be interested in enumerating MFSes in order to approximate the solution of the maximum falsifiability problem defined below.
(Maximum falsifiability).
Given a formula
(Minimum satisfiability).
Given a formula
Notice that the proof of Proposition 3 is quite trivial and, thus, is omitted here. Nevertheless, Proposition 3 indicates that, in addition to recent algorithms for MinSAT [5,47,50,52,53], possible alternatives include dedicated algorithms for the MaxFalse problem, and also solutions based on the enumeration of MFSes.
Besides MFSes, additional minimal sets are of interest. One example is a minimal set of clauses which, if removed from Given a formula Given a formula Consider the following formula:
(Minimal non-falsifiable subset).
The connection between MaxSAT and MaxFalse/MinSAT
Observe that the definitions of MFSes, MCFSes and MNFS presented above in the context of maximal falsifiability are tightly related to the widely used concepts of MSSes, MCSes and MUSes introduced in the area of maximal satisfiability. This connection is shown in Table 1. Whereas the MaxSAT problem consists in computing the maximum number of clauses that are simultaneously satisfied, the MaxFalse problem targets on determining the maximum number of simultaneously falsified clauses. Analogously, the concept of a maximal satisfiable subset (MSS) in MaxSAT corresponds to the concept of a maximal falsifiable subset (MFS) in MaxFalse. The same relation connects the notion of a minimal unsatisfiable subset (MUS) in MaxSAT and the notion of a minimal non-falsifiable subset (MNFS) in MaxFalse as well as correction subsets (MCSes in MaxSAT and MCFSes in MaxFalse).
A relevant result is the relationship between plain maximal falsifiability and maximal independent sets. Given
The relationship between MFSes and MxISes yields a somewhat straightforward hitting set relationship. For any maximal independent set I,
Given a graph
As a result, for the case of plain maximal falsifiability the following holds:
Let
The MNFSes of
Each MNFS of
The number of MNFSes of
Reductions of MaxClique to MaxSAT are well known (e.g. [51]). For example, such reductions also allow solving MIS, MVC with MaxSAT algorithms. A new encoding of MIS into MinSAT can be devised, which does not use hard clauses. Given an undirected graph
Consider the graph

From maximal independent set to maximal falsifiability. (a) Graph
We now consider other formulations of maximal falsifiability, where
Similar to the MaxSAT case, the problems considered for MaxFalse/MinSAT are plain (
MFSes for (partial) (weighted) maximal falsifiability problems are defined similarly to plain case, but
Given a formula
(Partial weighted minimum satisfiability).
Given a formula
A simple observation is that although weights can be associated with MFSes, MCFSes and MNFSes, their number is independent of the weight function (e.g. see [62]).
For the cases where
As it was mentioned above, a number of encodings of MinSAT to MaxSAT were proposed in the past [5,6,35,47,50,52,53,76]. One of the most efficient encodings of MinSAT is the so-called ⊤-encoding [35]. Given a set of clauses
Let
One of the most practically important problems in the context of Maximal Satisfiability is enumeration of MUSes of a CNF formula (e.g. see [54,56,67]). One way to enumerate all MUSes of a formula is the method based on the well-known relationship of minimal hitting set duality between MCSes and MUSes: each MCS (MUS) of a CNF formula is a minimal hitting set of the complete set of MUSes (MCSes) of the formula (see Proposition 1).
The corresponding theoretical results were considered in [13,71]. Enumeration of MUSes based on enumerating MCSes was done in [11,56,64]. The duality relationship between MCSes and MUSes was also used for solving the SMUS problem in [36,55]. The approach did not consist in enumerating all MCSes and MUSes – instead, in order to get a lower bound on the size of the smallest MUS, only some MCSes were computed.
This section proves that the relationship of a minimal hitting set duality also exists for the case of Maximal Falsifiability, i.e. between MCFSes and MNFSes. The corresponding assertions are presented in the form of theorems. Two auxiliary propositions are used in the proofs. Hereinafter, letters
Formula
Such an MNFS can be constructed by a simple algorithm that finds a pair of clauses in
A set of clauses
It follows from the fact that for any all-falsifiable subset
Subformula
Proposition 7 implies that subformula
Let
Let
Subformula
Proposition 8 implies that subformula
Let
Let
Observe that the proofs of the propositions presented above make use only of the general definitions of an MFS, MCFS and MNFS described in Section 3. Therefore, the propositions hold for both plain and partial maximal falsifiability.
It should be noted that in contrast to Maximal Satisfiability, for the case of Maximal Falsifiability it can be more helpful to enumerate MNFSes instead of MCFSes. A set of MNFSes can give us a lower bound on the size of each MCFS and, hence, an upper bound on the optimal value for MaxFalse. Therefore, this can be used to bootstrap algorithms that refine an upper bound (see Section 6).
Observe that there is no correspondence between computing MFSes and MxISes for the case
Recall that the connection between plain maximal falsifiability and maximal independent set in Section 3 established the correspondence between independent vertices and clauses that can be simultaneously falsified.
In contrast to plain maximal falsifiability, for which MNFSes are known to contain exactly two clauses (see Proposition 5), formulas with hard clauses may have MNFSes that contain just one clause. This fact is shown below.
Let
Proof by contradiction. Let
Let
Note that Corollary 1 gives a sufficient condition of partial formulas having MNFSes of size 1. Furthermore, it can be observed that formulas with hard clauses can also have MNFSes of size greater 2. Indeed, this can be illustrated with the following example.
Consider a set of clauses
This immediately shows that the number of all MNFSes of partial formulas cannot be polynomial in general. Although this implies that enumeration of MNFSes for such formulas may not be feasible in practice, instead of enumerating MNFSes of
As indicated in Section 3, there are linear time algorithms for plain maximal falsifiability, while the general case of the problem (i.e. when a partial CNF formula
Basic linear search
Let

Basic linear search (BLS)
Algorithm 1 shows the pseudo-code of the Basic Linear Search (BLS) algorithm for the general case of maximal falsifiability, inspired on algorithms for MCSes [58,64]. Given

Clause D-like algorithm (CLD)
Additionally, inspired by the results presented in [58], one can construct an algorithm for computing MFSes based on the ideas lying behind the clause D algorithm (CLD). The original CLD algorithm [58] proposed for computing an MCS of a CNF formula
The same idea (however, with a serious drawback) can be applied to the problem of computing an MFS of a CNF formula. Algorithm 2 shows the pseudo-code of the CLD-like algorithm adapted to maximal falsifiability. Given a formula in the form of
Algorithms for maximum falsifiability
A solution to the MaxFalse problem can be obtained by computing a solution to the MinSAT problem (Proposition 3). On the other hand, and as mentioned in Section 5, several encodings have been proposed to translate MinSAT into MaxSAT. Thus, the MaxFalse problem can be solved by encoding the problem into MaxSAT and solving the corresponding MaxSAT problem. This paper proposes instead native algorithms for the MaxFalse problem including three iterative algorithms and an algorithm based on the minimal hitting set duality.
Iterative algorithms
The three algorithms proposed in this section are based on iterative calls to a SAT solver, to determine if a subset of the soft clauses with a maximum current cost exists. The idea is similar to the classical iterative SAT-based MaxSAT solvers. Initially each soft clause is relaxed by associating a relaxation variable to the clause (a fresh Boolean variable). This process of relaxing a soft clause guarantees that whenever a soft clause is satisfied by an assignment, then its associated relaxation variable is assigned true. At each iteration, the SAT solver deals with the working formula and a constraint enforcing a current maximum cost on the set of relaxation variables assigned true. The current cost of each iteration depends on the bounds being refined, either a lower bound, an upper bound, or both. The three algorithms proposed correspond to the three types of search possible (to refine the bounds): Binary search (MFBS) (which refines both an upper and a lower bound); Linear search starting from a lower bound (named Linear search UNSAT-SAT, MFLSUS); and Linear search starting from an upper bound (named Linear search SAT-UNSAT, MFLSSU).

MaxFalse Binary Search (MFBS)

MaxFalse Linear Search SAT-UNSAT (MFLSSU)

MaxFalse Linear Search UNSAT-SAT (MFLSUS)
All the iterative algorithms start by obtaining a working formula
After relaxing, the bounds are computed (line 7 of the pseudo-codes of the Algorithms 3, 4 and 5). In the following we explain how the bounds are computed followed by a detailed description of each of the iterative algorithms.
The iterative algorithms proceed by refining an upper bound or a lower bound or both, depending on the algorithm. This section describes how the initial bounds are obtained from the relaxed working formula
In order to compute an upper bound, the algorithm calls a SAT solver on the working formula
The lower bound is computed by a greedy heuristic using only the soft clauses in
Afterwards, the variable with the maximum associated cost is selected. Since any assignment is forced to include the costs associated to the variables, then we greedily select the one with the biggest associated cost. The cost is added to the lower bound, and all the clauses corresponding to the minimum sum associated to the selected variable are deleted. The selected variable is then disregarded in the remaining iterations. The process is repeated until there are no more variables. In the end, a lower bound has been computed. Consider the weighted formula For the first iteration on the computation of the lower bound, each of the variables is associated with the following values:
The maximum value of 3 is selected with the negative polarity of variable The maximum corresponds to 1, increasing the lower bound to 4, and variable Finally, variable
This section presents the pseudo-codes of the three proposed iterative MaxFalse algorithms. First, the pseudo-code of the binary search algorithm is shown, followed by the pseudo-code of the linear search algorithms.
Algorithm 3 shows the pseudo-code of the MaxFalse Binary Search (MFBS) algorithm for maximum falsifiability. As mentioned in the introduction of Section 6.1, iterative algorithms start by relaxing all the soft clauses in a working formula
Lines 8–14 present the main loop of the MFBS algorithm. At each iteration, the algorithm computes a value κ in the middle of the bounds, and makes a call to the SAT solver with the working formula
The algorithm iterates until both bounds are the same (line 8), and returns a set of soft clauses falsified by the last assignment with function
Algorithm 4 shows the pseudo-code of the MaxFalse Linear Search SAT-UNSAT (MFLSSU) algorithm for maximum falsifiability, while Algorithm 5 shows the pseudo-code of the MaxFalse Linear Search UNSAT-SAT (MFLSUS) algorithm for maximum falsifiability. Since the pseudo-codes are similar, they are presented together.
In contrast to binary search where both upper and lower bounds are refined simultaneously, the idea of the linear search algorithms consists in refining only one of the bounds, either the upper bound in case of the Linear Search SAT-UNSAT, or the lower bound in case of the Linear Search UNSAT-SAT. Depending on where the optimum solution is located with regards to the bounds, refining only one of the bounds can be advantageous. For example, linear search MaxSAT algorithms refining lower bounds have demonstrated good performances in industrial categories in previous MaxSAT Evaluations.
As before, lines 2–7 obtain the relaxed working formula and compute the initial bounds. An upper bound is computed in the case of MFLSSU, and a lower bound is computed in the case of MFLSUS.
The main loop is presented in lines 8–13. At each iteration, line 10 makes a call to the SAT solver on the working formula
In the case of MFLSSU, since we are refining the upper bound, the maximum allowed cost is smaller than the current upper bound. The SAT solver is testing if there exists a solution smaller than the current one. If true, the SAT solver will return the new solution found and the upper bound is updated to the new value (similar to the refinement of the upper bound in the binary search algorithm (line 12 of MFBS)). MFLSSU stops when no better solution can be found.
In the case of MFLSUS, since we are refining the lower bound, the maximum allowed cost is at most the current lower bound. The SAT solver is testing if there exist a solution with a cost lower or equal to the current lower bound. If no solution exists, then the lower bound is increased to the next possible value (similar to the refinement of the lower bound in the binary search algorithm (line 14 of MFBS)). MFLSUS stops when a solution has been found, that is the current lower bound corresponds to the optimum value.
Algorithm based on minimal hitting set duality
Following the ideas described in Section 4, this section proposes an algorithm for the maximum falsifiability problem based on the minimal hitting set duality between sets of MCFSes and MNFSes of a CNF formula. A similar approach to MaxSAT (called MaxHS) was proposed in [24] and further improved in [25,26]. However, in contrast to MaxHS, which builts on top of the well-known MIP solver CPLEX, the algorithm proposed here is a pure SAT-based approach to the problem meaning that hitting sets are enumerated using a pure SAT-based technology without appealing to any of the integer programming algorithms. Also note that instead of computing minimal hitting sets of the set of all MNFSes, the approach being proposed enumerates minimal hitting sets of the set of unfalsifiable cores of the formula.

MaxFalse algorithm based on Hitting Sets (MFHS)
Algorithm 6 shows the pseudo-code of the proposed algorithm. The basic idea of the method is to divide the process into two parts. The first one makes use of an external oracle that enumerates smallest minimal hitting sets of the set of all unfalsifiable cores of the formula found so far. The second part is intended for checking if the set of clauses complement to what was found by the external oracle is all-falsifiable. If it is not then a new unsatisfiable core is extracted and the process continues. Otherwise, a solution is found and reported. In order to compute the smallest minimal hitting sets of the unfalsifiable cores found so far, a MaxSAT solver is used as the external oracle on a constructed partial MaxSAT formula
Note that maximality of the solution is guaranteed by maximality of solutions for
This section describes the experimental results obtained for Maximal Falsifiability as well as for Maximum Falsifiability. Section 7.1 shows a comparison on the quality of the solutions obtained for Maximal Falsifiability. Then Section 7.2 presents a study on the performance of the algorithms proposed for Maximum Falsifiability.
The algorithms described in this paper were implemented in C++ using incremental SAT solvers. The experiments were performed on an HPC cluster, with quad-core Intel Xeon E5450 3 GHz nodes with 32 GB of memory. The following two sets of benchmarks were considered in the evaluation. The first set, called MIS benchmarks, comprises all the MaxFalse instances that were considered in [37]. These instances are crafted and come from the MIS and MaxClique problems, which can be reduced to MaxFalse (the corresponding reductions were studied in [37]). The total number of instances in the MIS benchmark set is 233.
In order to evaluate the performance of the algorithms in real industrial problems (not random nor crafted problems), a second benchmark set was also considered. It comprises all the Partial MaxSAT Industrial and Weighted Partial Industrial benchmarks from the MaxSAT Evaluation 2014.3
See
As explained in Section 5, a different alternative to Maximal/Maximum Falsifiability consists in transforming the MaxFalse instance by encoding it into MaxSAT (e.g. via the ⊤-encoding), and then computing an MCS/MaxSAT solution of the resulting MaxSAT instance. In our experimental evaluation the ⊤-encoding was used for deriving MaxSAT instances for the MIS benchmarks. As for the MaxSAT benchmarks, the original instances considered contain only unit soft clauses, and thus there is no need to do the ⊤-encoding. Instead, it is enough to negate the corresponding literals in the soft clauses to get MaxSAT instances from MaxFalse, and the other way around.
The BLS and CLD algorithms (Algorithms 1 and 2) proposed in Section 5 were implemented in a tool called mxlFalse. The underlying SAT solver of the mxlFalse tool is Minisat 2.2 [28].
This section studies the quality of the solutions obtained for both sets of benchmarks. The cost of the MFSes/MCFSes obtained with BLS and CLD algorithms is compared against the cost of the MCSes obtained by MCSls [58] (an efficient MCS extractor) that was ran for the corresponding MaxSAT instances. Note that we used a number of possible configurations of MCSls and chose the best one, which uses the original CLD algorithm proposed in [58].
In the experiments both the mxlFalse and MCSls were set to enumerate MFSes/MCFSes and MCSes (respectively) for 3 min, whereupon the minimum cost MCFS/MCS was obtained. The results obtained were then divided by the optimum cost, and the values were plotted in the scatter plots of Figs 3 and 4. Figure 3 compares the values obtained by the proposed BLS (on the left) and CLD (on the right) algorithms for the MIS benchmarks instances to the value obtained by MCSls. It can be seen from the scatter plot that in the vast majority of cases all the considered algorithms are able to find the exact optimum while enumerating approximate solutions. As for the others, the best solution reported by all competitors is usually the same. There are a few outlying instances where MCSls is better than both BLS and CLD algorithms.

Scatter plots comparing BLS and CLD algorithms to MCSls for the MIS benchmark set. (Colors are visible in the online version of the article;

Scatter plots comparing BLS and CLD algorithms to MCSls for the MaxSAT benchmark set. (Colors are visible in the online version of the article;

Cactus plot for MIS benchmark instances. (Colors are visible in the online version of the article;
Figure 4 shows the comparison between the best solutions found by the proposed algorithms and MCSls for the considered MaxSAT benchmark set. In this case, even though there are instances where the BLS algorithm gets closer to the optimal solution than MCSls, in the majority of benchmarks solutions produced by MCSls are better than the ones of the BLS algorithm. As for the comparison between CLD and MCSls, apparently there is no clear winner. A number of instances where CLD was not able to find any approximate solution is larger than the number of instances for which MCSls got timed out. As it was mentioned in Section 5.2, this can be explained by the fact that the proposed CLD algorithm has to introduce a lot of additional variables (one variable per soft clause), which makes SAT calls harder. However, as one can see at Fig. 4, for a wide majority of formulas with a reasonable number of relaxable clauses CLD is able to enumerate solutions closer to the optimum than the ones found by MCSls. Therefore, in most of the cases solutions obtained by CLD are preferred.
The Maximum Falsifiability algorithms proposed in Section 6 were implemented in a tool called maximumFalse. Namely, the following algorithms were implemented: binary search (MFBS), linear search unsat-sat (MFLSUS) and linear search sat-unsat (MFLSSU) as well as the minimal hitting set based algorithm (MFHS). This section presents results on the performance of the proposed algorithms running for 1800 seconds with 4 GB of memory limit. The underlying SAT solver of the maximumFalse tool is the Glucose SAT solver [7]. Additionally, best non-portfolio MaxSAT solvers (according to the results of the MaxSAT Evaluation 2014) were considered, namely Open-WBO-Inc [59] and Eva500a [63].4
Open-WBO-Inc is the best non-portfolio solver in the category of MaxSAT Industrial and Partial MaxSAT Industrial while Eva500a outperforming every other solver in the category of Weighted Partial MaxSAT Industrial (see

Cactus plot for MaxSAT benchmark instances. (Colors are visible in the online version of the article; https://dx-doi-org.web.bisu.edu.cn/10.3233/AIC-150685.)
A cactus plot showing the performance of the evaluated algorithms on the MIS benchmark instances is presented in Fig. 5. The largest number of instances (108) for this set of benchmarks is solved by MaxHS. This is not surprising because MaxHS is known to perform extremely well for random and crafted MaxSAT benchmarks. Eva500a is 3 instances behind MaxHS (with 105 instances solved). Open-WBO-Inc comes third being able to cope with 95 instances. Among the proposed MaxFalse algorithms the best performance is shown by linear search sat-unsat (MFLSSU), which solved 92 instances, while the linear search unsat-sat (MFLSUS) coming the last (65 instances solved). This is caused by the nature of the benchmarks – optimal values of the majority of them are close to the initial upper bounds. Being able to solve 87 instances, the MFHS algorithm is fifth. A possible explanation of this can be the lack of additional heuristics and improvements in this algorithm, e.g. widely used disjoint core enumeration and core trimming, as well as a number of efficient heuristics proposed in [24–26] specifically for hitting set enumeration based approaches and implemented in MaxHS.
Figure 6 shows the performance of the tested algorithms on the MaxSAT benchmark instances. As expected, state-of-the-art core-guided MaxSAT algorithms outperform the other competitors. Eva500a shows the best performance with 772 solved instances (out of 877). Open-WBO-Inc comes second but it is far behind Eva500a with 639 solved instances. The worst performance is shown by iterative MaxFalse algorithms (271, 319 and 334 instances solved by MFLSSU, MFBS and MFLSUS, respectively). The MFLSUS algorithm is the best among them indicating that for this benchmark set either optimal values are close to initial lower bounds or the calls to the SAT oracle with the SAT outcome are harder than the UNSAT calls. For this set of benchmarks, the MFHS algorithm performs far better than all the iterative algorithms being able to solve 525 instances. Although MaxHS has a better performance (631 instances solved), it is expected because of several reasons. First, it uses a different solving engine utilizing the best known MIP solver called CPLEX. In contrast, our approach is a pure SAT-based algorithm. Second (and the most important), MaxHS is being developed and heavily improved for several years resulting its performance to increase dramatically over the years. Therefore, being a basic hitting set based algorithm for the MaxFalse problem, MFHS still has potential to be improved in a manner similar to what was already done for MaxHS.
As a result, the experimental evaluation performed reveals the lack of efficient native algorithms for the MaxFalse problem. This applies to both crafted and industrial problem instances. However, while the performance of the proposed MFHS algorithm can be improved in order to be as good as MaxHS is for the crafted MaxSAT instances, for the industrial problem instances the development of efficient native core-guided algorithms is of a crucial importance. Note that although core-guided MaxSAT algorithms result from over a decade of research, it is still not known in the literature how to take advantage of core-guided search natively in MaxFalse algorithms, nor it is known to be even possible. While this paper proposes a general framework for both maximal and maximum falsifiability, the mentioned issues are important topics of future research in the MaxFalse setting.

Clausal falsifiability problems characterization. (Colors are visible in the online version of the article;
Motivated by the recent interest in MinSAT, this paper develops a comprehensive characterization of this problem, which follows the one developed earlier for MaxSAT (see Fig. 7). To achieve this goal, the paper introduces the problems of maximum and maximal falsifiability. The case of plain maximal falsifiability is shown to correspond to the computation of a maximal independent set in an undirected graph. Also, the paper develops a reduction of maximal independent set into maximal falsifiability (and so to minimal satisfiability), which does not involve hard clauses. Moreover, as pointed out, maximal falsifiability can be viewed as a more general formulation (with respect to maximal independent set), as it allows hard clauses to be considered. The proposed reduction brings a number of important practical applications of the proposed maximum and maximal falsifiability framework including the well-known graph-related problems, as well as many others. Maximal falsifiability is also used to introduce a number of new concepts: maximal falsifiable subsets (MSFes), minimal correction for falsifiability subsets (MCFSes) and minimal non-falsifiability subsets (MNFSes). In addition, the paper develops native algorithms for both maximal and maximum falsifiability, namely algorithms for computing one MFS and for solving the MaxFalse problem, and shows how these problems can be solved by reduction to MaxSAT. Finally, minimal hitting set duality between MCFSes and MNCSes is proven for the general (partial) case. The preliminary experimental results indicate that the proposed algorithms for maximal falsifiability can compete with the state-of-the-art algorithms enumerating MCSes in terms of both the running time and the solution quality. As for the maximum falsifiability, the paper issues the challenge of developing efficient native algorithms for MaxFalse including native core-guided algorithms.
The work described in the paper opens a significant number of research directions. Concrete examples include additional native algorithms for computing MFSes and for MaxFalse, as well as improved versions of the proposed algorithms, among others.
Footnotes
Acknowledgements
The authors would like to thank the anonymous reviewers for their valuable comments and suggestions to improve earlier versions of the paper. This work is partially supported by SFI PI grant BEACON (09/IN.1/I2618), FCT grant POLARIS (PTDC/EIA-CCO/123051/2010) and national funds through Fundação para a Ciência e a Tecnologia (FCT) with reference UID/CEC/50021/2013.
