The abstract (arithmetical) analysis of algorithmic problems was initiated by S. Kleene and E. Post [2,8]. E. Post introduced the concept of degree of unsolvability of a problem, while Kleene and Post investigated in [2] the class of degrees of unsolvability of arithmetical (in the sense of Gödel) sets. Papers along the same line were published subsequently.
The traditional algorithmic problems of algebra, number theory, topology, and mathematical logic were problems of solvability. This explains the predominant interest shown first in problems of solvability of arithmetic (i.e., problems of solvability of sets of natural numbers). Subsequently, however, in logic and its applications, problems arose connected to separability, enumerability, and isomorphism of sets [5,6,10,12].
The definition of an algorithmic problem in abstract algorithm theory was formulated by Y.T. Medvedev, in which all the previously known cases and many others were treated [5]. The problem of constructing an arithmetical function2
I.e., a function defined on the natural numbers and assuming values from , which includes also 0.
satisfying certain conditions is called a Medvedev problem (M-problem). To each M-problem P there corresponds a family of functions satisfying the conditions of the problem. Conversely, any family of functions A defines some M-problem . The functions contained in the family corresponding to an M-problem P are called the solution functions of the M-problem P.
To each M-problem there corresponds a certain degree of difficulty (an exact definition of degrees of difficulty is given below). It is possible to define in a natural fashion conjunction, disjunction, and other operations of propositional calculus on the degrees of difficulty. As was established by Y.T. Medvedev, the calculus of M-problems is an interpretation of constructive propositional calculus. This is to be expected, since the calculus of M-problems is an elaboration of A.N. Kolmogorov’s calculus of problems (see [3]). The definition of reducibility of a family of functions (M-problems), which is basic in the calculus of M-problems, has a constructive character.
An M-problem (family A) is reducible to an M-problem (family B), if there exists a general method of transformation of any solution of the M-problem into a solution of the M-problem , or more accurately, if there exists a partial recursive operator T, which transforms each function f from the family B into some function g (which depends on f) from the family A, . The reducibility of the family A (M-problem to ) to B is denoted by (). The family of functions A (the M-problem )3
The definitions presented here apply equally well to families of functions and to the M-problems which they define.
is called solvable, if it contains at least one general recursive function. The M-problems (families) A and B are called equivalent () if they are reducible to each other.
The class of M-problems equivalent to an M-problem A is called the degree of difficulty of the M-problem A and is denoted by . The degrees of difficulty form a partially ordered set Ω: if the M-problem A is reducible to B. Ω is a distributive lattice with implication and has a largest and a smallest element (see [5]). The investigation of M-problems, initiated by Y.T. Medvedev, was continued by the author in [6].
Section 1
1. We describe here a second approach to the concept of reducibility of algorithmic problems, corresponding to classical, i.e., non-constructive, formulations.
Along with the problem of constructing an algorithm which solves a certain problem, it is possible to consider the problem of the existence of a required algorithm, without insisting on its concrete form. Then each condition imposed on the arithmetical functions (i.e., each family of functions) will be linked to two problems:
The problem of constructing one of the functions of this family: the M-problem.
The problem of proving the existence of a general recursive function in this family.4
It is easy to see here an analogy with the question of the existence of a solution of a differential equation and the problem of effectively finding a solution.
Problems of the second type will be called Ex-problems. There is a pairwise one-to-one correspondence between the classes of families of functions, M-problems, and Ex-problems. The Ex-problem corresponding to the family of functions A (M-problem ) will be denoted by . The functions of the family defining the Ex-problem Q will accordingly be called the solution functions of the Ex-problem . An Ex-problem is called solvable if its solution functions include a general recursive one.
An important method of establishing the solvability of an algorithmic problem A is to reduce this problem to a different problem B, the solvability of which has already been established. Conversely, the unsolvability of a problem A implies the unsolvability of any problem B to which problem A is reducible.
The Ex-problem (family of functions A) is weakly reducible to the Ex-problem (family B) (), if for any function f of the family B () there exists a partial recursive operator T, which transforms the function f into the function g of the family A ().
The choice of the function f governs here not only g but also the operator . In this case we say that the problem (family A) reduces weakly to the problem (family B) by means of the operators .
The reducibility of families of functions (problems) in the sense of Medvedev’s definition will be called henceforth strong reducibility (or simply reducibility).
Inasmuch as each of the three objects: the family of functions, the M-problem, and the Ex-problem, defines uniquely the two others, we shall henceforth identify these objects and call them problems.
2. A natural question arises concerning the relation between these types of reducibility. It is clear that strong reducibility of a problem A to a problem B implies weak reducibility of A to B. As shown by the example considered below, the converse is generally not true.
Let the problem A be determined by a family consisting of one non-recursive function f, , and let problem B be determined by a family consisting of all the functions obtained from f in the following manner: for each tuple of natural numbers we consider the function :
i.e., we “place in front” of the sequence of values the tuple :
It is easy to see that the problem reduces weakly to the problem :
For any function there exists a partial recursive operator (p.r.o.) T which transforms into f (by “discarding” the first s values of , where ).
However, the problem A does not strongly reduce to the problem B.
Let us assume the opposite, i.e., that there exists a p.r.o. T which transforms any function into f. Any p.r.o. T can be specified by means of a recursive sequence of pairs of tuples (see [4,6])
If the sequence of several first values of the function h forms a tuple d, then we call d a tuple of the function h. We shall also say that the function h begins with the tuple d. If and is a tuple of the function e, then is a tuple of the function h. Inasmuch as and is a tuple of the function , then is a tuple of the function f (for each w). In view of the fact that is a recursive sequence of tuples, the length of which is unlimited (in the aggregate), the function f is recursive, yet we have assumed it to be non-recursive. This contradiction proves that the problem A does not reduce strongly to B.
In the foregoing example, the problem B was chosen somewhat artificially. For algorithmic problems which are usually considered in the theory of algorithms and its applications, the situation is different. If we confine ourselves to reducibility (strong and weak) by means of general recursive operators5
A general recursive operator is a p.r.o. which transforms functions which are everywhere defined (on ) into functions which are everywhere defined.
or even partial recursive operators applicable to each solution function of the problem to which we reduce another problem, then both types of reducibility are equivalent for a broad class of problems. We shall return to this question in Section 2, and consider here in greater detail the calculus that results from the definition of weak reducibility of problems.
3. If problems A and B reduce weakly to each other, we shall call them weakly equivalent: . This relation is transitive, symmetrical, and reflexive. The class of all problems therefore breaks up into classes of weakly equivalent problems. The class of problems which are weakly equivalent to A will be called the weak degree of difficulty of problem A. The weak degree of difficulty of the problem A characterizes the problem of proving the existence (in the classical sense) of a computable solution function of the problem A.
A weak degree of difficulty exceeds , or , if the problem A reduces weakly to the problem B (, ). We denote by the partially ordered set of weak degrees of difficulty.
Between Ω and there is a one-sidedly univalent correspondence ; to each degree of difficulty there corresponds a weak degree of difficulty : is the weak degree of difficulty of a problem A with degree of difficulty a. The correspondence does not depend on the choice of the problem A, since equivalence of problems implies weak equivalence of problems. This relation is isotopic, since reducibility of problems implies weak reducibility. The solvable (smallest) degree 0 from Ω corresponds to the solvable weak degree from , and the improper (largest, i.e., defined by the empty class of functions) degree ∞ from Ω corresponds to an equal degree from . We shall prove that is a lattice and the indicated correspondence is a lattice homomorphism.
We note that admits a natural topological interpretation. Define a complete family of functions or points of Baire space (complete problem) to be any family (problem) A having the following property: together with each function f belonging to A, the family A contains any function g with respect to which the function f is recursive.
We shall establish some properties of complete families. The union and intersection of any number of complete families (finite or infinite) are also complete families.
Let B be some family of functions. The family consisting of all functions , for each of which there exists a certain function f from B, which is recursive with respect to this function g will be called the completion of the family B. It is obvious that is the smallest complete family containing the family B, and the completion of a complete family A coincides with A: . The family is weakly equivalent to B. It is sufficient to establish that , since , from which follows . Indeed, for any function there exists a p.r.o. T such that .
Completions of two weakly equivalent families A and B coincide: . Let . Then there exists a function and a p.r.o. such that . In view of , there exists a p.r.o. T such that . Then . Therefore . Conversely, if , then . Thus .
In view of the foregoing, any weak degree defines uniquely a complete family (problem) A, which we shall call the representative of .
Letandbe weak degrees of complete families A and B respectively. Then,6
denotes that the statement is equivalent to statement .
or using a different notation
Let . Then there exists a p.r.o. T such that . In view of the completeness of the family B, . The relation is obvious.
We now readily prove some theorems concerning the properties of .
For any set of weak degreesthere exist exact upper and lower bounds, denoted byand, respectively.
Let be a complete family with weak degree of difficulty and , . We shall prove that . Obviously A is a complete family and for any ξ. Further, let for any ξ and B a complete family, . Then and , hence . We put . Obviously, for any ξ. In addition, if for all ξ, and B is a representative of , then and , i.e., . Hence .
From the proof of Theorem 1, we see that the operations of taking the exact upper and lower bounds in correspond to the operations of intersection and union of complete families of functions.
is a complete lattice, represented by subsets of the Baire space J. In the function space J it is possible to introduce a topology by assigning as open sets the complete families of functions. This will be a space. (On this subject see G.D. Birkhoff, Lattice theory, Russian translation of the 2nd edition, IL 1952, Chapter IV, §§ 1 and 2.)
Let A and B be arbitrary problems,,,,. Then the problemwith degree of difficultyhas a weak degree, and the problem D with degree of difficultyhas a weak degree.
Following Y.T. Medvedev [5], we choose problems C and D in the following fashion. We define the p.r.o.s , and a two-place p.r.o. R:
The problem C consists of all the functions , where , and all the functions , where , and . The problem consists of all the solution functions of problems A and B,
We shall prove that C and are weakly equivalent, i.e., . Indeed, each function can be transformed with the aid of or into a function , and each function can be reduced by means of an inverse transformation into (i.e., reduces even strongly to C).
Further, the problem D consists of all the functions , where f runs through class A and g through class B. The problem consists of all the functions e such that problems A and B reduce to the problem of computability , i.e., for each function e there exists p.r.o. and such that , . We shall prove that problems D and are weakly equivalent:
(even ). The relation follows from the fact that class D is contained in , since any function can be transformed with the aid of the p.r.o. () into the function , (). To this end it is sufficient to put
. Let the function . Then there exist p.r.o. and such that
and
The p.r.o. T transforms the function e into , from which it follows that .
The weak degree will be called the disjunction, and will be called the conjunction, of the weak degrees and . Let us prove that the lattice has an implication operator:
For any weak degreesandthere exists a smallest degreein the class of weak degreessuch that.
We consider the representatives of the weak degrees and , i.e., the complete families (problems) A and B, , . We denote by the family of all the functions such that for each pair of functions , where and , there exist a p.r.o. T which transforms the pair into a function , . It is obvious that the family includes the family B and that where . Let us prove that the problem reduces weakly to any problem C such that where . Let C be such a problem and g an arbitrary function from C. As follows from Theorem 2, the problem D, which consists of all of the functions where f runs through the family A and g through the family C, has the weak degree . Inasmuch as , i.e., , for any function , there exists a p.r.o. such that . This means that for any pair of functions where and , there exists a two-place p.r.o. such that . By definition of , the function . It follows therefore that and . This completes the proof. □
We shall call the weak problem of reducibility of the problem B to the problem A, and the implication, denoted by . Obviously is a complete family, i.e., the representative of .
We note that implication, generally speaking, is not conserved in homomorphism of the lattices . Indeed, in the example discussed in Section 2, the problems A and B (, ) were related by and , or and . Therefore the implication is the solvable (trivial) weak degree (i.e., the degree of a solvable problem), and is an unsolvable degree and .
Note that solvability of the weak degree is equivalent to the relation . The proof of this is simple and will be omitted. Further consideration of this point is analogous to that of Y.T. Medvedev with respect to the calculus of Ω.
We consider an arbitrary segment . The weak degree is called the negation of the weak degree x (with respect to ). We introduce also the notation for the degree .
The thought arises of the connection between the calculus of weak degrees and the propositional calculus: elementary propositions can be interpreted as weak degrees, and the operations of propositional calculus correspond to like operations of the calculus of weak degrees. The truth of a formula corresponds to the solvability of a weak degree.
All the axioms and rules of derivation of intuitionistic propositional calculus are satisfied for weak degrees of an arbitrary segmentin.
Theorem 4 follows from the existence of implication in the distributive lattice Ω (see Birkhoff, Lattice theory, Russian translation of the 2nd edition, Chapter XII, §7).
Let us discuss the consequences of this point. In spite of the fact that the definition of weak reducibility of problems has been chosen in accordance with classical premises, the calculus of weak degrees obtained thereby is an interpretation of constructive propositional calculus and does not include, for example, the law of the excluded third.
However, this should not surprise us, since the calculus of weak degrees , like that of Ω, is a refinement of Kolmogorov’s calculus of problems.
The question whether the weak degrees are an exact7
An interpretation of a logical calculus K is called exact if all formulas true (solvable, realizable) in the interpretation are derivable in the calculus K.
interpretation of constructive propositional calculus remains open. We note that the calculus of degrees of difficulty Ω, as shown recently by Y.T. Medvedev, is an exact interpretation of the constructive calculus.
Section 2
In this section we analyze the question of the relation between strong and weak reducibility under certain limitations on the p.r.o.s by means of which the reducibility is realized, and on the problems themselves.
We need several new concepts. In the arguments that follow we shall find it convenient to use the Baire space J.
Arithmetical functions can be interpreted as points in Baire space (considering the sequence of the values of these functions [1,4]). To each problem A in such an interpretation, there corresponds a certain set of points of the Baire space, which defines it completely.
Let be a Baire interval, defined by a tuple . The problem which is defined by the set of points shall be called the interval of the problem A. In other words, is defined by the class of solution functions of the problem A beginning with the tuple . The interval is called non-empty if the set is non-empty. A problem A is called uniform if any of its non-empty intervals is (strongly) reducible to it.
The problem of solvability of the set E is defined by the class , consisting of one characteristic function of the set E. The problem of enumerability is determined by the class of the functions that enumerate the set E, i.e., the set E is the image of the function . The problem of separability of the sets and with empty intersection is determined by the class of functions satisfying the condition
The problem of enumerability of any non-empty set E is uniform.
Indeed, let C be the problem of enumerability of the set E and let be a non-empty interval in it: . Thus consists of all the functions which enumerate the set E and begin with the tuple . The problem is (strongly) reducible to the problem C by means of the p.r.o. T which, being applied to any function f, shifts the sequence of its values by first adding the tuple .
The problem of separabilityis uniform for arbitrary,(, where Λ is the empty set).
We denote the problem by A. Let be a non-empty interval of the problem A, . It is obvious that
The problem is (strongly) reducible to the problem A by means of the p.r.o. T which replaces the first s values of any function by the tuple . If is a solution function of the problem A, then it satisfies the condition (2). But then the function also satisfies the condition (2), as follows from (3) and from the definition of the p.r.o. T. In addition, the function g begins with the tuple and hence is a solution function of the M-problem , which was to be proved.
function is the problem defined by the class of functions (which are defined everywhere on ) coinciding with the function wherever the latter is defined. (We shall call such functions continuations of .) We note that a problem of separability is a particular case of a problem of continuation. Obviously we have:
The problem of continuation of any partial function is uniform.
The proof of Theorem 7 is analogous to the proof of Theorem 6.
Inasmuch as the p.r.o.s used in the proofs of Theorems 1 and 2 are general recursive, each problem of enumerability or separability reduces to any of its non-empty intervals by means of a general recursive operator. Problems possessing this property will be called general recursively uniform. In addition to problems of enumerability and separability, problems of solvability are also general recursively uniform, since the operator of identical transformation reduces any function to itself.
An example of a non-uniform problem is the problem defined by the class , where the degree of non-computability of the function f is strictly greater than the degree of non-computability of the function g.
We shall call the problem B closed if it corresponds to a closed set of points of the Baire space J. Obviously, solvability problems are closed.
The continuation problem of any partial function is closed.
Let be a convergent sequence of continuations of the function , and let . We shall prove that also continues . If the function is defined for , then for all k. Consequently , as was to be proved.
Any problem of separability is closed.
The problem of enumerabilityof any set E containing more than one element is not closed.
Let and let the function enumerate the set E. We define the sequence of functions enumerating the set E:
Obviously
In view of the fact that the set is not empty, is not a solution function of the problem , and consequently the problem is not closed.
However, it is possible to generalize the concept of closedness of a problem in such a way that enumerability problems as well as many other problems which are of interest for the recursive theory of sets are included. This concept is closely related with the theory of infinite games [9].
Let S be a set of points of the Baire space J. We imagine two players I and II who move alternately, and their moves consist of choosing Baire intervals which intersect with the set S. Player I chooses as his first move the Baire interval , which intersects with S. If player I chose in move m the Baire interval , then player II chooses in the mth move a sub-interval9
We consider Baire sub-intervals which are proper parts of their intervals.
of the interval intersecting with S. Then player I chooses in the st move a sub-interval of the interval intersecting with S. Let us assume that after the mth move of player I (II) the play is in the interval (). We agree that at the beginning the game is in the interval . Player II wins if the sequence of intervals
contracts to a point of the set S. Otherwise, player I wins.
We fix once and for all some effective numbering of the Baire intervals by means of natural numbers. By a strategy of a player we mean a function which indicates for each interval with number n the number r of a sub-interval of it. If the game is in the interval numbered n, then the player making the next move chooses the interval with number . The strategy φ is called correct with respect to the set S if for any interval numbered n intersecting with S, the interval numbered also intersects with S. We shall henceforth take strategy to mean a strategy which is correct with respect to the considered set. A strategy is called winning (for the set S) if player II, using this strategy, wins for any correct strategy of his opponent. A set S is called winning if there exists a winning strategy for this set. The M-problem and the class of functions defined by the set S will also be called winning in this case.
A set S (a problem ) the complement of which is nowhere dense is called trivially winning. In order to win, it is sufficient for player II to choose as his first move an interval which is completely contained in S, which is possible since the complement is nowhere dense.
If neither the set S nor its complement is trivially winning (or equivalently, neither S nor is nowhere dense), then they cannot be simultaneously winning. In fact, let S be a winning set and its winning strategy. Let us consider the game with respect to . Player I chooses as his first move an interval in which the set S is everywhere dense (such an interval exists, since S is not a set which is nowhere dense). Then player I applies strategy . For any strategy of player II, the sequence of intervals in which the game is situated will contract to a point belonging to S, i.e., player II loses.
An example of a winning set (problem) is a closed set S (problem ). In this case the sequence of intervals contracts always to a point of S. It follows therefore that problems of solvability and separability are winning. There exist also non-closed winning problems.
Any problem of enumerability is a winning problem.
Let be the problem of enumerability of a set F of natural numbers, and let be the corresponding subset of J. Player II chooses a strategy in the following manner: let n be the number of an interval containing points in , by virtue of which . We denote by the smallest number belonging to the set F which is not equal to for , and if there is no such number, then . We put . Obviously intersects with . We consider the sequence of intervals in which the game occurs:
We note that: (1) for each m, all of the numbers of the tuples10
As is well known, Baire intervals are identified with tuples of natural numbers.
belong to F; (2) any number will be sooner or later encountered in the tuples , because going from to we add a still unchosen element of the set F (if it exists). But then the sequence contracts to the point where the set coincides with F, i.e., . This proves the theorem.
A partial recursive operator T is called fully applicable to a problem B if it is defined on each solution function of the problem B. The class of all p.r.o.s which are fully applicable to the problem B will be denoted by .
If a problem A reduces strongly (weakly) to a problem B by means of operators of a certain class P, then we say that A is strongly (weakly) P-reducible to B.
Let U be some class of p.r.o.s. A problem B is called U-uniform if any of its non-empty intervals is strongly reducible to it by means of operators of the class U.
The class of p.r.o.s represented in the form of compositions11
is the result of successive application of the p.r.o.s R and T to the function f.
where and will be denoted by .
Let A be a closed problem, B a U-uniform winning problem, and P a subclass of. If the problem A is weakly P-reducible to the problem B, then the problem A is strongly-reducible to the problem B.
Proof. Let us assume that no operator of class reduces the problem A to the problem B. We arrange all the p.r. operators of the class P in some sequence
To each operator there corresponds a continuous function in the Baire space (see [4]) defined at each point of the set , by virtue of . By virtue of our assumptions, including continuity of the functions and closedness of the set , there exists for each s an interval δ represented by the function in , the complement of . Let φ be the winning strategy for the set . By the method indicated above, we obtain for an interval . Let be the number of ; let ; let be the interval numbered ; let be the problem defined by the set , which is then a non-empty interval of the problem B.
Inasmuch as the problem B is U-uniform, the problem is strongly U-reducible to B. But then the problem A cannot be strongly P-reducible to , since in accordance with our assumption the problem A is not strongly -reducible to B. Consequently, there exists a non-empty interval intersecting with the set and transformed by the function into a subset of . Obviously it is possible to choose so as to make . If is the number of , then is the number of a sub-interval , , which also intersects with . Let be the problem defined by the set
We define further in the same manner the intervals
and the problems .
The problem B, by virtue of U-uniformity, is strongly U-reducible to any problem , while the problem A does not reduce strongly to by any P-operator. By virtue of the winning character of the problem B and of the strategy φ, the sequence contracts to a point .
Inasmuch as for any s the operator transforms the set into a subset of , we have for any s, and this means that the problem A does not reduce weakly to B by means of operators in the class P, which contradicts the conditions of the theorem. Consequently, the assumption that the problem A does not reduce strongly to B by means of operators in the class is incorrect. The theorem is proved.
Our desire to be as general as possible has made it necessary to formulate the theorem in a rather cumbersome manner. We present some simply formulated corollaries of Theorem 11.
If a closed problem A reduces weakly to a uniform winning problem B by means of operators of the class, then A reduces strongly to B.
A U-uniform problem is called general recursively uniform if U is the class of general recursive operators [4,11]. Problems of solvability, separability, and enumerability are general recursively uniform.
If a closed problem A reduces weakly to a general recursively uniform problem B by means of general recursive operators, then problem A reduces strongly to problem B by means of a general recursive operator.
In conclusion, we formulate some unsolved problems.
Is it possible to strengthen the fundamental theorem in such a way that weak reducibility (by means of arbitrary partial recursive operators) of a closed problem A to a uniform problem B would imply strong reducibility of A to B?
Under what “natural” conditions imposed on problems A and B does weak reducibility (by means of an arbitrary p.r.o.) imply strong reducibility?
What is the situation in the particular case when A is a solvability problem and B is a separability problem of enumerated recursively inseparable sets (we note that no non-trivial solvability problem A can be reduced strongly to a separability problem B [6,7]).
References
1.
P.S.Aleksandrov and A.N.Kolmogorov, Introduction to the General Theory of Sets and Functions, Gosudarstv. Izdat. Tehn.-Teor. Lit., Moscow–Leningrad, 1948.
2.
S.C.Kleene and E.L.Post, The upper semi-lattice of degrees of recursive unsolvability, Annals of Mathematics. Second Series59(3) (1954), 379–407.
3.
A.Kolmogoroff, Zur Deutung der intuitionistischen Logik, Mathematische Zeitschrift35(1) (1932), 58–65.
4.
A.V.Kuznetsov and B.A.Trakhtenbrot, Investigation of partial recursive operators by means of the theory of Baire space, Doklady Akademii Nauk SSSR105(5) (1955), 897–900.
5.
Y.T.Medvedev, Degrees of difficulty of mass problems, Doklady Akademii Nauk SSSR104(4) (1955), 501–504.
6.
A.A.Muchnik, On the unsolvability of the problem of reducibility in the theory of algorithms, Doklady Akademii Nauk SSSR108(2) (1956), 194–197.
7.
A.A.Muchnik, On the reducibility of problems of solvability of enumerable sets to problems of separability, Izvestiya Akademii Nauk SSSR, Seriya Matematicheskaya29 (1965), 717–724.
8.
E.L.Post, Recursively enumerable sets of positive integers and their decision problems, Bulletin of the American Mathematical Society50(5) (1944), 284–316.
9.
E.D.Stotskii, On the descriptive theory of games, in: Problemy Kibernetiki (Problems of Cybernetics), Vol. 8, Fizmatgiz, Moscow, 1962, pp. 45–54.
10.
B.A.Trakhtenbrot, On recursive separability, Doklady Akademii Nauk SSSR88(6) (1953), 953–956.
11.
B.A.Trakhtenbrot, Tabular representation of recursive operators, Doklady Akademii Nauk SSSR101(3) (1955), 417–420.
12.
V.A.Uspenskii, Gödel’s theorem and the theory of algorithms, Doklady Akademii Nauk SSSR91(4) (1953), 737–740.