In this paper we study, for , the projection operators over , that is the multi-valued functions that associate to and closed, the points of A which are closest to x. We also deal with approximate projections, where we content ourselves with points of A which are almost the closest to x. We use the tools of Weihrauch reducibility to classify these operators depending on the representation of A and the dimension n. It turns out that, depending on the representation of the closed sets and the dimension of the space, the projection and approximate projection operators characterize some of the most fundamental computational classes in the Weihrauch lattice.
Projecting a point over a non-empty subset of a Euclidean space is an operation deeply grounded in our geometrical intuition of the spatial continuum and has many important applications in higher mathematics. More precisely, given and we seek such that (when A is closed, such a y does exist, although it might not be unique). In this paper we show that the intuitive, even empirical, naturalness of this problem leads to multi-valued function realizing some well-known levels of incomputability.
We work in the Weihrauch lattice, which has become a widespread tool to classify the level of incomputability of mathematical problems from several branches of classical mathematics since [16]. Intuitively, given two (multi-valued) functions f and g on represented spaces, f is Weihrauch reducible to g if f can be computed by g, with computable translations from to , and, viceversa, from to , allowed. (More details are in §2.2 below.)
Recall that in this approach mathematical objects are encoded by sequences of infinite length whose information is based on the topological properties of the underlying spaces. For example, (for a fixed ) is naturally represented by an effective Cauchy sequence in converging to x. But if we want to project x onto a subset of we of course also need a suitable encoding for the set. We focus our investigation on closed sets (although we will also mention the special case of compact sets) and their standard topologies. The so-called negative representation for closed sets is based on the lower Fell topology and consists in enumerating an open cover of the complement. In contrast, their positive representation is based on the upper Fell topology and consists, for nonempty closed sets, in enumerating dense sequences of points in them. Finally, the total representation, corresponding to the Fell topology, is obtained by combining both kinds of information ([27]). More details about these representations will be given in §2.1 below. We thus obtain different projection operators, depending on the representation chosen for the closed set.
In the literature ([3,20]) it has been proved that the projection operators, for some metric spaces and closed sets with optimal conditions (such as convexity, boundedness of A, uniqueness of the solution) are computable. But what happens when such optimal conditions fail? It is not surprising that the problem is then no longer computably solvable for any of the above mentioned representations on closed sets, so the goal becomes the classification, depending on the type of information involved, of the corresponding degrees of incomputability in the Weihrauch lattice.
In many concrete applications one may be content already with approximations of arbitrarily accurate precision. In other words, we investigate the computational complexity of operators selecting points such that for some fixed . Intuitively, we expect that the loss of accuracy results in a simpler computational complexity. We indeed prove that these operators are simpler than their exact counterparts, but still not computable for negative and positive representations of closed sets. In contrast, the approximate projection operators with total information are computable.
Table 1 summarizes our main results. Quite surprisingly, it turns out that in most cases the (approximate) projection operators are Weihrauch complete with respect to some fundamental computational class which is represented in the last column by its emblematic representative, already studied in the literature, and defined in §2.3 below. In other words, the notion of projection allows us, by varying the kind of projection, the representation of the closed sets, and the dimension of the space, to characterize some of the most fundamental degrees in the Weihrauch lattice. In all cases, we obtain a characterization in terms of previously studied Weihrauch degrees.
Summary of main results: The first column indicates the kind of projection, the second column the representation of the closed sets, the third one the dimension of the Euclidean space , the fourth one our results, and the last one the references to the results in this paper where the results are proved
It is also remarkable that, as far as exact projections are concerned, negative or positive information for closed sets can be used interchangeably, as this has no effect in the classification obtained with respect to any given dimension . The difference between negative and positive information only arises when approximations are allowed. Here, the relevant degrees are even incomparable (Corollary 5.9).
To see that the approximate projections are of practical importance we suggest a concrete application, which is actually the original motivation for our research. The Whitney Extension Theorem was originally proved in [31] and, roughly speaking, generalizes the well-known Urysohn-Tietze Extension Lemma to the case of differentiable functions. An expository paper on modern developments concerning the Whitney Extension Theorem and its generalizations is [15]. By using approximate projections in place of the exact ones originally used in the proof of the Whitney Extension Theorem as exposed in the classical textbook [28],1
Stein himself suggests on p.172 the possibility of using approximate projections, although our use probably is not the one he was foreseeing.
we sketch the computability of this theorem. Full details of this result are postponed to a forthcoming paper [17].
We now explain the organization of the paper. In Section 2 we give a brief introduction to computable analysis, introduce the representations we will be using throughout the paper, and recall Weihrauch reducibility and some milestones in the Weihrauch lattice. Section 3 provides a new characterization of the Weihrauch degree of the function Sort, introduced by Neumann and Pauly ([21]). Sections 4 and 5 are the core of the paper and are devoted respectively to the exact and approximated projection operators: after defining them we prove the results summarized in Table 1. In Section 6 we briefly sketch the application of approximate projections to the Whitney Extension Theorem.
Computable analysis: Notation and terminology
This Section recalls basic definitions and terminology of computable analysis and of Weihrauch reducibilities (see [11] for a self-contained introduction to the subject). The reader familiar with the topics can safely skip it and refer back to this section as needed.
We work in the framework is the so called Type-2 Theory of Effectivity (TTE), which finds a systematic foundation in [30] and provides a realistic and flexible model of computation. The salient features of TTE Turing machines are that they work on infinite sequences of bits and that no correction is allowed on the output. A partial function is computable if it is in computed by some TTE Turing machine. An immediate consequence of the restraint concerning the output is that all computable functions are continuous.
Representations
To extend the notion of computability to functions between spaces different from we need the notion of representation. Recall that a representation of a set X is a surjective function , and in this case we say that the pair is a represented space. If a -name for x is any such that . By routine syntactic pairing techniques it is straightforward to obtain representations for finite and countably infinite product of represented spaces.
Given represented spaces and and a partial multi-valued function , we say that is a -realizer of f (and write ) if , for all . We can now say that a function between represented spaces is computable if it has a computable realizer.
For representations and of the same set X, we say that is computably reducible to (we write ) if there is a computable such that for every we have . If and , the two representations are computably equivalent ().
The general notion of representation is too broad for practical purposes. Concretely, representations are associated to the final topologies they induce on the represented space, and usually admissible representations for -spaces are considered. Such representations are those that make the use of realizers meaningful: if X and Y are admissibly represented, a single valued is continuous if and only if it admits a continuous realizer with respect to the Baire topology (see [30] and [25] for introductions to the theory of admissible representations).
An important example is the Cauchy representation which is admissible with respect to the topology of a separable (computable) metric space.
(Computable metric spaces).
A computable metric space is a triple , where d is a metric on X, is a dense sequence in X, and is a computable double sequence in . We then represent X by the Cauchy representation , defined by
When we say that is an effective Cauchy sequence, and that it converges effectively to x.
Notice that with this representation, the metric is computable.
A particularly important example is provided by the Euclidean spaces , which are computable metric spaces when we fix a function enumerating in an effective way . Here is the usual Euclidean metric.
By using the same effective numbering , there are other ways to represent real numbers, by changing the underlying topology over . The representation is given by iff , and analogously is given by iff . These two representations are admissible with respect to the topologies and whose open sets are of the form and respectively (see [30] for more details).
Given a computable metric space we can effectively enumerate the open balls with center in and rational radius in an obvious way using a computable pairing function: to we associate the open ball , where is a standard enumeration of the nonnegative rational numbers (notice that when ). We call these sets open basic balls. We denote the closed ball by or (notice that in general this is not the same as the closure of , although in they coincide).
(Closed set representations).
Let be a computable metric space.
By we denote the hyperspace of closed subsets of X equipped with the negative information representation such that
By we denote the hyperspace of closed subsets of X equipped with the positive information representation such that
Finally, by we denote the hyperspace of closed subsets of X equipped with the total information representation , that is
It is clear from Definitions 2.1 and 2.2 that we can view A as an element of if and only if we can semi-decide whether for every . This means that to show that (a name for) some can be computed from some input z it suffices to give a definition of A by a formula with parameter z.
It is well known that the operations are computable, as well as .
Closed sets with positive information are also known in the literature as overt sets (see [25] for a discussion of nomenclature).
By [13, Theorems 3.7 and 3.8], in every complete computable metric space , the positive information representation for nonempty closed sets is equivalent to the representation which assigns to a name the set . See also [30, Lemma 5.1.10] for the case .
As for the negative information, in the Euclidean space this is equivalent to the representation encoding a closed by enumerating all k such that ([30, Lemma 5.1.10]).
We are also interested in representing the space of the compact subsets of a fixed computable metric space.
(Compact set representations).
Let be a computable metric space. By we denote the hyperspace of compact subsets of X equipped with the negative information representation such that:
Analogously, one defines the hyperspace of compact subsets of X equipped with the positive information representation , and the hyperspace of compact subsets of X equipped with the total information representation , by replacing with and , respectively.
In the case of the Euclidean space , the balls can be more simply replaced by a single ball , for , satisfying (in agreement with [30, Definition 5.2.1]).
Abstracting from the purely syntactic elements, representations often denote objects by enumerating sequences of objects. Therefore one is often allowed to skip the annoying linguistic aspects by describing the represented element directly through the corresponding sequence of objects. For instance, we see a point x in a metric space directly as , where, for all i, with respect to some given Cauchy-name p of x. Analogously, we can describe a closed set directly as , by meaning that (which really should be ) is the i-th rational open ball enumerated by some -name of A.
Weihrauch reducibility
The original definition of Weihrauch reducibility between functions over represented spaces is due to Weihrauch in an unpublished report from 1992, and in the next decade the notion was explored in several thesis by some of Weihrauch’s students. The authors [16] extended Weihrauch reducibility to multi-valued functions. Let and be partial multi-valued functions between represented spaces. We say that f is Weihrauch reducible to g, and write , if there are computable and such that whenever (here is the identity function on Baire space).
The intuition behind the definition is that means that the problem of computing f can be computably and uniformly solved by using in each instance a single computation of g: K modifies (each name for) the input of f to feed it to g, while H, using also the original input, transforms (any name for) the output of g into (a name for) the correct output of f. Another characterization of Weihrauch reducibility is provided by the fact that if and only if there is a Turing machine that computes f using g as an oracle exactly once during its infinite computation [29].
A direct consequence of the definition of Weihrauch reducibility is the following Invariance Principle: implies that for any given -name p of some there is some with a -name q such that (here denotes the usual Turing reducibility). In other words, provides an upper bound for the computational complexity of (some element in) .
The relation is reflexive and transitive and induces an equivalence relation denoted by . The partial order on the sets of -equivalence classes (called Weihrauch degrees) is a distributive bounded lattice [5,23] with several natural and useful algebraic operations [10]. As usual, we use to denote and , and to denote and .
The Weihrauch lattice can be used as a tool for comparing multi-valued functions arising from theorems from different areas of mathematics, once the theorems are translated into mathematical problems on represented spaces. This line of research has blossomed in the last few years [1,2,5–10,14,16,23,24] and this paper contributes to it by classifying the projection operators.
In some cases, one can prove the reducibility of f to g by using a computable K that does not access to the original input, that is, we have whenever . In this case we say that f is strongly Weihrauch reducible to g and write . We then use for the induced equivalence relation.
We notice that always hold, whereas holds when g is a cylinder, that is , where id is the identity function on the Baire space.
Some milestones in the Weihrauch lattice
Multi-valued functions can be seen as problems: given , find a . The algebraic structure of the Weihrauch lattice can provide a useful tool to determine the computational complexity of fundamental mathematical problems which are not computable, at least in the standard TTE-model. A typical example is to find the derivative of a differentiable real function. Other paradigmatic problems are those provided by fundamental theorems of classical mathematics. The idea here is to see a statement of the form as defining the multi-valued function with domain and . It turns out that the Weihrauch degree of many mathematical problems can be evaluated with the help of few operators. Relevant for our work are the following:
, the computational version of the limited principle of omniscience of constructive mathematics defined by if and if ;
, the computational version of the lesser limited principle of omniscience of constructive mathematics defined by iff , where for at most one and one it holds ;
, the Weak König’s Lemma operator, mapping each infinite binary tree to its infinite paths; here a tree is represented by its characteristic function , that is, iff for a recursive enumeration of all finite binary words;
, the closed choice operators, selecting members from any given non-empty closed set (encoded by negative information) in a computable metric space X;
, the compact choice operators, selecting members from any given non-empty compact set (encoded by negative information) in a computable metric space X;
, , for every convergent sequence in the Baire space;
, the Bolzano–Weierstraß Theorem operators, that maps every sequence with compact range in a computable metric space X to its accumulation points.
For instance, the problem of finding the derivative of f is Weihrauch equivalent to lim. As for , , and , we obtain very important cases when we set or . For example, the (contrapositive of) the Baire Category Theorem is Weihrauch equivalent to . See [11] for a general overview of this program of classification of mathematical problems and for further references.
It is well known that (where ) and .
A multi-valued function f is called non deterministically computable if , computable with finitely many mind changes if , and limit computable if . This terminology arises from the non standard models of computation that make such f computable. For instance, f is computable with finitely many mind changes if it can be computed by a non standard TTE-machine that is allowed to revise the output with the restraint that only finitely many corrections can occur. See [11] for more details and further references.
Some degrees can be seen as the parallelization or composition of other degrees. The parallelization of of is defined as . We have for example and . It is known that parallelization is a closure operator, that is , , and .
The composition of multi-valued functions is defined so that the range of the first function not necessarily has to be included in the domain of the second function. Intuitively, some computational transformation is allowed so that the two spaces can match. It is easier to define such compositional product as an operation on degrees2
The introduction of the compositional product as a specific function is more involved (see [12], [11, Definition 5.3]) and not relevant for this paper.
by
Here the leftmost occurrences of f and g must be understood as denoting the corresponding degrees, and the maximum as a degree defined by the partial order induced on the Weihrauch degrees by . (Notice that the Weihrauch lattice is not complete, but the max above always exists by [12, Corollary 18], [11, Theorem 5.2].) It holds then
These equivalences justify the following terminology: is said to be non deterministically limit computable and is said to be non deterministically computable with finitely many mind changes.
Finally, some degrees can be seen as jumps of others. Given a multi-valued function on represented spaces , , the jump of f coincides with f but the representation of X is weakened into the representation , where and iff . It holds then and .
Notice that lim is a cylinder, hence , and the same holds for WKL and .
The functions Sort and
In [21] Neumann and Pauly introduced the function defined as
Our results support the importance of this function, so that one might see it as a candidate for a new possible milestone in the Weihrauch lattice. To this end we first show that Sort is strongly Weihrauch equivalent to another natural function.
Consider the space
This space is seen as a subspace of the represented space , hence its members are represented as real numbers via Cauchy sequences of elements of the dense set of rationals in , i.e., itself.
It is easy to see that this Cauchy representation is computably equivalent to the representation with and
To see that , take any -name p of and consider the Cauchy sequence such that if for all , and if for a (unique) . For the opposite reduction, let converge effectively to x. To obtain a -name p of x just put if and otherwise. Intuitively, according to the representation a name of is a (computable!) oracle that for every replies “yes” or “no” to the question “is ?”; if the answer is always “no” then .
It is often more convenient to represent by . However, when representing the space of closed subsets of we will view as a computable metric space and use the standard enumeration of the basic open balls , for and q a nonnegative rational number, to obtain the representation of .
As a subset of , is also well-ordered by the usual order <. The single valued function mapping A to is then defined for every .
.
We first show that . Given we construct a set that will provide us with the necessary information to compute . More precisely, we define , where if , , contains exactly n occurrences of 0. Let now r be a -name of . By construction, if 0 occurs exactly n times in p. We obtain then as follows. We inspect r and as long as , we let , so that if for all . As soon as we find an n such that , then we let for every , so that in the end .
To prove argue as follows. Let be given as input to . Our strategy consists simply in choosing at any stage s the smallest element of not contained in and we want to write an input for Sort that reflects our choice. At stage 0 let then be the least element of not contained in . If this is 0, then we write . Otherwise, let it be for some . Then we put as initial segment of the input r of Sort. At stage we consider the sets . Let be the least element not contained in , and let w be the initial segment of r obtained at stage k. If , then we let . Otherwise, if for some we extend w so to obtain a finite prefix with containing exactly occurrences of 0 (possibly ). In the end, by construction, r contains exactly n occurrences of 0 if for some , and r contains infinitely many 0 if . We now inspect to compute a -name q of . Recall that if r contains infinitely many occurrences of 0, that is, , otherwise if r contains exactly n occurrences of 0, that is, . Therefore, to obtain a correct -name q, we let as long as . If suddenly , then we let and for all . In this way we obtain exactly the -name of . □
Using Proposition 3.1, we now study the degree of Sort in more detail. The following result is given already in Proposition 24 of [21] but we give here a more direct proof of the same result in terms of computability with finitely many mind changes using .
To prove , consider the operator , , for , which is known to be Weihrauch equivalent to by [26, Lemma 2.3]. We obtain (for the rightmost reduction observe that the map from to is clearly computable).
To prove that , we will show that is not computable with finitely many mind changes.
Let p indeed be a -name of a nonempty closed . The task is to output the minimal element in A. Suppose that p lists only open balls of the type for various . If the sequence encoded by p will in the end contain every open ball of the form , the temporary choice of any element of the form will sooner or later force us to select a larger candidate. In this case we obtain the name of the correct output 0 only after infinitely many mind changes.
We should therefore choose 0 as the eventual output at some stage s, when only a finite initial segment of p has been read. However, this output is incorrect if the sequence encoded by p never mentions a specific element , which is possible on the basis of the finite initial segment of p read by the computation at sage s. □
The next result is also given in Proposition 24 of [21]:
.
It is easy to see that . To prove that the opposite reduction does not hold, apply the Invariance Principle: Sort has only computable outputs, whereas lim maps some computable input to an incomputable output. □
For the following results, we need the Bolzano Weierstraß operators , with for , and the operators , which are the restrictions of the operators to the sequences with compact range for which the accumulation point is unique.
For every , .
would imply by Proposition 3.2. Since by [10, Corollary 11.24] and obviously , this would in turn imply , which is impossible by [10, Proposition 13.9]. □
We now show that Sort is not non deterministically computable with finitely many mind changes:
Recall that an operation f is non-uniformly computable, if contains a computable solution for all computable x. A Weihrauch degree f is called low, if . Both properties are preserved downwards under Weihrauch reduction.
Notice that Sort is non-uniformly computable as all solutions are computable. Moreover computes the characteristic function of the -complete set
Therefore . Since and ∗ is monotone, it follows that Sort is not low. On the other hand, is low by [2, Theorem 8.7], but not non-uniformly computable because and there exist computable infinite binary trees without computable infinite branches. The incomparability of Sort and then follows immediately. □
Exact projections operators
We start with the formal definition of the exact projection operators.
Given a metric space X, a point and a nonempty set we say that is a projection point of x onto A if (where, as usual, ). In other words, the projection points of x onto A are the points of A with minimal distance from x.
Notice that if then x itself is the unique projection point of x onto A. Obviously, projection points of x onto A exist if and only if the infimum in the definition of is actually a minimum. We will be mostly interested in the case where is a Euclidean space and A is closed; in this situation projection points of any onto A do exist.
If X is a computable metric space, projections points give rise to several multi-valued functions, depending on the representation of , which we will always assume to be at least closed.
Given a computable metric space X the (exact) negative, positive and total closed projection operators on X are the partial multi-valued functions , and which associate to every (with Cauchy representation) and every closed (with negative, positive and total representation, respectively) the set of the projection points of x onto A.
Thus , , and .
The (exact) negative, positive and total projections operators for compact sets are defined by replacing , , and with , , and respectively. These are denoted , , and .
The first obvious observation is that the negative projection operators compute the corresponding choice operators.
and for all computable metric spaces X.
Projections on compact sets are special cases of projections on closed sets.
For all computable metric spaces X:
,
,
.
The proof follows immediately by the definition of the representations. □
In some important cases, the inverse reduction holds as well. In the next result, a computable metric space X is computably compact when it is computable as a member of , that is, it has some computable -name (or, equivalently, of ).
For all computably compact metric spaces X:
,
,
.
The inverse reductions of Fact 4.4 can be obtained by fixing a finite cover of X by basic balls and use it to show that , , and are computable. □
For :
,
,
.
The inverse reductions of Fact 4.4 can be obtained as follows.
We first deal with the positive representation. According to Remark 2.3, let and . By [30, Lemma 5.1.7] we can compute as an element of , hence we can determine a (natural) . Given x we can also determine an upper bound for . Let . Using Remark 2.5, and since clearly , it suffices to compute a dense sequence in K. This is not difficult, starting from the positive information for A: we list all points in with distance from 0 strictly less than . Notice that all projection points of x onto A belong to K. Obviously, these points also are projections points of x onto K, so that an application of to this new set releases a correct result.
We now deal with the total representation. Let then be given. We want to compute, as a suitable input for , some compact L with total information such that the projections points of x onto L should be also projection points of x onto A. However, we cannot set (with K the same of the previous case). This is because the possible elements in that are not accumulation points of the dense set enumerated in K do not belong to K, but they are inevitably preserved by the negative information on A and on . Thus, the two descriptions needed to provide the total information of K can fail to be coherent. To obtain consistent information for both types of information, we add to K the whole set . Therefore we define L to be
The left hand term of the equation guarantees that a -name of L can be effectively obtained, while the right hand side guarantees the same with respect to a - name. Finally, use Remark 2.5 and the fact that to obtain a -name of L as a member of .
We now consider the negative representation with the goal of showing that . We make use of the homeomorphism f between and the open ball defined by
We claim that f is computable. The critical points are the vectors t close to 0, but we can handle them as follows: until the test fails and the parallel test succeeds, we let . Notice in fact, that for all (including 0), . Analogously, one can prove that is also computable.
Now suppose we are given . We compute a compact set as follows. The main idea is to use f to rescale A within the compact . However, the function f produces unavoidable metric distortions, as f-images get closer to each other the more the original points are far from the origin. Hence, projections points of onto do not necessarily correspond to f-images of the projection points of x onto A. To solve this problem, we first translate the space so that x becomes the origin: in this way, the order relationships between distances from x are preserved by f. To take into account that possible “infinity points” of A get mapped to points on we add the whole to our compact set. Therefore we set
The second line provides a definition of H with A and x as parameters, and hence (a name for) is computed from (a name for) x and . Since , by Remark 2.5 we have .
Since and , the monotonicity of arctan implies that if and only if for all . Thus the members of are exactly those of the form for some . Therefore from we can compute . Notice that we are using x (which is part of the original input) in this final computation, so that we do not prove . □
Since we are interested mainly in projections in Euclidean spaces, Theorem 4.6 allows us to concentrate on operators for closed sets.
The proof of the next theorem shows that we can obtain upper bounds for all three exact projection operators by using essentially the same argument.
For , and are non deterministically limit computable, that is , .
For , is non deterministically computable, that is .
We first show (2). Given and we can compute by [30, Lemma 5.1.7]. We use this distance to compute first as an element in , and then . This set obviously consists precisely of all projection points of x onto A.
We use then an upper bound N of and an upper bound M of to translate into an element of : it holds in fact that .
Finally, to determine a projection point of x onto A, it suffices to select a point from this compact set. This is the only non computable step in the construction, but it is non deterministically computable by [6, Theorem 2.10]. This shows , and follows because WKL is a cylinder.
When A is not provided with total information, we can initially use lim to obtain the total information about A. For the input , this follows by [4, Proposition 4.2]. For the input this follows by [4, Proposition 4.5] (since is effectively locally compact). The remainder of the process remains unaltered. Therefore, the negative and the positive projection operators can be simulated by composing a limit computable procedure with a non deterministically computable one, i.e., they are non deterministically limit computable.
By [10, Corollary 11.19] this means that , and again, since is a cylinder (see [10, Corollary 11.13]), we obtain , . □
Exact negative projection operators
In the previous section we have seen that . But is this reduction in fact an equivalence? This is indeed the case for as the following result shows:
for .
Recall that by [10, Corollary 11.7], . Hence we can substitute in the proof by . Moreover, it suffices to work with because the results for follow by transitivity of as .
Fix the usual (and computable, by [7, Lemma 7.1]) embedding . Moreover, let be computable and such that iff for every .
Throughout this proof it is convenient to represent points of in polar coordinates (which we will write ). This does not cause any problem, because we use only points with radial coordinate not smaller than 1 and angular coordinate in the interval : for such points both directions of the conversion between Cartesian and polar coordinates are computable.
Without loss of generality, we are given as input a sequence of trees converging to an infinite binary tree T and we want to find, using , an infinite path in T. To achieve this goal we compute a closed subset B of such that if , then is an infinite path in T. B is defined as the intersection of closed sets .
To describe the , for each and , let us denote by the closed set (here, as usual, denotes that the finite binary string w is an initial segment of ). In words, is obtained by removing from A the inner slice up to in the w-direction.
At stage s, for every we let be the cardinality of the set
We then define, for every ,
Eventually, we let
In this way we compute and we need to show that if then is a path in T.
Since converges, for every k the sequence is non-decreasing and eventually takes a constant value . Therefore the sequences and stabilize at and respectively.
If then the ray starting at 0 and moving in direction meets B at distance from 0. To see this notice first that if then . Thus, even when for some with we deleted the ray in direction up to , at some later stage (such that and so ) the deletion up to superseded it.
If instead and ℓ is least such that then the ray starting at 0 and moving in direction meets B at distance from 0 (because at a stage s such that we delete the ray up to distance ).
It thus suffices to check that for every ℓ. Indeed we have
Thus every point in is in direction for some , as required. □
For case we do not obtain the full power of . We can prove however that a characterization for the one dimensional case can be found in terms of . As a preliminary result, we prove:
.
Analogously to the treatment of negative information in the proof of Theorem 4.6, given and we can compute the set
Notice that for such a set both
always exist, which would not hold true in general for our original A. Moreover . Since , for all . More precisely, as in the proof of Theorem 4.6, the members of are exactly those of the form for some . Recalling that we can determine ℓ as an element of and r as an element of . We then use to obtain . Let now denote as the function mapping any given for which the elements ℓ, r defined as above exist to the pair . We have then just proved that .
Consider now the function such that and . It is easy to see that (an application of LLPO finds such that , then we use the input of , which is still available by definition of , to recover the value of ).
Let now . Then, in virtue of what observed above, .
This shows that (the transformation was indeed computable uniformly in and notice also that, by definition of , the original is still available after the application of , hence it can be used to compute ).
By definition of compositional product, for every and . Therefore . □
For the next result we need to use the Sierpinski space and its ordinary admissible representation:
(Sierpinski space).
The Sierpinski space is given by the topology on the set .
As a represented space, the Sierpinski space is equipped with the representation and for .
In other words, LPO can be seen as the identity function , , where the codomain is equipped with the discrete topology.
.
Consider the space . As , for the identity function we find that , as obviously and moreover ([5, Lemma 6.3], [11, Theorem 6.7]). In the statement we can thus replace lim with .
Notice now that the computable embedding we already used in the proof of Theorem 4.8 gives naturally rise to a corresponding computable embedding . Recall that ι preserves the order on binary sequences, hence does the same.
Finally, observe that , the lifted version of Sort such that coincides with , is computable.
In the following, by notational abuse, we identify with , that is, we will not distinguish a binary sequence from any such that . This produces no ambiguity for and that still remain single-valued, whereas the single-valuedness of can be preserved by its replacement with a computable realizer. For instance, we will see as defined by , and as being of the form with .
Now, given inputs , we compute and , where
for and . Since coincides with for all , we notice that if and only if only if p contains infinitely many 0 (in this case indeed ), and if and only if p contains infinitely many 1 (in this case indeed ).
Given now and , we can compute
From we can use to compute and then . Moreover, the sign of y yields a valid answer to (notice that the sign of , is always decidable, as they are necessarily different from 0, which is not necessarily the case for ℓ and r). □
Through the notion of jump that we recalled in Section 2.3 we are now able to characterize in terms of :
.
This follows by Proposition 4.10 and Lemma 4.12, since ([10, Corollary 11.11]) and since for generic multi-valued functions f it holds . □
Exact positive projection operators
Quite surprisingly, for the projections with positive information for closed sets we obtain the same characterizations obtained for the case of negative information. We start with the dimensions for which we are still able to prove the equivalence with :
for .
We prove the statement for . As before, the results for follow by transitivity of as . As in the proof of Theorem 4.8, also here it is convenient to represent points of in polar coordinates. In this case we use only points with radial coordinate not smaller than 1 and angular coordinate in the interval , so that again for our purposes both directions of the conversion between Cartesian and polar coordinates are computable.
Let be given as input. We want to find a cluster point of this sequence. We consider the points . Let now . Notice that because is bounded, while if and only if is a cluster point of . Thus if then and . □
For , by reasoning analogously to the case of negative information, we obtain the same characterization in terms of . We start with the following result, which is an analoguous of Proposition 4.10:
.
Let and be given. We can now compute
Notice that both and always exist, which would not hold true in general for our original A. Moreover . Recalling that we can determine ℓ as an element of and r as an element of . Analogously to the proof of Proposition 4.10, we can then use to obtain and consequently LLPO to determine such that . As observed, this gives a member of . □
.
The proof is almost the same of that of Lemma 4.12. But the replacement of the negative representation for closed sets with its dual requires to switch the positions of ℓ and r with respect to 0. We compute then the new set . From we can then extract q. Moreover, given the sign of y, we will select 0 or 1 as accumulation point of the input sequence by making the dual choice with respect to that of the proof of Lemma 4.12. □
.
This follows by Proposition 4.16 and Lemma 4.17, analogously to the proof of Corollary 4.13. □
Exact total projection operators
For the case of total information we can fully characterize the Weihrauch degree of already for . We start by determining the following upper bound:
.
Let the input be given with . It holds obviously that , and in fact for . By using the total information on A we can compute the exact value of r via approximations that become at every stage more reliable. We produce then a valid input for LLPO in the following way. At stage s, by considering the initial segment of the negative information on A that we have read so far, if both points and still are plausible candidates as members of A we let . Otherwise, suppose that we realize that one of the two points, say , is not in A. Then we put . We then let for all . If instead we realize that then we switch the roles of and .
Given now we compute (again) or , depending on whether or , finding an element of . □
Notice that in the above proof the use of the original input after the application of LLPO is essential: cannot hold for mere cardinality reasons. But the opposite reduction even holds for the strong version of Weihrauch reducibility:
.
Let . We construct then a valid input for according to the following idea: if a point of is negative, then , and if a point of is positive, then . If we do this then by checking the sign of an element of we determine an element of .
The construction of A proceeds as follows. We immediately remove from A the intervals , and . Then we activate the following inductive procedure. Suppose that at stage it holds for all . We add then to A the points and . At the same time we remove from A the intervals and . Otherwise, let s be the first stage in which a digit different from 0 appears in , say, . We want then the closest point of A to 0 to be positive. To this aim, we add to A the point alone. Moreover, we remove from A the intervals , (notice that 0 was removed from A already before the start of the inductive procedure), and . In this case the description of A is complete after stage s. The case is analogous. □
For we see instead that a precise characterisation is given by WKL.
for .
We prove the statement for by replacing WKL through its well known strongly Weihrauch equivalent version (see [2, Corollary 4.6]). The cases are then as usual proved by transitivity of .
Let then be given, which means that we are provided with a sequence of rational open intervals such that . We now construct the new closed set as the set of all points (with polar coordinates, as in the proofs of Theorem 4.8 and Proposition 4.14) satisfying the following three conditions:
,
,
.
Intuitively, we draw in part of the circular crown between the circles of radius 1 and 2 centered at the origin. We then remove around a point a little open portion of the crown as soon as we know that (see Fig. 1).
The construction of the set in the proof of Theorem 4.22: Here overlap.
It is immediate to see that if then and . Hence it remains to prove that we can compute a name of .
To see that (a name for) K as an element of is computable from (the given name for) A, observe that all the conditions (1)–(3) are in .
To see that also (a name for) K as an element of is computable from (the given name for) A, observe that K is the closure of the set
We claim that we can enumerate, and even decide, this subset of effectively from . The conditions and are immediately decidable for rational numbers. Hence, to determine whether it remains only to analyze the condition (3) in the definition of K. To this aim, for , let then be minimal such that . Then, for condition (3) is equivalent to . Since r and α are rational numbers, we can find effectively such m and then decide whether .
Therefore the set C is decidable and we can enumerate its members (as pairs of real numbers) for the positive information on K. □
Since, as we have seen, the (exact) projection operators are computationally quite hard, it might be reasonable to consider some approximate versions of them. In many practical circumstances, we may indeed be content of finding points that lie at a distance comparable with the smallest one.
Given a metric space X, , a point and a nonempty set we say that is a ε-projection point of x onto A if . In other words, the ε-projection points of x onto A are the points of A which are at minimal distance from x up to an error of ε times the distance itself.
Notice that if then for any ε, x is the unique ε-projection point of x onto A. In general, for any ε, ε-projection points of x onto A exist unless . As when dealing with exact projections, we will be interested in the case where A is closed; in this situation ε-projection points of any onto A do exist for any ε. If X is a computable metric space, the multi-valued functions arising from ε-projections points and depending on the representation of are defined similarly to their exact counterparts.
Given a computable metric space X and the ε-approximate negative, positive and total closed projection operators on X are the partial multi-valued functions , and which associate to every (with Cauchy representation) and every closed (with negative, positive and total representation, respectively) the set of the ε-projection points of x onto A.
Thus , , and .
The ε-approximate negative, positive and total projections operators for compact sets are defined by replacing , , and with , , and respectively. These are denoted , , and .
The first observations about the approximated operators partly mimic the ones we made for the exact operators.
Let X be a computable metric space and .
If then where P is any of , , , , , .
and .
, , .
If X is computably compact , , .
, for .
(1) and (2) are obvious.
(3) and (4) can be proved exactly as Facts 4.4 and 4.5 respectively: indeed those proofs consist of transformations of the input and do not use any specific feature of the functions involved.
(5) follows from the proofs of the analogous results in Theorem 4.6, since the ε-projection points of x onto the compact sets K and L constructed there are also ε-projection points of x onto the original closed set A. □
Notice that in (5) above is missing – we show below in Proposition 5.5 that this does not hold. The proof of the analogous result in Theorem 4.6 cannot be translated to the approximate setting. Indeed if we repeat that construction then to obtain the ε-projection points of x onto A we need to have a -projection point of x onto H for
Hence no specific will work for all x and A. Even viewing ε as part of the input we do not solve the problem: from the negative information on A we obtain only lower bounds for .
Approximated negative projection operators
The following results characterizes the computational complexity of negative approximated projection operators on for all .
For every and , .
For the right-to-left direction, observe that by Fact 5.3.(2).
For the other direction, consider an input . Since we can compute , we denote by the strict lower bound for computed at stage s, so that . We set .
We now define the negative closed set
To see that we can compute a -name of B observe that B is defined by a -formula with A as a parameter.
Intuitively, B is constituted by “copies” of different subsets of translated onto different levels of the space , so that (i) each copy lies at distance 1 from the adjacent copies, (ii) on the s-th level we remove the points of A that are “too far” from x according to the approximation of that we know at that stage. Notice that the s-th level of B is nonempty if and only if , and this happens for some s (for all s when ) because . Therefore is a valid input for .
If , then because . We have shown . Finally by [2, Corollary 4.9]. □
For we only state the bounds given in the following proposition. We recall the use of the finite-parallelization operator that maps any given multi-valued to defined as for all .
For every and ,
The first inequality follows from Fact 5.3.(2) and the fact that by [5, Theorem 8.5].
We proceed to show that :
Given an input , we can use LPO to decide whether or not . If yes, we can output x. If no, we can compute a lower bound . Since we know K as a compact set, we can subsequently compute some such that . Consider the slices , which we can effectively compute as closed sets. We can use to decide for each whether (as we have K, and thus also as a compact set). Let be the least positive answer (if it exists), or L otherwise. Then is available as a non-empty compact set, and each of its elements (chosen by ) is a valid output for .
That is straightforward, e.g. via the independent choice theorem implying the closure under compositional product of the class of non deterministic functions with finitely many mind changes ([2, Theorem 7.6]). To see that this is strict, we observe that . Since the degree of admits a single-valued representative (for example unique choice [2]), the closed choice elimination theorem (as stated in [19, Theorem 2.1]) implies that if , then . That this is impossible can be seen using Hertling’s level [18], which is an ordinal invariant of Weihrauch degrees defined as follows: Given a function f, let , let be the closure of the set of discontinuity points of , and for limit ordinal γ, let . The level of f is the least α such that (if this ever happens). The level of does not exist [22], whereas has level at most . □
Notice that our proof shows in fact that
and hence , for every computable metric space X.
Approximated positive projection operators
For every and , .
By Proposition 3.1 it suffices to show that and by Fact 5.3.1 we can assume that ε is computable. Given let
This is a -condition, hence A is computable from as a nonempty member of .
Let now and notice that:
if then by the definition of A we have ;
if then and inductively we can prove that for every k there exists n such that which implies ; hence .
We need to show that from z and the original input we can compute an effective Cauchy sequence converging to a point . To compute set and start a recursive procedure which will stop after finitely many steps. Given use (the name of) z to check whether there exists such that ; in this case we stop the recursion. If instead for every it follows that and hence there exists such that . Since this is a property, we can search for such a until we find one. The recursion will stop when either we find such that or we see that (if the first alternative never occurs, such a k exists since because ). In the first case let , while in the second case let .
It is clear from the construction that if and we have for every . This implies that if for some s we have with then the sequence converges to , which belongs to by (1) above. If instead for every s the first possibility never occurs it means that , so that by (2) , and indeed converges to x.
However, the convergence of does not suffice, and we need to check that we actually defined an effective Cauchy sequence. For this it suffices to show that for every s. This is obvious if , and . Now assume that neither nor have been defined using . In other words, and where and . Then
The last possibility (by the observation above) is that with and with . In this case notice that, since , we have . Then
□
As usual, it suffices to show the reduction for . Fix such that and notice that . Given closed and nonempty in , with rational open balls in , we compute a sequence in by setting for the least k such that if such a k exists, and otherwise setting .
If , then for every , which implies . Hence .
If instead then is the least natural number such that and is a discrete subset of the closed interval . In fact, for all n, for some and, for n sufficiently large, . This implies that . Moreover, if then for some and hence
and thus . We thus showed that .
We have proved that is a singleton and we now show that its unique element y can be used to compute . Given then such , we produce the -name q of in the following way. For each s we check whether or not. Notice that this test is decidable because y belongs to and is not an accumulation point of this set. If the answer is positive, we put , otherwise . □
By Proposition 3.5, Theorem 5.4 and Corollary 5.8. □
Total approximated projection operators
Our classification of projection operators ends finally with a computable version of projection, that can be therefore used in concrete applications.
For every and , is computable.
By Fact 5.3.1 we can assume that ε is computable. We give an algorithm to determine some for every with .
We know already that total information on A allows us to compute , and then . We construct by induction an approximate projection point of x onto A as follows.
At stage we check whether
Notice that at least one of these two conditions holds, and we stop when we verify one of them. If (i) is verified before (ii), we let , and move to step . If instead (ii) is verified before (i), we inspect the dense sequence in A searching for some z such that (a suitable z always exists in this case) and then let for all .
We now show that the algorithm works. First we need to check that is an effective Cauchy sequence converging to some y, and to this end it suffices to check that for all s. This is trivial if at stage s and as well at stage the condition (i) is satisfied first, or alternatively if (ii) has been verified at some stage . The interesting case is therefore when (ii) is verified for the first time at stage . Then
We then need to check that . If (i) has always been verified, then , since . If at stage s (ii) is verified, then where z was picked so that . □
An application: The Whitney extension theorem
Projection points are often used in mathematics. An example is the Whitney Extension Theorem, originally proved in [31], and dealing with differentiable functions in . This theorem considers a real-valued continuous function f defined on a closed . Since A is closed, we cannot even attempt to compute the partial derivatives of f at many boundary points of A. However we can have also a set of continuous functions (the pseudo-derivatives of f) defined also on A which satisfy Taylor’s formulas and hence behave like the partial derivatives of degree of f (f and this set of functions are collectively called a jet). The Whitney Extension Theorem asserts that under these hypotheses f can be extended to some , so that g and its partial derivatives extend the elements of the jet.
A classical proof of the Whitney Extension Theorem is contained in [28, Chapter VI], and we follow Stein’s proof to provide a computable version. Starting with the closed set A, Stein defines a family of cubes tiling the complement of A and a partition of unity consisting of smooth functions. For each let be a projection point of the center of Q onto A. We then define the extension of f by
(Notice that, for a given A and after we fix , and , in fact we obtain a linear operator from the space of jets to .)
If A is given with total information, variations of and can be computed. Thus at first sight the only essentially non-computable step (by Proposition 4.20 and Theorem 4.22) in Stein’s proof is the choice of . To overcome this obstacle can be replaced with some other point of A which is close enough to Q, and “close enough” depends only from the size of Q. This suggests that the multi-valued functions naturally associated to the Whitney Extension Theorem are actually computable without resorting to any projections. However there is another, subtler, point that needs to be taken into account. In fact, in the definition by cases of g given above the case distinction is not computable. Thus we need to provide an effective way, given x and A, to compute without knowing whether . Here the projection operators, which are defined over , come back into the picture and appear to be essential: when we do not know positively that they are used to compute in a way that is compatible with both cases. Only by showing that approximate projections are indeed sufficient it is possible to find a computable version of the Whitney Extension Theorem.
Summing up, assuming A is represented with total information and using Theorem 5.10, we show that the multi-valued function associated to the Whitney Extension Theorem is computable. As mentioned in the introduction, full details of this result will be included in a forthcoming paper [17].
Footnotes
Acknowledgements
Marcone’s research partially supported by PRIN 2012 Grant “Logica, Modelli e Insiemi” and by the departmental PRID funding “HiWei – The higher levels of the Weihrauch hierarchy”.
References
1.
E.P.Astor, D.D.Dzhafarov, R.Solomon and J.Suggs, The uniform content of partial and linear orders, Ann. Pure Appl. Logic168(6) (2017), 1153–1171. doi:10.1016/j.apal.2016.11.010.
2.
V.Brattka, M.de Brecht and A.Pauly, Closed choice and a uniform low basis theorem, Ann. Pure Appl. Logic163(8) (2012), 986–1008. doi:10.1016/j.apal.2011.12.020.
3.
V.Brattka and R.Dillhage, Computability of finite-dimensional linear subspaces and best approximation, Ann. Pure Appl. Logic162(3) (2010), 182–193. doi:10.1016/j.apal.2010.09.011.
4.
V.Brattka and G.Gherardi, Borel complexity of topological operations on computable metric spaces, Jour. Log. and Comp.19(1) (2009), 45–76. doi:10.1093/logcom/exn027.
5.
V.Brattka and G.Gherardi, Weihrauch degrees, omniscience principles and weak computability, J. Symbolic Logic76(1) (2011), 143–176. doi:10.2178/jsl/1294170993.
6.
V.Brattka and G.Gherardi, Effective choice and boundedness principles in computable analysis, Bull. Symbolic Logic17(1) (2011), 73–117. doi:10.2178/bsl/1294186663.
7.
V.Brattka, G.Gherardi and R.Hölzl, Probabilistic computability and choice, Inform. and Comput.242 (2015), 249–286. doi:10.1016/j.ic.2015.03.005.
8.
V.Brattka, G.Gherardi and R.Hölzl, Las Vegas computability and algorithmic randomness, in: 32nd International Symposium on Theoretical Aspects of Computer Science, LIPIcs. Leibniz Int. Proc. Inform., Vol. 30, Schloss Dagstuhl. Leibniz-Zent. Inform., Wadern, 2015, pp. 130–142+1 unnumbered page.
9.
V.Brattka, G.Gherardi, R.Hölzl and A.Pauly, The Vitali covering theorem in the Weihrauch lattice, in: Computability and Complexity: Essays Dedicated to Rodney G. Downey on the Occasion of His 60th Birthday, A.Day, M.Fellows, N.Greenberg, B.Khoussainov, A.Melnikov and F.Rosamond, eds, Springer International Publishing, Cham, 2017, pp. 188–200, https://doi.org/10.1007/978-3-319-50062-1_14. ISBN 978-3-319-50062-1. doi:10.1007/978-3-319-50062-1_14.
10.
V.Brattka, G.Gherardi and A.Marcone, The Bolzano–Weierstrass theorem is the jump of weak Kőnig’s lemma, Ann. Pure Appl. Logic163(6) (2012), 623–655. doi:10.1016/j.apal.2011.10.006.
11.
V.Brattka, G.Gherardi and A.Pauly, Weihrauch complexity in computable analysis, in: Handbook of Computability and Complexity in Analysis, V.Brattka and P.Hertling, eds, Springer International Publishing, To appear. arXiv:1707.03202.
12.
V.Brattka and A.Pauly, On the algebraic structure of Weihrauch degrees, Logical Methods in Computer Science14 (2018). doi:10.23638/LMCS-14(4:4)2018.
13.
V.Brattka and G.Presser, Computability on subsets of metric spaces, Theoret. Comput. Sci.305(1–3) (2003), 43–76, Topology in computer science (Schloß Dagstuhl, 2000). doi:10.1016/S0304-3975(02)00693-X.
14.
F.G.Dorais, D.D.Dzhafarov, J.L.Hirst, J.R.Mileti and P.Shafer, On uniform relationships between combinatorial problems, Trans. Amer. Math. Soc.368(2) (2016), 1321–1359. doi:10.1090/tran/6465.
15.
C.Fefferman, Whitney’s extension problems and interpolation of data, Bull. Amer. Math. Soc. (N.S.)46(2) (2009), 207–220. doi:10.1090/S0273-0979-08-01240-8.
16.
G.Gherardi and A.Marcone, How incomputable is the separable Hahn–Banach theorem?, Notre Dame J. Form. Log.50(4) (2009), 393–425(2010). doi:10.1215/00294527-2009-018.
17.
G.Gherardi and A.Marcone, The Whitney Extension Theorem is computable, In preparation.
18.
P.Hertling, Unstetigkeitsgrade von Funktionen in der effektiven Analysis, PhD thesis, Fernuniversität, Gesamthochschule in Hagen, 1996.
19.
S.Le Roux and A.Pauly, Finite choice, convex choice and finding roots, Log. Meth. Comp. Sci.11(4:6) (2015), 1–30, https://lmcs.episciences.org/1607. doi:10.2168/LMCS-11(4:6)2015.
20.
E.Neumann, Computational problems in metric fixed point theory and their Weihrauch degrees, Log. Methods Comput. Sci.11(4) (2015), 4:20, 44. doi:10.2168/LMCS-11(4:20)2015.
21.
E.Neumann and A.Pauly, A topological view on algebraic computation models, Jour. Complex.44 (2018), 1–22. doi:10.1016/j.jco.2017.08.003.
22.
A.Pauly, Methoden zum Vergleich der Unstetigkeit von Funktionen, Masters Thesis, FernUniversität Hagen, 2007.
23.
A.Pauly, On the (semi)lattices induced by continuous reducibilities, MLQ Math. Log. Q.56(5) (2010), 488–502. doi:10.1002/malq.200910104.
24.
A.Pauly, How incomputable is finding Nash equilibria?, J.UCS16(18) (2010), 2686–2710.
25.
A.Pauly, On the topological aspects of the theory of represented spaces, Computab.5(2) (2016), 159–180, https://content.iospress.com/articles/computability/com049. doi:10.3233/COM-150049.
26.
A.Pauly, W.Fouché and G.Davie, Weihrauch-completeness for layerwise computability, Logical Methods in Computer Science14 (2018). doi:10.23638/LMCS-14(2:11)2018.
E.M.Stein, Singular Integrals and Differentiability Properties of Functions, Princeton Mathematical Series, No. 30, Princeton University Press, Princeton, N.J., 1970, xiv+290.
29.
N.R.Tavana and K.Weihrauch, Turing machines on represented sets, a model of computation for analysis, Log. Methods Comput. Sci.7(2) (2011), 2:19, 21. doi:10.2168/LMCS-7(2:19)2011.
30.
K.Weihrauch, Computable Analysis, Texts in Theoretical Computer Science. An EATCS Series, Springer-Verlag, Berlin, 2000, x+285. ISBN 3-540-66817-9. doi:10.1007/978-3-642-56999-9.
31.
H.Whitney, Analytic extensions of differentiable functions defined in closed sets, Trans. Amer. Math. Soc.36(1) (1934), 63–89. doi:10.2307/1989708.