We establish primitive recursive (PR) versions of some known facts about computable ordered fields of reals and computable reals, and apply them to prove primitive recursiveness of several important problems in linear algebra and analysis.
One of the central results of this paper is a partial PR analogue of Ershov–Madison’s theorem about real closures of computable ordered fields. It allows us, in particular, to obtain PR root-finding algorithms in the PR real and algebraic closures of PR fields with a certain property (PR splitting). We also relate the corresponding fields to the PR reals, as well as introduce and study the notion of a PR metric space. It enables us to derive sufficient conditions for PR computing of normal forms of matrices and solution operators of symmetric hyperbolic systems of PDEs. The methods represent a mix of symbolic and approximate algorithms.
In [34,35], computable ordered fields of reals were related to the field of computable reals and were used to prove computability of some problems in algebra and analysis (notably, spectral problems for symmetric matrices and computing solutions of symmetric hyperbolic systems of partial differential equations (PDEs) uniformly in matrix coefficients) in the rigorous sense of computable analysis [40]. The proposed sufficient conditions for computability are very broad but do not yield any complexity upper bounds because they use algorithms based on unbounded search through countable sets. We note that the situation here is rather subtle, e.g. the spectral decomposition of a real symmetric -matrix is not computable [41] (as a multi-valued function on the reals) but it becomes computable (even for -matrices uniformly in n) if matrix coefficients range over any fixed computable real closed field of reals.
In [36], the PTIME-presentability of the ordered field of algebraic reals and PTIME-computability of some problems on algebraic numbers established in [1] were applied to find non-trivial upper complexity bounds for the aforementioned problems in algebra and analysis. A weak point here is that this approach applies only to problems with coefficients in because is currently the only known PTIME-presentable real closed ordered field.
Another weak point is that complexity classes like PTIME or PSPACE are often not closed under important constructions. E.g. the spectral decomposition of an algebraic symmetric -matrix is PTIME-computable for any fixed n, but not uniformly in n. The same holds for the problem of root-finding for polynomials in [1]. For differential equations, PTIME is in many cases preserved for analytic/polynomial initial data: [6,19] for ordinary differential equations (ODEs), [23] for PDEs. However, for more general functional classes the situation is different: solving ODEs with a Lipshitz continuous PTIME computable right-hand part is PSPACE-complete [18]. Computing the solutions of the Dirichlet problem for the Poisson equation [20] and periodic boundary value problem for the heat equation [22], is #P1-complete; according to [22,23], for a large class of linear evolutionary PDEs, the difference scheme method is in general in PSPACE, for some particular cases in #P, when applied to fixed real PTIME computable initial data.
Thus, it seems reasonable to investigate properties of the aforementioned problems for natural complexity classes in between PTIME and COMPUTABLE, to obtain better closure properties and efficient solutions of wider classes of problems. An obvious candidate here is the class PR of primitively recursive functions having a prominent role in computability theory and proof theory.
Recently, there was a renewed interest in primitively recursive (PR) structures (see e.g. [4] and references therein) which are recognized as a principal model for an emerging new paradigm of computability – the so called online computability (see e.g. [5]). PR-solvability of a problem yields a solution algorithm which does not use an exhaustive search through a structure (usually written as unbounded WHILE...DO, REPEAT...UNTIL, or μ operator); thus, it becomes possible to count working time of the algorithm. Although the upper complexity bounds for a PR-algorithm may be awfully large, this is a principal improvement compared with the general computability. As stressed in [4], PR-presentability of a structure may often be improved even compared with PTIME-presentability.
Thus, PR-presentability of structures (and PR-computability in general) seems important for the following reasons: it is in some respect close to feasible computability, is technically easier than, say PTIME-computability, and has much better closure properties. In this paper we investigate PR-versions of some results in [34,36]. The PR versions have their own flavour and complement the results in [34,36].
In particular, we find a PR-version (for Archimedean case) of the Ershov–Madison theorem on the computable real closure [9,25], relate PR ordered fields of reals to the field of PR reals, propose (apparently, new) notions of PR-computability in analysis and apply them to obtain new results on computability of PDE-solutions. Our notion of PR Archimedean field of reals uses the idea of PR Skolem functions which was earlier used by R.L. Goodstein in [14] in his development of a version of constructive analysis.1
We are grateful to Vasco Brattka for the hint to Goodstein’s monography.
Our approach to PR computability in analysis sketched below is also related to the approach by W. Gomaa (see [13], comments after Remark 1) to PR computability on the reals.2
We are grateful to an anonymous reviewer of [32] for the hint to the survey by W. Gomaa.
More specifically, we identify a class of PRAS-fields (PR Archimedean fields of reals with PR-splitting) such that the above-mentioned problems over any such field are PR-computable. These results complement and contrast the results in [34,36], as well as some results in [1]. E.g., the class of PRAS-fields is shown to be richer than the class of PTIME-presentable fields but the union of this class is a proper subset of the set of PR reals (in contrast with the corresponding fact in [34]). In the applications sections, we show how this applies to spectral problems and (PR) solving of symmetric hyperbolic systems of PDEs. For the latter example the solution is computed numerically (via difference schemes) while the algebraic part is performed symbolically; this part also requires introducing definitions of PR real functions and operators.
In programming terms, we identify an important class of number fields and related algorithmic problems of algebra and analysis which may be programmed without using the above-mentioned unbounded cycle operators.
The present paper is an extended version of the conference paper [32] which contains new results, detailed proofs of some results which were only sketched in the conference version, and precise formulations of auxiliary facts. After some preliminaries on computable and PR-structures in the next section and on PR rings and fields in Section 3, we define in Section 4 PR-Archimedean fields and prove the PR-version of Ershov–Madison’s theorem for such fields. In Section 5 we introduce PR-splitting property and give a sufficient condition for uniqueness of the PR real closure and for the existence of PR root-finding algorithms in the PR real and algebraic closures of PR-fields with this property. In Section 6 we examine PR-versions of results in [34,35] on the relations of computable ordered fields of reals to the field of computable reals. In Section 7 we show that many transcendental reals may be included in a PRAS-field, in contrast with the PTIME-presentable ordered fields of reals for which no such example is known. In Section 8 we apply the obtained results to show the existence of PR algorithms for finding normal forms of matrices over any PRAS-field frequently used in applications. In Section 9 we introduce basic notions of a PR version of computable analysis which seems closely related to Goodstein’s version of constructive analysis. In Section 10 we apply the obtained results to proving PR-computability of solutions operators for symmetric hyperbolic systems of PDE, complementing the results in [34,36]. We conclude in Section 11 with a short informal discussion and some open problems.
PR structures
Here we recall some basic definitions and observations about PR functions and structures. We start with recalling basic notions related to computable structures (see e.g. [10,27,37] for additional details).
A numbering is any function with domain . Instead of we may write whenever convenient. A numbering of a set B is a surjection β from onto B; sometimes we write or instead of the “canonical” . For numberings β and γ, β is reducible to γ (in symbols ) iff for some computable function f on , and β is equivalent to γ (in symbols ) iff and . These notions (due to A.N. Kolmogorov) enable to transfer the computability theory over to computability theory over many other countable structures.
Let be a numbering. A relation on B is ν-computable if the relation on is computable. A function is ν-computable if for some computable function ; this notion is naturally extended to partial functions . More generally, given another numbering , a function is -computable if for some computable function .
A structure of a finite signature σ is called constructivizable iff there is a numbering β of B such that all signature predicates and functions, and also the equality predicate, are β-computable. Such a numbering β is called a constructivization of , and the pair is called a constructive structure.
Note that all information about a constructive structure is contained in the numbering β (and computable functions representing the equality and signature functions and relations in this numbering) because . We sometimes use this to shorten notation in Sections 5 and 6.
The notion of a constructivizable structure is equivalent to the notion of a computably presentable structure popular in the Western literature. Obviously, is a constructive structure iff, given and a quantifier-free σ-formula with free variables among , one can compute the value of ϕ in .
A structure of a finite signature σ is called strongly constructivizable iff there is a constructivization β of B such that, given and a first-order σ-formula , one can compute the value . Such β is called a strong constructivization of , and the pair is called a strongly constructive structure.
Clearly, any strongly constructivizible structure is constructivizible and has a decidable first-order theory. The notion of a strongly constructive structure is equivalent to the notion of a decidable structure popular in the Western literature.
PR-versions of the notions defined above are obtained by changing “computable” to “PR” in the definitions above. In particular, for numberings β and γ, β is PR-reducible to γ (in symbols ) iff for some PR function f on , and β is PR-equivalent to γ (in symbols ) iff and . For , a relation on B is ν-PR if the relation on is PR. A function is ν-PR if for some PR function . A structure is PR-constructivizable iff there is a numbering β of B such that all signature predicates and functions, and also the equality predicate, are β-PR. Such β is called a PR-constructivization of , and the pair is called a PR structure.
Basic information on PR functions is supposed to be known; it may be found e.g. in [28]. The PR functions are generated from the distinguished functions , , and by repeated applications of the operators of superposition S and primitive recursion R. Thus, any PR function is represented by a “correct” term in the partial algebra of functions over (“correct” terms are those satisfying some obvious constraints on the arities of the involved functions which guarantee that the resulted function on is total). Intuitively, any total function defined by an explicit definition using (not too complicated) recursion is PR; the unbounded μ-operator is of course forbidden but the bounded one is possible.
The PR-version of Definition 2 was introduced in [27]. After a long break, PR-structures appeared as an intermediate stage of proving PTIME-presentability of a structure (see e.g. [7,15]). After another break, PR-structures appeared in the literature as a promising candidate for capturing the so called online structures which give a practically relevant alternative to computable structures (see the discussion and additional references in [4]). The following notion from [4] is important for this approach: a structure is fully PR-presentable (FPR-presentable) if it is isomorphic to a PR structure with universe . Let us characterise the -structures in our (i.e., Mal’cev’s) terminology. We call a numbering ν PR-infinite if there is a PR function f such that whenever .
An infinite structureis FPR-presentable iff it has a PR-constructivization β which is PR-infinite.
We consider the less obvious direction. Let β be a PR-constructivization which is PR-infinite via f. Define a function as follows: and . Since B is infinite, g is total and injective. Let . Then and h is PR, hence g is also PR. The numbering is PR-reducible to β and injective. Conversely, via the PR function . Thus, γ is a bijective numbering of B PR-equivalent to β, so it is a bijective PR-constructivization of . Copying interpretations of signature symbols from to via we obtain a PR-copy of with universe . □
Note that any PR-constructivization β of an associative commutative ring with 1 of characteristic 0 is PR infinite (via any PR function f such that coincide with the element ( summands)). Since in the subsequent sections we consider mostly rings and fields of characteristic 0, most of the PR-constructivizable structures are also FPR-presentable. As observed in [17], in fact any PR-constructivizable infinite field is FPR-presentable.
Importantly, all usual encodings and decodings of constructive objects (like pairs, triples, finite strings, terms, formulas and so on) used in computability theory and its applications may be done using PR functions [28]. For instance, there is a PR bijection between and , with PR decoding functions. With some abuse, we use similar notation to encode triples and finite strings of natural numbers.
We give some examples of PR structures. The structure is clearly PR. The ordered ring of integers is PR-constructivizable via the bijective numbering and . The ordered field of rationals is PR-constructivizable via the numbering . This numbering may be in the obvious way improved to a bijective PR-constructivization such that from a given n one can primitive recursively compute a fraction , , , and vice versa; below we always assume that ϰ is a bijection with these properties..
Let be the Gödel numbering of all variable-free terms of signature where is an infinite sequence of new constant symbols. Let be a σ-structure. We associate with any numbering the numbering as follows: is the value of in when the constant is interpreted as . The following fact is a straightforward PR-analogue of a particular case of a theorem in [33].
For allwe have:,implies, and; any σ-function is-PR; ifand any σ-function is μ-PR then.
Ifis a PR σ-structure andthenandis a PR σ-substructure ofgenerated by; in particular,.
We conclude this section with recalling a nice characterization of unary PR functions due to R. Robinson (see e.g. Section 3.5 in [28]). Consider the structure where is the set of unary functions on , + and ∘ are binary operations on defined by and , J is a unary operation on defined by where and , s and q are distinguished elements defined by and where is the integer part of , i.e., the unique integer m with . This structure is known as the Robinson algebra.
Let be the set of variable-free terms t of signature . The value t of t in the Robinson algebra is an element of . By Robinson’s theorem, the set of values t of such terms coincides with the set of unary PR functions. Using a standard Gödel’s encoding by natural numbers (e.g., we can set , , , , and ), one can construct a computable numbering ψ of the unary PR functions such that the operations +, ∘, J are ψ-PR (see e.g. Section 5.2 of [28] for the details). Recall that computability of ψ means that the binary function is computable; this binary function is not PR. Moreover there is a sequence in such that and the function is PR.
More generally, for any , let be the set of terms of signature τ with variables among a fixed list of pairwise distinct variables. Any determines the n-ary operator t on by setting to be the value of t for . The functions of the form coincide with the functions PR in (the last notion is obtained from the “correct” terms mentioned in the Introduction by adding to the list of basic functions). As above, this yield a Gödel numbering of n-ary PR operators on. For this numbering coincides with the numbering ψ of PR functions in the preceding paragraph. For we obtain a numbering of unary PR-operators on which is PR-reducible to the standard numbering of Turing functionals. We use the introduced PR-operators on in Section 9 to define PR functions on the reals.
PR rings and fields
The literature on computable rings and fields is very rich but, surprisingly, the PR analogue of this theory does not seem to be considered extensively so far. In this section we collect a few notions and facts on PR rings and fields which are used in the sequel and which are analogues of their computable versions. We assume the reader to be familiar with basic notions and facts about rings and fields (see e.g. [39]). The word “ring” in this paper usually means “associative commutative ring with 1”, the only exception are rings of matrices which are in general not commutative. The investigation of PR rings and fields in parallel to the well known corresponding computable versions [10,37] is mostly straightforward but from time to time some complications do appear. We consider fields and ordered fields in signatures and resp.; for (ordered) rings the symbol is of course removed.
Recall that an integral domain is a ring with no zero-divisors satisfying . With any integral domain we associate its quotient field . The elements of are the equivalence classes of pairs where , and the equivalence on pairs is defined by: iff . With any numbering β of B we associate the numbering of as follows: if , and otherwise. The next proposition is straightforward.
If β is a PR-constructivization of an integral domainthenis a PR-constructivization of the quotient field.
If β is a PR-constructivization of an ordered ring(which is automatically an integral domain) thenis a PR-constructivization of the quotient ordered field(with the unique ordering extending the given ordering of).
With any numbering β of a (countable) ring we associate the numbering (the precise notation should refer to the variable x, say we could use ) of the ring of polynomials over with variable x as follows: where is a PR coding of the set of finite non-empty strings of natural numbers. Iterating this construction, we obtain for each n the numbering of (identifying with ) as follows: , . Then the expression defines a numbering of the set of polynomials with any number of variables. The next proposition is straightforward.
Letandbe PR rings,a subring of, and. Thenfor all n.
If β is a PR-constructivization ofthenare PR-constructivizations of,, … ,respectively.
For any n, let be the evaluation function defined as follows: is the value of p at . Let be the evaluation function which returns the value of a polynomial if the arities match and returns 0 otherwise. The next proposition is straightforward.
Ifis a PR ring then the evaluation functions are PR in the corresponding PR-constructivizations of the polynomial rings above.
Polynomials are closely related to terms in the signature of rings. We formulate a straightforward fact about such a relation to terms in signature . The direction from polynomials to terms is checked by induction on the number of monomials, the opposite direction – by induction on (the rank of) terms. Interestingly, the PTIME-version of this fact fails in both directions.
Letbe a PR ring. Given, one can primitive recursively find a σ-termsuch thatfor all, whereis interpreted as. The same holds for the opposite direction.
Below we consider rings of polynomials only over integer domains and over fields. As is well known, the ring has interesting arithmetic resembling in many respects the integer arithmetic. We mention (not systematically) some terminology and algorithms which have natural PR analogues. If , where , then n is called the degree of p, denoted as . The element is the leading coefficient of p. If or ( and ), then the polynomial is called normalized. We say that divides in , , if there is with . A polynomial is a greatest common divisor of, , if for and the conditions for imply . A greatest common divisor always exists and is unique up to multiplication by a non-zero constant in . We denote by the normalized greatest common divisor.
A polynomial over a field is irreducible in if and the equality implies that or . If p is an irreducible polynomial and , then or . Every non-zero polynomial is representable in the form , where and are normalized irreducible polynomials, and such a representation is unique up to factor permutation; it is called the canonical decomposition of p.
The algorithm of polynomial division of by (where with are given polynomials over a field) returns the quotient and the remainder polynomials such that and . The Euclidean algorithm, applied to such polynomials , , produces an iterated sequence of quotients and remainders and returns the greatest common divisor of , as the last non-zero remainder.
The derivative of a polynomial is defined as . If , where , are distinct normalized irreducible polynomials, , and for , then , hence . A polynomial p is square-free if in the factorization above for . For polynomials over a field of characteristic 0 this is equivalent to . In every field that extends , the roots of p and coincide and the latter polynomial does not have multiple roots. The next proposition is straightforward.
Ifis a PR field thenis a PR integral domain and the functions deg, quot, rest, gcd, ′ and the relations ∣, “,are relatively prime”, “p is square-free” are-PR.
For any field , is an integral domain whose quotient field is known as the field of rational functions over ; let be the surjection essentially defined before Proposition 3. For any normalized irreducible , let be the quotient field of by the maximal ideal of , and let be the canonical surjection. The next proposition follows easily from the previous one and Proposition 3.
Ifis a PR field then so are alsoand.
In the study of computable fields, the property of computable splitting is important. The PR-version of this notion is as follows: a PR field has PR splitting if, given , one can primitive recursively find a canonical decomposition of p. Note that this implies that the property of being a reducible polynomial is -PR. We do not currently know whether the opposite implication holds (although its computable version obviously holds). The following assertion collects straightforward PR-analogues of the corresponding well-known facts about computable splitting [10,37].
The PR fieldhas PR splitting.
Ifis a PR field which has PR splitting then so are the fieldsandfrom the previous proposition.
Let be a field extension, , and let be the subfield of generated by . If are algebraically independent (hence transcendental over ) then is known to be isomorphic to the field of rational functions (the standard isomorphism is induced by the polynomial evaluation function). If is algebraic over then is known to be isomorphic to the field where is the (unique) normalized polynomial of minimal degree with .
If has characteristic 0 and is an algebraic closure of then for any there exists (called a primitive element for ) such that (this follows from the well-known primitive element theorem, see e.g. Section 46 of [39]). Theorem 11 in [24] provides a constructive version of this theorem. Item 3 of the following proposition is a PR-version of this constructive version with essentially the same proof. Items 1 and 2 are straightforward PR versions of the facts mentioned in the previous paragraph.
Letandbe PR fields such that,,has PR splitting, and letbe a finite or infinite sequence, which is PR reducible to β provided it is infinite.
Ifare algebraically independent overthen the standard isomorphism betweenand, as well as its inverse, are represented by PR functions on the names.
Ifis algebraic overthen the standard isomorphism betweenisand its inverse are represented by PR functions on the names.
Lethave characteristic 0 and letbe an algebraic closure of. Givenwithfor, one can primitive recursively find a primitive element b forand polynomialssuch thatandfor.
Recall that a polynomial in is symmetric if it does not change under any permutation of the variables. The symmetric polynomials
are called elementary. It is well known that any symmetric polynomial may be obtained by substituting the expressions for in a suitable polynomial . The standard proof of this fact is constructive (see e.g. Section 33 in [39]), and in fact the algorithm in that proof is PR. This yields the following.
Letbe a PR ring. Given a symmetric, one can primitive recursively compute a polynomialsuch that.
Let be the ring of -matrices over a ring . We use standard terminology and notation from linear algebra. In particular, is the determinant of , is the diagonal matrix with diagonal elements , so in particular is the unit matrix. The polynomial is called the characteristic polynomial of A. With any numbering β of we associate the numbering of , by using the PR-bijection between and . Let G be the set of non-degenerate matrices , i.e. matrices with non-zero determinants. If is a field then G coincides with the set of matrices A for which the matrix exists. Also rectangular matrices are useful, in particular for solving general (i.e., with arbitrary number of variables and equations) linear systems of equations. The next proposition is straightforward.
Letbe a PR ring.
For any,is a PR-constructivization of the ringuniformly in n.
The functionis-PR, and the setis PR uniformly in n.
The functionis-PR uniformly in n.
Ifis a field then there is a PR functionsuch thatfor all n and.
Given a general linear system of equations over a PR field, one can (using, say, the Gauss method) primitive recursively find its general solution (i.e., a fundamental system of solutions).
Let be a ring and , be polynomials over . Recall that Silvester matrix for p, q is the matrix whose first n rows are
and whose last m rows are
For , the resultant of p, q, denoted is defined as the determinant of the Silvester matrix for p, q. We also define respectively for , , .
Thus, . Note that the resultant may also be considered as a fixed polynomial in . Clearly, if β is a PR-constructivization of then the resultant is a PR function in the corresponding numberings , β.
In the remainder of this section we assume that is a field. Recall that discriminantof (where and ) is defined by where is a list of all roots (possibly with repetition) of p in an algebraic closure of . In the next proposition we recall some properties of resultant and discriminant from [24,39]. Some other properties proved in [24] will be recalled later.
We have:iff eitherorhas degree.
Let p be a polynomial overof degree. Then p has a multiple root iniffiff p is not square-free iff.
Let p be a polynomial overof degree. Then, hence.
Letandbe in. Then.
Let p, q be polynomials of positive degrees m, n over, andandbe the lists of all roots of p and q in, respectively. Then the equalities of the previous item hold.
As already mentioned, proofs of results in this section follow easily from known proofs. PR analogues of many other algebraic facts may also be obtained this way. Below we prove some less straightforward results from PR algebra and analysis.
PR real closure
By a classical theorem of Artin and Schreier, for any ordered field there exists an algebraic ordered extension which is real closed. Such an extension, called the real closure of, is unique in the sense that for any real closure of there is a unique isomorphism between and identical on .
Yu.L. Ershov [9] and independently E.W. Madison [25] proved a computable version of the Artin–Schreier theorem: if is constructivizable then so is also . In this section we make search for a PR analogue of the Ershov–Madison theorem. Though we have not found a complete analogue, we describe one for the case of Archimedean ordered fields. We recall some details of the proof of Ershov–Madison’s theorem in [25] which are used for our PR version (the proof in [9] is a particular case of a proof of a more general model-theoretic result and it is not currently clear how to adjust it to the PR case).
The author of [25] defines, from any given constructivization α of an ordered field , a constructivization of the real closure as follows (we use slightly modified notation). Let mean that either is the zero polynomial (i.e., all coefficients of are zero) or has at most k roots in . Then if , otherwise is the -st (w.r.t. <) root b of in (i.e., and there are precisely k roots of in strictly below b).
It remains to check that are -computable. As observed in [25], this follows from the Tarski quantifier elimination for real closed fields [38]. For instance, in order to check -computability of + (equivalently, computability of the relation on ) it suffices to note that, using the definition of one can compute, given , a first-order formula of signature and a string of natural numbers such that iff is true in . By the quantifier elimination, we can think that ϕ is quantifier-free. Since is a substructure of , the values of in both structures coincide. Since is constructive, the relation is computable.
Unfortunately, this argument does not automatically yield the PR-version. If is PR then the Madison proof does yield that the graphs of signature functions are PR in . This follows from the proof sketched above because Tarski’s quantifier elimination is PR, i.e., from an arbitrary first-order formula ϕ as above one can primitive recursively find an equivalent quantifier-free formula (even better complexity bounds for quantifier elimination are known, see e.g. [3] and references therein). So, at first glance the PR-version of the Ershov–Madison theorem automatically follows from Madison’s proof sketched above. But primitive recursiveness of a graph of a function does not imply primitive recursiveness of the function itself, see e.g. Section 6.4 of [28]. This is a major obstacle to proving the PR-version of the Ershov–Madison theorem in full generality. In fact, we currently do not have a proof for the general case. But we do have a reasonable version for a natural subclass of Archimedean fields.
Every Archimedean ordered field is isomorphic to a substructure of the ordered field of reals, so in the sequel we always assume that . In fact, we can also assume that since is isomorphic (over ) to the ordered field of real roots of non-zero polynomials from . So, from now on we always assume that and are ordered subfields of , i.e. , and is the set of real roots of non-zero polynomials over .
Note that if is a constructivization of then is computably Archimedean in the sense that , for a suitable computable function f. Again, the PR-version of the last fact, probably, does not hold in general. In fact, our proof below works only for PR-Archimedean fields which we define as the PR ordered subfields of such that there is a PR function f with . The main result of this section is the following.
Ifis a PR-Archimedean subfield ofthen so is also.
The theorem follows from Facts 1–7 proved below. Most of the facts just show that some standard algebraic functions are PR. The proofs of some facts are versions of the corresponding proofs in [1,2,24] which show that the ordered field of algebraic reals is PTIME-presentable.
There is a PR function f such that all real roots of any non-zero polynomialare in the interval. In particular,for all i, k (sois PR-Archimedean provided that it is a PR ordered field).
By the notation in Section 3, . Since is non-zero, we have where is the degree of . As is well known, all real roots of are in where and . Since is PR-Archimedean, there is a PR-function f with . The second assertion follows from the definition of . □
Given a polynomialof degree, one can primitive recursively find the Sturm sequence of polynomialsinwith the following property: the number of real roots of p in any intervalequalswhere, for, is the sign alternation number in the sequence.
As is well known, the sequence sseq is defined as follows: , is the derivative of p, and for , is the negative remainder after dividing by (thus, is a small variation of the sequence from the Euclidean algorithm for p, ). By Proposition 7 and other remarks in Section 2, the sequence can be found primitive recursively. □
Given a non-zero polynomialand, one can primitive recursively find the number of real roots of p in the interval, as well as the number of all real roots of p.
Givenof degree, one can primitive recursively find a positive rationalwhereis the smallest distance between distinct roots of p.
Without loss of generality we can think that p has no multiple roots (otherwise, we can take instead of p where is the greatest common divisor of p and , because p and are known to have the same roots and the latter polynomial has no multiple roots, see remarks before Proposition 7). By Mahler’s theorem (see the corollary of Theorem 2 in [26]),
where is the discriminant of p and . Since by Proposition 13 and p has no multiple roots, . Since is PR-Archimedean, we can primitive recursively find a positive rational below . □
Given a non-zero polynomialand a positive rational number ε, one can primitive recursively find a sequence(whereis the number of real roots of p) of pairwise disjoint rational intervals of lengthwhich separate the real roots of p, i.e. everycontains precisely one real root of p.
Follows from the previous facts using the bisection method. □
Operations +, ·, −,onare-PR.
All operations are considered similarly, so we give details only for +; we describe a PR function with . Let and . By the definition of , this relation is PR. If then we set . If and then we set . It remains to consider the case when both and are false, i.e. is the -st real root of and is the -st real root of . It suffices to primitive recursively find such that and is the -st real root of (then we can set ).
By (the proof of) Theorem 6 in [24], the polynomial has as a root (in fact, the complex roots of r coincide with the sums of complex roots of p, q). By remarks before Proposition 13, we can primitive recursively find s with . For any rational intervals and , the interval contains , and its length may be made arbitrarily small. Using Fact 5, we can primitive recursively find a sequence of rational intervals which separate all real roots of r such that I intersects precisely one interval , , of this sequence. Then , hence it remains to set . □
The relation ⩽ onis-PR.
By Fact 6, it suffices to show that the relation is PR. Let again . By the definition of we have: iff either or ( and the -st real root of is non-negative). Consider the case when is false. By Fact 5, we can primitive recursively find a sequence (where is the number of real roots of ) of pairwise disjoint rational intervals of length such that every contains precisely one real root of . Then . Assume first that (i.e., ). Then for a unique , hence iff .
In the case , we consider the polynomial which satisfies . Computing the sequence for polynomial q in place of and applying the argument of the previous paragraph we see that iff . Altogether, these arguments and the primitive recursiveness of relation complete the proof. □
By a classical theorem of Steinitz, for any field there exists its algebraic closure which is unique in the sense that for any algebraic closure of there is an isomorphism between and identical on . M. Rabin [31] proved a computable version of the Steinitz theorem: if is constructivizable then so is also . The uniqueness up to computable isomorphism holds for constructive fields which have computable splitting. Though we do not yet know a complete PR-analogue of Rabin’s theorem, we note that the algebraic closures of PR Archimedean ordered fields are PR-constructive.
Recall (see e.g. Chapters 10, 11 of [39]) that a real closed field is never algebraically closed (the polynomial has no root in ) but its algebraic closure is constructed very easily by adjoining a root of . Thus, is isomorphic to where the arithmetic on pairs is similar to that of the field of complex numbers. If is a constructive ordered subfield of , let be the induced numbering of (considered as a subfield of ), i.e. . The following is an immediate corollary of Theorem 1.
Ifis a PR-Archimedean ordered subfield ofthenis a PR subfield of.
The computable versions of proofs above show that the computable version of Theorem 1 holds: If is a constructive ordered subfield of then so is also .
PR root-finding
We say that a computable field has computable root-finding (cf. [11,29]) if, given a polynomial of degree , one can compute a (possibly, empty) list of all roots of p in . Theorem 4.43 in [11] states that has computable root-finding iff it has computable splitting. As usual, the notion of PR root-finding is obtained by changing “computable” to “PR” in the definition above. The proof of Theorem 4.43 in [11] works for the PR-version which, together with Proposition 11, yields the following.
A PR field has PR root-finding iff it has PR splitting.
Obviously, every computable algebraically closed field has computable root-finding, but the proof makes use of the unbounded search. The next theorem shows that the PR-version of this holds at least for some fields considered above. To shorten formulations, we denote by (resp. , ) the set of all such that , , is a PR-constructive ordered subfield of (resp., a PR-Archimedean, a PR-Archimedean ordered subfield with PR splitting). By a PRAS-field we mean an ordered subfield of which has a PR-constructivization . In the remaining part of the paper, we usually denote by , , the (ordered) fields associated with α, , , respectively.
Ifthenandhave PR root-finding.
Under the assumption we first establish some auxiliary facts. Let .
Given a polynomialand polynomialsof positive degrees, one can primitive recursively findof positive degree such that, for all complex rootsof,, the valueis a root of q.
Let , be binary operators on such that all sums (resp. products) of complex roots of p, q are among the roots of (resp. ). By the proof of Theorem 6 in [24] (see also the proof of Fact 6 in the previous section), operators , are given by explicit formulas (based on a resultant calculus) which show they are -PR.
We associate with any σ-term the polynomial as follows: , , , . By induction on t one easily checks that, for all complex roots of , , is a root of .
By Proposition 6, from one can primitive recursively find a σ-term such that for all . Thus, we can take . □
Given a non-zero polynomial, one can primitive recursively findsuch that, for any complex rootof r, the real partis a root ofand the imaginary partis a root of.
Let be the polynomial obtained from the algorithm of Fact 1 for and . For any complex root of r we then have: , b is a root of , and is a root of where is the complex conjugate of b and i is the imaginary unit. Thus, has the desired property.
Let now be the polynomial obtained from the algorithm of Fact 1 for and . For any complex root of r we then have: , b is a root of , and is a root of . Thus, , hence also . Summing up the last two equalities we see that where . Thus, has the desired property. □
Given a polynomialand polynomialssuch thatfor each, one can primitive recursively findsuch that every complex root of p is among the roots of r.
The proof is essentially the same as in the Algorithm 3 of [24], hence we give only a sketch. Since has PR splitting, we may without loss of generality think that are irreducible. By Proposition 10(3), we may primitive recursively find and irreducible such that , and for all . Let . We may without loss of generality think that (otherwise, replace t by ). Then the polynomial , where , has the desired properties. By the results in Section 3, r may be found primitive recursively. □
Given , we have to primitive recursively find all complex roots of p. By Fact 3, we can find such that all complex roots of p are among the roots of r. By Fact 2, we can find such that, for any complex root of r, the real part is a root of and the imaginary part is a root of . By the definition of and the results of Section 4, we can find the lists and of all real roots of and , respectively. Then all complex roots of p are among where , . Substituting these complex numbers one by one in p and using Proposition 5, we can primitive recursively choose all complex roots of p.
It remains to show that has PR root-finding. Let ; we have to find a list of all real roots of p. Since , we have by Proposition 4. By the previous paragraph, we can compute the list of all complex roots of p. Choosing the real numbers from this list, we obtain a list of all real roots of p. □
For all, we have:,implies, and similarly forin place of.
For any,, sois a closure operator on.
As mentioned in Section 4, the real closure of an ordered field is unique up to isomorphism over this ordered field. We conclude this section with a PR-version of this fact. The proof is an easy adaptation of the proof for the classical case (see e.g. [39], Theorem 8 in Section 82).
Letand letbe a PR-Archimedean ordered field such that it has PR root-finding,is a real closure ofand. Thenis PR isomorphic toover, i.e. there is an (unique) isomorphism f fromontosuch that f is identical on A, f is-PR, andis-PR.
Let , be the computable analogues of , , i.e. (resp. ) is the set of all maps such that is a constructive ordered subfield of (resp., a constructive ordered subfield which has computable splitting). The proofs above apply to these computable analogues, in particular the computable version of Proposition 15 gives a sufficient condition for uniqueness of the computable real closure.
PRAS-fields vs. PR reals
In [34,35] we have shown that for any finite set F of computable reals there is a computable real closed ordered subfield of the computable reals such that (see also a more general Theorem 4.1 in [30] obtained independently). This fact implies the following charaterization of the union of all constructivizable ordered fields of reals:
where is the set of computable reals and , are the computable analogues of , . In this section we are interested in PR-analogues of these facts from [34,35].
The PR-analogue of is the ordered field of PR reals. In this section we often cite the survey [8] on PR reals where references to the source papers may be found; we sometimes use slightly different notation from that in [8]. Recall that a real number a is PR if for a PR sequence of rational numbers which is fast Cauchy, i.e. for all n. There is a natural numbering τ of . To define it precisely, we describe some technical details which will also be used in Section 9.
With any (see the end of Section 2) we associate the sequence of rational numbers. Since is a bijection, the function is a bijection between and . From the properties of ϰ in Section 2 it follows that p is PR iff is PR, and similarly for functions of larger arity. By we denote the set of all such that is fast Cauchy. With any we associate as follows: if then , else where . Clearly, for each , and if then , in particular .
Now we define the numbering τ of by: where ψ is the numbering of unary PR functions from the end of Section 2 and . In the next proposition we collect some properties of the introduced objects.
is a subfield of, and operations +, −, · are τ-PR.
The sequence of realsis computable, hence the inclusionis proper.
The relation < onis τ-c.e.
The ordered fieldis real closed.
The ordered fieldis not constructivizable.
(1) Proof is easily extracted (say) from the proofs of Proposition 4.1 and Theorem 4.2 in [8] and the remarks at the end of Section 2. We have to find a PR function g such that , and similarly for −, ·. Denote the sequences and by and , respectively. These are PR fast Cauchy sequences of rationals converging to and , respectively.
Then and for . Let , then is a fast Cauchy sequence of rationals that converges to . By the properties of ϰ, , is a PR function from , hence . By Robinson’s theorem, for some . Moreover, the terms may be chosen so that the function is PR. Then for some binary PR function g we have . Therefore, , as desired.
For the operation − the proof is the same, only now we have to set . For the operation · the proof is the same, only now we have to set and , for a suitable PR function f (see the proof of Theorem 4.2 in [8]).
(2) The computability of the sequence follows from the definition of τ. The properness of inclusion follows by the well-known property of the computable reals.
(3) Obvious from the definition of τ.
(4) This is due to Peter Hertling (private communication [16], with permission to mention the formulation here).
The reciprocal partial function is not τ-PR (this is proved by essentially the same argument as that in Proposition 24(2); the argument is topological, hence more natural to be discussed in Section 9). Nevertheless, the restriction of the reciprocal function to is τ-PR uniformly in n.
For any , let be the set of PR reals b such that the sign of polynomials in at b is checked primitive recursively. Formally, for any real b, let be 0, 1, 2 depending on whether b is zero, positive, or negative. Then is the set of all such that the function is PR. More generally, for any , let be the set of tuples of PR reals such that the function is PR where is the numbering of from Section 4. Note that .
Ifandthenfor all n.
For alland n we have:.
For anywe have.
For anythere is a uniformly PR sequenceof PR functionssuch thatis a fast Cauchy sequence converging to, in particular.
1. Let , so is PR. Since , by Proposition 4 we have , so for some PR function f. Then , hence is PR.
2. The assertion follows from item 1 because, clearly, .
3. Let and let satisfy . Using the bisection method starting with the interval and the PR-constructivity of α, we construct a PR function such that . Then is a fast Cauchy sequence converging to a, hence . Moreover, by Proposition 4 we get .
4. Since is PR-Archimedean, for some PR function f. Using the bisection method as in (3) with in place of , we construct a uniformly PR sequence with the specified properties. The uniformity yields a PR function f such that . By the definition of τ, via f. □
By items 2 and 3 of the last proposition, implies , hence all PR ordered fields of reals are contained in . The next result shows which elements of (and, moreover, which finite tuples of reals) can be included into some PR ordered field of reals.
Conversely, let . First we consider the case when are algebraically independent over , hence for every i with . Then with the induced numbering γ is a PR field by Proposition 8 because it is isomorphic to the field of rational functions. The elements of have the form for some , . Since iff both , are positive or both , are negative, γ is a PR constructivization of . By Proposition 9, , hence we can take .
Now let be arbitrary. Without loss of generality (renumbering if necessary), let be the unique number such that are algebraically independent over while are algebraic over . Let γ be defined as in the previous paragraph for (with n replaced by ) and for . By the previous paragraph and Proposition 2, we can take . □
The results above imply the following characterization of the union of all PRAS-fields.
.
Obviously, . By Proposition 17(3), , so it suffices to show that . This follows from Theorem 3 because . □
This corollary would yield satisfactory PR-analogues of some facts mentioned in the beginning of this section, if we had . In the next proposition we will show that this is not the case.
First we recall some facts about continuous fractions. Associate with any real x the sequence of integers (which we call here the canonical continuous fraction for x) and an auxiliary sequence as follows:
let be the integer part of x and ;
if then let , otherwise let and ;
if or then let , otherwise let and .
It is well known that x is rational iff . It is easy to see that , , implies , and imply . Note that the set of all integer sequences with these properties is in a bijective correspondence with which is given by where , for and otherwise, for and otherwise, and so on. The converse map is given by “computing” the canonical continuous fraction for x.
The set of reals with the PR canonical continuous fraction has a natural numbering γ constructed as follows. Associate with any sequence of integers the sequence as follows: ; if then , otherwise ; if or then , otherwise . Then has the properties above, and if ν has these properties then . Let now be the sequence of PR integer sequences induced by the computable sequence of all unary PR functions (as usual, we implicitly use a suitable PR bijection between and ); then the sequence consists of all PR sequences with the properties above. Setting , we obtain a natural numbering of all reals with the PR canonical continuous fraction.
The inclusionis strict.
Let be the set of reals which have PR continuous fractions (see [8]) and references therein). By a theorem of Lehman, the inclusion is strict (for a proof see e.g. Theorem 7.4 in [8]). So, it suffices to show that . By Corollary 3, it suffices to show that for every .
First we show that is a PR function from to . Let be a PR function such that for every . Since , for some PR function f we have , hence . Since , it suffices to show that the function is PR. But this follows from PR-constructivity of and the obvious equalities
Let be the canonical continuous fraction for . By the definition above, it is a PR sequence of rationals (even uniformly in n), hence and therefore . □
We guess that the inclusion is also strict.
1. From the proof it follows that for any the relation is PR (because it is equivalent to ).
2. Also, the proof shows that (this follows from the definition of the numbering above and the fact that the sequence is PR uniformly in n).
3. For the computable versions of and all proofs of this section remain valid and yield the results mentioned in the beginning of this section because, as one easily checks, and the function is computable for every . Note that the computable versions of and coincide.
We see that the relations between classes , , and fields , are much more intricate than for their computable analogues.
How rich is the collection ? By Proposition 9(1), . By Proposition 2, is closed under , hence , i.e., is a PRAS-field. In fact, is even PTIME-presentable [1,2]. Moreover, it is open whether there is PTIME-presentable ordered field of reals beyond . In the next section we show that PRAS-fields may contain transcendental numbers.
PRAS-fields beyond
In this section we examine which transcendental PR reals (and tuples of PR reals) may be included in a PRAS-field. First we show that there are PRAS-fields of any countable transcendence degree.
For anyand any non-empty rational interval I there existswhich is transcendental over.
For anythere exists a uniformly PR infinite sequenceof reals which are algebraically independent overand satisfyfor every n where.
1. We define by induction PR sequences of rational numbers and of rational open intervals such that and, for every j, where is the closure of , and . Then we set which automatically guarantees that is fast Cauchy and hence . The remaining properties of b are obtained by taking some additional care.
Let and be any rational number in . Assume by induction that we already have defined , for which satisfy the properties above for . Then we define , as follows. If the polynomial is zero or has no real roots, choose , arbitrarily such that and . Otherwise, use Fact 5 in Section 4 to primitive recursively find a non-empty rational open interval J such that and contains no real root of ; then is either positive on or negative on , and this alternative is checked primitive recursively. Now choose , as above but with the additional property . Then the sequences , are PR and satisfy the properties specified in the previous paragraph.
Note that for all n, and if is non-zero then it is either positive or negative on , hence ; therefore, b is transcendental over . If is zero then , otherwise depending on whether is positive on or is negative on . Therefore, the function is PR and hence .
2. Note that the construction in item 1 is PR in the sense that, given an index for (i.e., a code of tuple of indices for PR functions representing the equality and the signature symbols, and also of the splitting function), one can primitive recursively find a π-index for b and a PR-index of the function .
Let . Since the construction in Proposition 3 is PR, we can primitive recursively find an index of with . Since the construction in Theorem 4 is PR, we can primitive recursively find an index of with .
Taking in place of α, we primitive recursively find an index of some transcendental over . It is easy to check that , are algebraically independent over and . Iterating this process indefinitely, we obtain a desired sequence . □
There are PRAS-fields of any countable transcendence degree.
By Theorems 4(2) (for ) and 3, any of the ordered fields , , , … , is a PRAS-field. □
1. Theorem 4 and Proposition 3 imply that the algebraic closures of the fields for every n, and of , are PR-constructivizable (the latter fact is a step to proving the PR-version of the Rabin theorem mentioned in Section 4).
2. From the construction of numbers in the proof Theorem 4 it follows that all these numbers are in the set PRT defined below.
An important problem is to determine whether a given concrete transcendental real (or a tuple of such reals) may be included in some PRAS-field. In general, this question seems very difficult but for some concrete numbers (including the Euler number e and the circle number π) the solution follows from results of Goodstein’s monograph [14].
By a PR-Cauchy sequence we mean a PR sequence of rationals such that for some PR function N it holds: . Since further results of this section essentially depend on notions and results of the appendix to [14], we make some of our notations closer to those in [14]. Let be the natural numbering of non-zero rational polynomials defined by where is the numbering of from Section 3 and f is the PR function enumerating the PR set in the increasing order.
([14]).
By a PR transcendental real we mean a PR-Cauchy sequence such that for some PR functions k, N we have: for every . Let PRT denote the set of limits of PR transcendental reals.
The set of limits of PR-Cauchy sequences coincides with.
Ifandare PR-Cauchy sequences then so are also,, and.
Ifis a PR-Cauchy sequence then so is also, even uniformly in r, i.e., there is a binary PR function M such thatfor all.
Every number in PRT is transcendental.
Items 1–3 are easy consequences of Proposition 4.1 and Theorem 4.2 in [8]. Item 4 (observed in the appendix of [14]) is obvious. □
We have, hence every number from PRT may be included in some PRAS-field.
Let be a PR transcendental real; for the first assertion, we have to show that is in . By Theorem 3, it suffices to show that the sign of the value may be found primitive recursively. Since s is transcendental by Lemma 1(4), we get the dichotomy: or . Therefore, it suffices to check that is a PR unary relation on r.
By Definition 5, there are PR functions k, N such that for every . By Lemma 1, there is a binary PR function M such that for all . For the number we then have and (because ). Therefore, iff . But f is a PR function, so is a PR relation.
For the second assertion, let . Then by the first assertion. Since is a PRAS-field, by Theorem 3 so is also the ordered field that contains s. □
The ordered fields,,, andare PRAS-fields.
In the appendix of [14] it is proved that , hence and are PRAS-fields by the proof of Theorem 5. By Corollary 2(2), and are also PRAS-fields. □
Again, the results of this section are more intricate than their computable analogues in [34]. We illustrate this by the ordered field . By the general fact in [34] mentioned in the beginning of Section 6, is a computable ordered field with splitting (the computable analogue of PRAS-fields). But we do not know whether it is a PRAS-field. The point is that it is open whether e and π are algebraically dependent (a long-standing open question in number theory). If yes, then is a PRAS field by Corollary 2(ii). If not, a serious additional investigation is still needed to see whether where α is a PRAS-constructivization of .
PR linear algebra
Here we show PR computability of some problems of linear algebra frequently used in applications.
As follows from an old result of F. Rellich (see e.g. [41]), the spectral problems discussed in this section are non-computable if we consider them, as is usually done in the books on linear algebra, for arbitrary real or complex matrices, and understand computability in the sense of A. Turing. This leads to computational instabilities when these problems are solved numerically, which was our original motivation to identify restricted computable versions of these problems. We will show that these problems are PR for matrices over any PRAS-field.
Recall that spectrum of any complex matrix from is a sequence of all eigenvalues of M (each eigenvalue occurs in the sequence several times, according to its multiplicity). The following fact immediately follows from Theorem 2 and Proposition 12.
Letbe a PRAS-field. Given n and a symmetric matrix, one can primitive recursively find a spectrum of M uniformly in n.
As is well known, all eigenvalues of any symmetric real matrix are real. Spectral decomposition of such a matrix is a pair where is the non-decreasing spectrum of A and is a corresponding orthonormal basis of eigenvectors, i.e. for .
Letbe a PRAS-field. Given n and a symmetric matrix, one can primitive recursively find a spectral decomposition of A uniformly in n.
By Proposition 19, we can primitive recursively compute the increasing sequence of all distinct roots of and the corresponding multiplicities . Using the Gauss method, we then primitive recursively find, for each , a basis for the eigenspace corresponding to . Applying the Gram–Schmidt orthonormalisation process which is (with simplified indices) given by the recurrent formulas
we primitive recursively obtain an orthonormal basis for this eigenspace. Putting together the orthonormal bases for all j, we obtain a desired orthornormal basis for the whole space. Of course, the orthonormal basis of eigenvectors is not unique. It is only important that some such basis may be found primitive recursively. □
The last proposition may be extended to a natural class of complex matrices. A matrix is normal if where is the conjugate matrix for , and A is self-adjoint if . Note that every symmetric real matrix is self-adjoint, and every self-adjoint matrix is normal. It is known that for any eigenvalue μ of a normal matrix A the multiplicity of μ coincides with the dimension of the corresponding eigenspace, and this eigenspace has a basis consisting of eigenvectors. The next extension of Proposition 20 is thus proved by the same argument.
Letbe a PRAS-field. Given n and a normal matrix, one can primitive recursively find a spectral decomposition of A uniformly in n.
By a matrix pencil we mean a pair (often written in the form ) of real non-degenerate symmetric matrices such that A is positive definite (i.e., all of its eigenvalues are positive). By spectral decomposition of such a pencil we mean a tuple
such that and are spectral decompositions of the symmetric matrices A and respectively, where L is the matrix formed by vectors written as columns, is the transposition of L, and .
Letbe a PRAS-field. Given n and a matrix pencilwith matrices A, B in, one can primitive recursively find a spectral decomposition ofuniformly in n.
First we find a spectral decomposition of A using the algorithm of Proposition 20. Then we primitive recursively find the matrix . Applying the algorithm of Proposition 20 to this matrix, we compute the remaining items , . Note that coincides with the spectrum of (in general, non-symmetric) matrix . □
An important normal form for square matrices over an algebraically closed field is the Jordan normal form. The next proposition gives a sufficient condition for PR-computability of this form similar to those given above. The proof, which is obtained by inspecting any standard algorithm solving this problem written with all details (as e.g. the algorithm in Section 18 of [12]), is omitted.
Letbe a PRAS-field. Given n and a matrix, one can primitive recursively and uniformly in n find a Jordan normal formfor M and a non-degenerate matrixwith.
PR analysis
Computable analysis, developed by many people, was systematized in [40]. A central notion of computable analysis (due to A. Turing) is the notion of a computable (partial) function on the reals and on more complex spaces. In this section we attempt to develop a small part of PR analysis. Our approach is somewhat related to earlier works [13,14].
For any , let be the computable numbering of n-ary PR operators on the Baire space from the end of Section 2. An example of unary PR operator is the function defined in Section 6. This operator is clearly a retraction of onto , i.e. for each and for . Recall that, by the definition, iff is fast Cauchy. Another example is the function defined at the end of Section 6. Note that every PR operator on is total and the class of such operators is closed under composition.
We proceed with defining PR functions on the reals. Similarly to the ideas of computable analysis, we can use a suitable surjection to transfer primitive recursiveness on to that on (and then, may be, to more complex spaces). Namely, we define and call this γ the Cauchy representation of . Note that γ is an admissible representation in the sense of [40], and it is computably equivalent to the Cauchy representation of defined in [40].
A partial function is called PR if there is a PR function (called a γ-realizer of f) such that for all .
Although this definition looks similar to the definition of a computable partial function on the reals, there is an important difference: while in the computable case the computable realizer may be partial, the PR-realizers are always total, as any PR operator on . Clearly, the PR functions on the reals are computable, and in fact they form a very restricted subclass of the computable functions. Nevertheless, many practically important functions are PR. We illustrate similarities and differences between computable and PR functions by providing some examples.
The functions +, ·, − on(and on) are PR.
For every polynomial, the corresponding evaluation functionis PR.
The reciprocal partial functionon(and on) is computable but not PR (cf. Remark
3
).
The class of PR functions (and the class of PR partial functions) onis closed under composition.
The 0-ary total functions oncoincide with the PR reals.
Letbe a PR partial function on the reals. Then its restrictiontois τ-PR.
1. This is proved by essentially the same argument as that in the proof of Proposition 16(1).
2. Follows from item 1.
3. The computability of the reciprocal partial function is well known (with a computable partial realizer). Suppose for a contradiction that it is PR and let g be its PR realizer (which is automatically total). Then g is computable, hence also continuous. Let and let be the unique sequence of rationals with . Since g is continuous, for a suitable n we have: for any fast Cauchy sequence of rationals with , , the corresponding sequence of rationals with , satisfies . Let and where . Note that the first element of the sequence is , and that whenever (because g is a realizer for ). Since and are fast Cauchy, we have , .
Let now be any integer with , and define as follows: , , and . Then , hence . A contradiction.
4. The assertion follows from the corresponding fact for realizers which are PR operators on .
5. Obvious.
6. Let g be a PR realizer for f, then for some (we use the notation and facts from the end of Section 2). It suffices to show that the PR function satisfies whenever is defined. Indeed, we have:
□
PR analysis is much more intricate than computable analysis. For instance, the computable version of the basic notion of “elementary function” is straightforward but the corresponding “correct” PR analogue is far from obvious, as demonstrated in particular by the facts about the reciprocal function. Nevertheless, we guess that many important concrete functions are PR. For instance, the results in the appendix to [14] suggest that this is the case for the functions sin, cos though some additional work is needed to adjust the arguments in [14] to our context.
An important notion of computable analysis is the notion of a computable metric space. Having in mind applications in the next section, we propose the following PR versions of this notion.
By a PR metric space we mean a triple where is a metric space, is a numbering of a dense subset , and there is a ternary PR sequence of rationals such that, for all m, n, is fast Cauchy .
For , by an α-PR metric space we mean a triple as above such that , for a suitable binary PR function f.
With any triple as above we can in the usual way associate the so-called Cauchy representation of M, i.e., the partial function from onto M as follows: iff the sequence is fast Cauchy and converges to x. For every α-PR metric space , the Cauchy representation is constructed more regularly. Namely, let the set and the function on be defined in the same way as the corresponding objects in Section 6 but with ν in place of ϰ and d in place of the usual distance function on the reals. Then again is a PR retraction from onto . We set whenever the limit exists.
Any ϰ-PR metric space is an α-PR metric space for every.
Ifis an α-PR metric space andis complete thenis total.
For every infinite α-PR metric spacethere is an injective numbering, sois an α-PR metric space and.
Every α-PR metric space is a PR metric space.
1. This follows from .
2. Obvious by the definition of Cauchy representation.
3. The numbering is constructed from ν in the same way as the numbering γ is constructed from β in the proof of Proposition 1. The properties of are obvious. Note that, say, the reduction between partial representations means that there is a unary PR operator f on such that for every .
4. Let f be a binary PR function f such that . Proposition 17(4) yields the sequence witnessing that is a PR metric space. □
Definition 7 naturally extends to the definition of a PR function between PR metric spaces:
Let and be PR metric spaces. A partial function is PR if it has a PR realizer w.r.t. , , i.e., there is a unary PR operator g on such that for every .
For readers’ convenience, we give examples of PR metric spaces (and normed spaces) and PR functions between them relevant to the next section; for more detailed definitions of these spaces see e.g. [35] and references therein. For any , the Euclidean vector space carries the sup-norm and the Euclidean norm ; we denote the corresponding metrics by and , respectively. Define the function by .
There are several natural subspaces and variations of the Euclidean spaces, in particular the space of symmetric real matrices, the space of symmetric real positively definite matrices, and the m-dimensional unitary cube . They have numberings of dense subsets induced by the corresponding numbering , using the easy fact that the sets , , and are PR.
Important modifications of the Euclidean spaces are the spaces of grid functions. Consider, for any positive integer N, the uniform rectangular grid on defined by the points
where , . Let be the corresponding spatial grid step and τ be a time step. Denote , where L is the number of the time steps. We will consider the grid norms
on the grid functions and the -norm
on the grid functions . The numberings of dense sets (formed by the rational functions on the grids) are induced by the numbering ϰ.
We work with several functional spaces most of which are subsets of the set of integrable continuous functions equipped with the -norm. In particular, we deal with the space (resp. ) of continuous (resp. k-time continuously differentiable) functions equipped with the -norm
We will also use the sup-norm
on or and the -norm
on where . Whenever we want to emphasize the norm we use notation like , or .
Associate with any rational grid function the continuous extension of f obtained by piecewise-linear interpolation on each coordinate, and similarly for grid functions . Such interpolations are known as multilinear interpolations. Note that the restriction of to any grid cell is a polynomial of degree m. The extensions induce a countable dense set in (or ) with any of the three norms induced by ϰ and natural numberings of the grids for all and of the grids for all and rational τ.
Along with the mentioned norms, their A-modifications, for a given matrix A, are useful. In particular, the A-modification of the -norms is defined by
while the A-modification of the -norms is defined by
and in a similar way for the grid norms.
The spacesandare ϰ-PR metric spaces uniformly in n.
The spaces S,, Q and the spaces of grid functions are ϰ-PR metric spaces uniformly in their dimensions.
For any, the spaces,, andare ϰ-PR metric spaces uniformly in n.
Letand let A be a symmetric matrix in. Then the spaces from (3), equipped with the A-modified metrics, are α-PR metric spaces uniformly in n.
The restrictionis a PR function fromto.
The operatoris a PR function fromto
Items (1,2) are obvious from the definition.
3. The proof is a straightforward calculation which shows that the distance between elements of the dense subsets is an algebraic real which is uniformly primitive recursively computable. Item (6) is considered similarly, only now calculations are made within the PRAS-field .
Items (4,5) follow from the definitions and well-known properties of the multilinear interpolations. □
PR solutions of PDE
Here we apply the above-developed theory to investigate the question when the solution operators for hyperbolic symmetric systems of PDE are PR. This complements the results in [34] and [36] where computability and bit complexity of such operators were examined.
For simplicity we discuss here only the Cauchy initial value problem (the boundary value problems are considered similarly) stated as follows:
Here and are non-degenerate symmetric -matrices, , , , , and is a partial function acting on the domain of existence and uniqueness of the Cauchy problem (1). The set H is known to be (see e.g. [36] for references and additional information) the intersection of semi-spaces
of where , are the minimum and maximum of the eigenvalues of .
Below we formulate sufficient conditions for PR-computability of the solution operator for (1) by putting some restrictions on matrices and functions φ, f. Matrix coefficients are usually in a real closed PRAS-field . The results below are PR analogues of the corresponding results in [35,36]. Most of the technical details are the same as in those papers, so we only give short proof sketches pointing to the new details.
We start with formulating two auxiliary facts. The next immediate corollary of Propositions 20 and 22 shows that we can primitive recursively compute H. Our algorithms for solving the Cauchy problem are for technical reasons presented only for the case when H satisfies the condition for all (which implies that H is compact); this condition often holds for natural physical systems.
Letbe a PRAS-field. Givenandas in (
1
), one can computeand check the conditionfor allprimitive recursively uniformly in m, n. Thus, the algorithm finds the domain H satisfying the condition above, or reports on the absence of such a domain.
We also need another immediate corollary of Propositions 20 and 22 about the spectral decomposition of the matrix A as in (1). Let , be respectively the maximum and minimum of . Let L be the orthonormal matrix formed by vectors written in columns, so , and let . For each , let be the spectral decomposition of the symmetric matrix . Let , be respectively the maximum and minimum of . Let and be the orthonormal matrix formed by vectors written in columns, so . Let for each .
Letbe a PRAS-field. Givenandas in (
1
), one can primitive recursively uniformly in m, n compute the quantities,,,,,,,(,) specified above.
Now we are able to formulate our results about PR-computability of the Cauchy problem. The last proposition contains all information used in the Godunov difference scheme which in the central part of our algorithm. All details of the algorithm are given in [36]. The next result is a PR-version of Theorem 5.2 in [34] (though Theorem 5.2 was about the boundary-value problem). Moreover, for notation simplicity we stick to the case , as in [36].
Letbe a PRAS-field and letbe integers. Then the solution operatorfor (
1
) is a PR-computable function (uniformly in m, n) fromtowhere S andare respectively the sets of all symmetric and symmetric positively definite matrices from,andfor.
We first make precise computations as in Propositions 27 and 28. With these quantities at hand, we repeat computations with the Godunov scheme as in Section 5.2. of [34]. Namely, we primitive recursively transform any given sequence of grid functions such that their multilinear interpolations form a fast Cauchy sequence converging in to φ, to a fast Cauchy sequence converging in to the solution of the Cauchy problem. For any k we first compute the time step as in Lemma 4.4 of [35]; this computation is PR. Then we compute the grid function by the algorithm of Godunov’s scheme; these computations are performed precisely within the field and they are PR since the involved metric spaces are α-PR (see Propositions 26 and 25(1)).
In this way, we primitive recursively transform any given sequence to the sequence . As shown in Sections 5.2 and 5.3 of [34], the corresponding sequence of interpolations satisfies where c is a constant depending only on . Moreover, the estimates in Sections 5.2 and 5.3 of [35] show that c is also computed primitive recursively. Let m satisfy , then the m-shift of is the desired fast Cauchy PR sequence of approximations to the solution of (1). □
For fixed , Theorem 6 of course implies PR-computability of the solution operator for (1). The next result (which is a PR-version of Theorem 5.1 in [34]) shows that the assumption may be weakened to .
Letbe integers andbe fixed matrices satisfying the conditions in (
1
) such thatfor all. Then the solution operatorfor (
1
) is a PR-computable function (uniformly in m, n) fromto,whenever φ satisfies the conditionsandfor.
All the quantities from Propositions 27 and 28 are fixed elements of because this field is real closed by Proposition 16(4). With these data at hand, all computations in the Godunov scheme are made within using only the operations +, ·, −, hence these computations are τ-PR by Proposition 16(1) where τ is the numbering of . Thus, the grid functions take now values in uniformly in k. In fact, we can work directly with the corresponding fast Cauchy PR sequences of rationals, and the family of all such sequences is uniformly PR, hence we can primitive recursively compute arbitrarily precise rational approximations to the grid functions . □
Let be the cardinalities of spectra of A and of the matrix pencils , resp. Theorem 5.3 in [34] (formulated there also for ) states that the operator sending any sequence of symmetric real matrices (with some restrictions similar to those in Theorem 6) such that the matrix pencils have no zero eigenvalues, to the solution of (1), is a computable partial function from the space to . The PR-version of this theorem would give just its strengthening to the claim that the operator is PR. Unfortunately, the proof in [35] does not straightforwardly yield this strengthening because it first computes “good enough” rational approximations to but this computation makes use of the unbounded search.
We conclude this section with the following PR-version of Theorem 2 in [36]. Note that formulation is broader than in [36] because now the algorithm is uniform on m, n, a and works with numbers beyond algebraic ones.
Letbe a PRAS-field. Given integers, matrices, and rational functions,as in (
1
), one can primitive recursively uniformly in m, n, a compute a rationalwith, a spatial rational grid step h dividing 1, a time grid step τ dividing T and an h, τ-grid functionsuch that, whereis the multilinear interpolation of the restriction of the grid function υ to H.
The proof is an easy modification of the proof of Theorem 2 in [36]. First we use Propositions 27 and 28 to primitive recursively compute input data for the difference scheme algorithm. Then we use the algorithm of Section 4.1 in [36] to compute the space and time grid steps h, τ which guarantee the estimate (for fixed parameters this algorithm works in polynomial time but uniformity requires a bit higher complexity). Then we use the algorithm of Godunov’s scheme which is written in detail in [36] as an explicit sequence of matrix computation which are precise computations within the field . The results of the current paper show that these computations are PR. Note that the resulting grid function takes values in . If needed, Proposition 17(4) may be used to primitive recursively compute a rational-valued grid function with the same precision estimate. □
Conclusion
Papers [34–36], and also this paper, is a mix of symbolic algorithms (which aim to find precise solutions), and approximate algorithms (which aim to find “good enough” approximations to precise solutions). The symbolic algorithms implemented e.g. in computer algebra systems correspond well to computations on discrete structures (with mathematical foundations in the classical computability and complexity theory). The approximate algorithms included in many numerical mathematics packages correspond well to computations on continuous structures (with mathematical foundations in the field of computability and complexity in analysis).
The fast progress of computation theory in the last decades made informal descriptions of several algorithms in standard textbooks in algebra and analysis insufficient and sometimes even incorrect. They typically remain correct when interpreted in countable discrete structures like those in Section 3, though a finer distinction between general computability and feasible computability is desirable. Some algorithms interpreted in continuous structures (like the real or complex numbers) become even incorrect (see examples in Section 8); it seems desirable to add corresponding comments (which mention the computable analysis approach) in the next editions of such textbooks.
Some open problems
We hope that the present paper demonstrates that PR computations is a natural next step in the investigation of this interaction because it provides a natural borderline between problems in algebra and analysis computable in principle and feasible problems. Although PR functions were thoroughly investigated in computability theory and proof theory, their study in computable structure theory and computable analysis seems still in the very beginning. There are many natural open questions about PR and more feasible computations, e.g.:
Is there a PR field such that the property of being a reducible polynomial is -PR but does not have PR splitting?
Is there a PR ordered subfield of which is not PR-Archimedean?
Is the algebraic closure of any PR field PR-constructivizable?
Is there a PR-constructive algebraically closed field without PR root-finding?
Is there such that ?
Describe the degree spectrum of the ordered field .
Is the field a PRAS-field?
Is there a PTIME-presentable ordered field of reals which contains a transcendental number?
Are the functions sin, cos on PR-computable?
Footnotes
Acknowledgements
The authors thank Pavel Alaev, Sergey Goncharov, Valentina Harizanov, Peter Hertling, Iskander Kalimullin, Julia Knight, Russell Miller, Andrey Morozov, and Xizhong Zheng for useful discussions and bibliographical hints.
This work is supported by Mathematical Center in Akademgorodok under agreement No. 075-15-2022-281 with the Ministry of Science and Higher Education of the Russian Federation.
List of the main abbreviations and notations
References
1.
P.E.Alaev and V.L.Selivanov, Polynomial-time presentations of algebraic number fields (extended abstract), in: Proceedings of the Conference Computability in Europe, F.Manea, R.Miller and D.Novotka, eds, LNCS, Vol. 10936, Springer, Berlin, 2018.
2.
P.E.Alaev and V.L.Selivanov, Fields of algebraic numbers computable in polynomial time I, Algebra and Logic58(6) (2019), 673–705, (Russian, there is an English translation). doi:10.33048/alglog.2019.58.601.
3.
S.Basu, R.Pollack and M.Roy, Algorithms in Real Algebraic Geometry, Springer, Heidelberg, 2006.
4.
N.Bazhenov, R.Downey, I.Kalimullin and A.Melnikov, Foundations of online structure theory, Bulletin of Symbolic Logic25(2) (2019), 141–181. doi:10.1017/bsl.2019.20.
5.
A.Borodin and R.El-Yaniv, Online Computation and Competitive Analysis, Cambridge University Press, 1998.
6.
O.Bournez, D.Graça and A.Pouly, Solving analytic differential equations in polynomial time over unbounded domains, in: Mathematical Foundations of Computer Science 2011, Lecture Notes in Comput. Sci., Vol. 6907, Springer, Heidelberg, 2011, pp. 170–181. doi:10.1007/978-3-642-22993-0_18.
7.
D.A.Cenzer and J.B.Remmel, Polynomial-time versus recursive models, Ann. Pure Appl. Logic54(1) (1991), 17–58. doi:10.1016/0168-0072(91)90008-A.
8.
Q.Chen, K.Su and X.Zheng, Primitive recursive real numbers, Mathematical Logic Quarterly53(4/5) (2007), 365–380. doi:10.1002/malq.200710005.
9.
Y.L.Ershov, Numbered fields, in: Proc. 3-rd Intern. Congr. for Logic, Methodology and Philosophy of Science, Amsterdam, 1967, 1968, pp. 31–35.
10.
Y.L.Ershov and S.S.Goncharov, Constructive Models, Scientific Book, Novosibirsk, 1999, (in Russian, there is an English Translation).
11.
A.Fröhlich and J.C.Shepherdson, Effective procedures in field theories, Philos. Trans. London Roy. Soc.248(950) (1956), 407–432. doi:10.1098/rsta.1956.0003.
12.
I.M.Gelfand, Lectures on Linear Algebra, Interscience Pulishers, New York, 1963.
13.
W.Gomaa, Algebraic characterizations of computable analysis real functions, Int. J. Unconv. Comput.7(4) (2011), 245–272.
14.
R.L.Goodstein, Recursive Analysis, North Holland, Amsterdam, 1961.
15.
S.Grigorieff, Every recursive linear ordering has a copy in DTIMESPACE(n, log(n)), J. Symb. Log.55(1) (1990), 260–276. doi:10.2307/2274966.
16.
P.Hertling, The set of primitive recursive reals is a real closed field (private communication).
17.
I.S.Kalimullin and R.Miller, Primitive recursive fields and categoricity, Algebra and Logic58(1) (2–19) (2019), 132–138, (Russian, there is an English translation).
A.Kawamura, F.Steinberg and H.Thies, Parameterized complexity for uniform operators on multidimensional analytic functions and ODE solving, in: Proc 25th Int. Workshop on Logic, Language, Information, and Computation (WOLLIC), 2018, pp. 223–236. doi:10.1007/978-3-662-57669-4_13.
20.
A.Kawamura, F.Steinberg and M.Ziegler, On the computational complexity of the Dirichlet problem for Poisson’s equation, Mathematical Structures in Computer Science27(8) (2017), 1437–1465. doi:10.1017/S096012951600013X.
21.
N.G.Khisamiev, Non-constructivizability of some ordered fields of real numbers, Siberian Mathematical Journal28(5) (1987), 193–195.
22.
I.Koswara, G.Pogudin, S.Selivanova and M.Ziegler, Bit-complexity of solving systems of linear evolutionary partial differential equations, in: Proc. 16th International Computer Science Symposium in Russia, LNCS, Vol. 12730, pp. 223–241.
23.
I.Koswara, S.Selivanova and M.Ziegler, Computational complexity of real powering and improved solving linear differential equations, in: LNCS, Vol. 11532, 2019.
24.
R.Loos, Computing in algebraic extensions, in: Computer Algebra: Symbolic and Algebraic Computations, Springer-Verlag, 1982, pp. 115–138. doi:10.1007/978-3-7091-3406-1_9.
25.
E.W.Madison, A note on computable real fields, J. Symbolic Logic35(2) (1970), 239–241. doi:10.2307/2270515.
26.
K.Mahler, An inequality for the discriminant of a polynomial, Michigan Mathematical Journal11 (1964), 257–262.
27.
A.I.Mal’cev, Constructive algebras, in: The Metamathematics of Algebraic Systems, Uspechi Mat. Nauk, Vol. 16, North Holand, Amsterdam, 1961, pp. 3–60, in Russian, English translation, 1971, p. 148–214.
28.
A.I.Mal’cev, Algorithms and Recursive Functions, Fizmatgiz, Moscow, 1964, (Russian, English translation: Wolters-Noordhoff, 1970.).
29.
R.Miller, Is it harder to factor a polynomial or to find a root?, Transactions of the American Mathematical Society362(10) (2010), 5261–5281. doi:10.1090/S0002-9947-2010-04918-9.
30.
R.Miller and V.Ocasio Gonzalez, Degree spectra of real closed fields, Archive for Mathematical Logic58 (2019), 387–411. doi:10.1007/s00153-018-0638-z.
31.
M.O.Rabin, Computable algebra, general theory and theory of computable fields, Trans. Amer. Math. Soc.95(2) (1960), 341–360. doi:10.1090/S0002-9947-1960-0113807-4.
32.
V.Selivanov and S.Selivanova, Primitive recursive ordered fields and some applications, in: CASC 2021, F.Boulieret al., eds, LNCS, Vol. 12865, 2021, pp. 353–369.
33.
V.L.Selivanov, On a class of reducibilities in recursion theory, Probabilistic Methods and Cybernetics, Kazan University18 (1982), 83–101, (Russian).
34.
S.Selivanova and V.Selivanov, Computing solution operators of boundary-value problems for some linear hyperbolic systems of PDEs, Logical Methods in Computer Science13(4:13) (2017), 1–31.
35.
S.V.Selivanova and V.L.Selivanov, On constructive number fields and computability of solutions of PDEs, Doklady Mathematics477(3) (2017), 282–285.
36.
S.V.Selivanova and V.L.Selivanov, Bit complexity of computing solutions for symmetric hyperbolic systems of PDEs with guaranteed precision, Computability10(2) (2021), 123–140.
37.
V.Stoltenberg-Hansen and J.V.Tucker, Computable rings and fields, in: Handbook of Computability Theory, E.Griffor, ed., Elsevier, 1999, pp. 363–447. doi:10.1016/S0049-237X(99)80028-7.
38.
A.Tarski, A Decision Method for Elementary Algebra and Geometry, 2nd edn, University of California Press, Berkeley and Los Angeles, California, 1951.
39.
B.L.van der Waerden, Algebra, Springer, Berlin, 1967.