Schnorr showed that a real X is Martin-Löf random if and only if for some constant c and all n, where K denotes the prefix-free complexity function. Fortnow (unpublished) and Nies, Stephan and Terwijn [J. Symbolic Logic70 (2005), 515–535] observed that the condition can be replaced with , for any fixed increasing computable sequence , in this characterization. The purpose of this note is to establish the following generalisation of this fact. We show that X is Martin-Löf random if and only if , where is any fixed pointedly X-computable sequence, in the sense that is computable from X in a self-delimiting way, so that at most the first bits of X are queried in the computation of . On the other hand, we also show that there are reals X which are very far from being Martin-Löf random, but for which there exists some X-computable sequence such that .
A well known result of Schnorr (see Chaitin [1]) is that Martin-Löf’s notion of algorithmic randomness from [9] can be expressed in terms of incompressibility with respect to prefix-free machines. In particular, a real X is Martin-Löf random if and only if , where K denotes the prefix-free complexity function. The latter condition says that there exists a constant c such that all the initial segments of X are c-incompressible (in a prefix-free sense). As reported in Downey and Hirschfeldt [3, Proposition 6.1.4], Fortnow (unpublished) and Nies, Stephan and Terwijn [11] showed that Schnorr’s characterisation remains valid if we replace the condition with , where is any computable increasing sequence.
In this note we consider the extent to which this fact can be generalised to incomputable increasing sequences . It is well known that there are reals which are not Martin-Löf random, yet have infinitely many 0-incompressible initial segments. Hence this characterisation does not hold for arbitrary increasing sequences . We consider the case when is computable from X. Our main result is that if is computable from X in a certain restricted way, then X is Martin-Löf random if and only if . On the other hand we show how to construct reals X and X-computable sequences such that the above equivalence fails, so we have but X is very far from being Martin-Löf random.
Pointed computability
Our main result is that if X computes in a certain natural fashion, then is a sufficient and necessary condition for the Martin-Löf randomness of X. In this section we formalise the notion of oracle-computability required in order for this equivalence to hold, which we call pointed computability.
A Turing functional Φ can be thought of as a machine which takes as inputs a number n and a program σ, and either halts on these inputs producing a number as output, or else diverges. The consistency of Φ requires that if and , then the computation is identical to that for , yielding the same output. Then can be defined as . Without loss of generality, given a Turing functional Φ, a string ρ and a number n, we may assume that implies and . This is a standard convention and it is not hard to see that if for two reals and a Turing functional Ψ which might not obey the convention, then there exists a Turing functional Φ which does obey the stated convention and for which .
Given a Turing functional Φ, a number n and strings , the consistency property says that if then we must have that , i.e. the finite oracles differ at a digit which is less than . The following definition is based on a more stringent consistency requirement.
(Pointed computations).
Given a real X, we say that a sequence is pointedly X-computable if is (strictly) increasing and there exists a Turing functional Φ such that for each n.
The latter condition in Definition 1.1 says that some oracle Turing machine computes each from X with oracle-use bounded above by . Note that, without loss of generality, we may assume that the oracle-use in this computation is exactly .
As a typical example of pointed computations (suppressing the monotonicity requirement for now), consider an oracle machine which starts on input n by reading increasingly longer initial segments of the oracle tape, and eventually stops after steps, with output s. If, for a given X, such a machine converges for every n, then it produces a pointed computation in the sense of Definition 1.1. Another example is the settling time of a non-computable c.e. set A: let and for each n let be the least number which is larger than and such that for all . Then is pointedly A-computable and non-computable.
Later we will note that there are weaker notions of computability which suffice for our characterization of Martin-Löf randomness. One such notion is the condition that for all n and all . Note that the latter is the non-uniform version of the notion of Definition 1.1.
Our results
Our main result is the following, which we prove in Section 2.
(Randomness condition).
Suppose thatis pointedly computable from a real X. Then X is Martin-Löf random if and only if.
It is well-known that there are reals which are not Martin-Löf random, yet have infinitely many incompressible initial segments. Hence Theorem 1.2 does not hold if we simply waive the requirement that is pointedly computable from X. One may ask, however, if Theorem 1.2 continues to hold if we merely require that is computable from X and not that it is pointedly X-computable. It is not surprising that the latter question has a negative answer. One way to exhibit an example witnessing this fact, is to construct a real with infinitely many incompressible initial segments, which computes the halting problem and is not Martin-Löf random. Since the prefix-free complexity function is computable from the halting problem , given such an oracle X we can effectively find infinitely many t such that . This gives the following fact.
Suppose that X computes the halting problem, X is not Martin-Löf random and there exists some constant c and infinitely many n such that. Then X computes an increasing sequencesuch thatfor all n.
In Section 3 we present two ways of constructing oracles X which have the properties mentioned in Proposition 1.3, thus establishing the following.
There exists a real X and an X-computable increasing sequence, such thatfor all n, and X is not Martin-Löf random.
Our first construction of such X involves starting from a Martin-Löf random Y which computes the halting problem, and inserting zeros at certain places, thus causing X to be non-random, while preserving its ability to calculate lengths at which its initial segments have high prefix-free complexity. The second construction of such an oracle X is more flexible, and gives a real which is highly non-random, in the sense that its characteristic sequence has a computable subsequence of zeros.
Related concepts and results from the literature
A central notion studied in this paper is that of a set X which is able to compute a sequence of positions in its binary expansion where the corresponding initial segments are incompressible. Clearly every Martin-Löf random has this property, but there are also many reals with this property which are not Martin-Löf random. This notion might remind some readers of the autocomplex reals (see [6,7] or [3, Section 8.16]), which are the reals X which compute a non-decreasing unbounded function f such that for all n. Moreover, Theorem 1.2 has similarities to a result by Miller and Yu [10], which says that if and g is computable from X with identity oracle-use, then . Note that the latter result can be seen as an extension of the following consequence of the Kraft-Chaitin inequality:
It is clear that the result of Miller and Yu [10] is related to its special case (1) in the same way as our Theorem 1.2 is related to results originally obtained by Fortnow (unpublished) and Nies, Stephan and Terwijn [11], discussed earlier.
We need to show that if is pointedly X-computable, then X is Martin-Löf random if and only if .
The ‘only if’ direction in this statement is trivial, so it remains to show the ‘if’ direction. We prove the contrapositive. Assuming that X is not Martin-Löf random and is pointedly X-computable, we show that for each constant c there exists some n such that . Let Φ be a Turing functional such that for all n, and such that for every n, r, ρ such that we have , , and for all . Let U be the underlying optimal universal prefix-free machine.
We define a prefix-free machine M which makes use of the descriptions of U as follows. For each vector , such that:
for all and for all ;
and ;
let τ be the digits of ρ between digit t and digit and note that
Let M describe with the string , defining . This completes the definition of M.
It follows immediately from the definition that M is effectively calculable. Next we show that M does not allocate two different strings the same description. Given two identical M-descriptions , since U is a prefix-free machine we must have and . By the construction of M, the string described in both cases is then . In a similar manner, we may show that M is a prefix-free machine. Suppose that are two descriptions issued by M, resulting from the vectors , respectively. Since U is a prefix-free machine and , are U-descriptions, we have , and . Let σ be and let t be . Then and hence1
An intuitive description of the argument that follows for showing that is this: each of determine a sequence , , although may be able to define for . However so by the construction of M we have that both , equal the digits of (or equivalently ) between digit t and digit .
Thus , and t belongs to both intervals. This means that , because otherwise would have to belong to a different interval, not the one determined by and , since the values of Φ are strictly monotone. This would be a contradiction by the choice of in the definition of M and the fact that which was established earlier. So let . Since and , by (2) the strings , have the same length, so , which shows that the two descriptions , are identical. This completes the proof that M is a prefix-free machine.
It remains to show that if X is not Martin-Löf random, then for each c there exists some n with . Let d be a constant such that for all strings η. Given any constant c, since X is not Martin-Löf random, there exists some such that . Let n be such that . Then M will describe with where σ is the shortest description of and the length of τ is . The length of σ is , which is at most . We have:
So , as required.
As discussed in the introduction, we present two different constructions of a real X which computes an increasing sequence such that for all n and X is not Martin-Löf random.
An ad hoc construction
One way to construct a real X with the property of Proposition 1.3 is to start from a Martin-Löf random real Y which computes the halting problem, and insert zeros into Y in a way that does not change the fact that is computable from the resulting oracle, but does ensure non-randomness. Recall that a Martin-Löf random real Y which computes the halting problem exists by the Kučera–Gács theorem [5,8]. In this construction we use the result of Chaitin [1], which asserts that:
We also use the fact that for each real Z which is Martin-Löf random and each string σ, the real is Martin-Löf random, and the fact from [2] that:
The reader may observe that a partial computable prediction rule f as above which is always successful on Z would give rise to a computable martingale which succeeds on Z, which we know is not possible for Martin-Löf random reals (e.g. see [3, Section 6.3]).
Let Φ be a functional via which Y computes the complexity function K, i.e. such that for all σ. We form X from Y by inserting 0s at various positions, in a stage by stage process. The real X is defined as the limit of a sequence and we form each from by inserting a 0 at position , which means that we define for , for and for . At stage 0 we define , and (for convenience) define . Now inductively suppose that we have performed stages , and that we have recorded . For any string , let be the string which results from removing all of the 0s that we have inserted during the stages . At step we search for of and with such that computes and . By (3), it follows that such σ and τ exist. Then we define and insert a 0 at position .
This completes the construction of X given Y. From the construction it follows that X computes both Y and the sequence . This follows because X is able to retrace the construction. Inductively suppose that X has been able to retrace the construction up until the end of stage k, and so knows the values . Then, using the oracle for X we can perform the same search that was carried out at stage , but using X rather than : we search for of and with such that computes and . Since the next zero is inserted after τ, the result of the search is the same as when was used during the construction at stage . Then , completing the induction step. Therefore X computes the halting set . Moreover there is a partial computable function f such that for each we have if and only if for some k (f uses σ as an oracle to try and retrace the construction and converges on σ if it is of length for some k in the retraced construction). For each k, the next digit of X is a 0, so f is a partial computable prediction rule that succeeds on X, which means that X is not Martin-Löf random. This completes the construction of a set X with the properties of Proposition 1.3.
A refined construction
Here we construct the required X by finite extensions. This construction can be combined with other requirements. For example, X can be highly non-random, in the sense that it has a computable sequence of 0s. We need some facts from the theory of prefix-free Kolmogorov complexity. For each string σ, let denote the shortest prefix-free description of σ (if there are many shortest descriptions, we consider the one which describes σ first). Also let denote the prefix-free complexity of τ relative to string ρ. The following is a relativized version of Chaitin’s counting theorem from [1].
(Relativized counting theorem).
There exists a constant c such that for all σ, r and all:
Given σ we define for to be the of the weight of the prefix-free descriptions relative to which describe extensions of σ of length n. Then since the relative prefix-free complexity K is a minimal information measure, there exists a constant c such that for all n, σ,
We claim that the constant c has the property of the statement of the lemma. For a contradiction, suppose that this is not the case. Then for some n there are more than many τ such that . In that case we have
which contradicts (5). This contradiction concludes the proof of the lemma. □
Recall the symmetry of information fact from [1,4]:
where for two functions f, g means that is bounded above. Since for all strings σ, τ, by the symmetry of information, Lemma 3.1 has the following corollary.
(Relativized counting, again).
There exists a constant c such thatfor alland all.
Corollary 3.2 is the tool we are going to use for our finite extension construction. The problem we face is, given a string σ to find an extension τ such that . Since there are many extensions of σ of length n, by Corollary 3.2 it suffices to consider n such that , which means that so
Such a number n clearly exists in the interval . The quantity is sometimes called the randomness deficiency of σ. We have shown that:
We are ready to construct the required real X by finite extensions
In this construction the lengths will be computable while the strings will be chosen so that for all i. For each i the string will be the concatenation of with a string such that . So for each i the string will be uniformly computable from : simply find the first 1 starting from position in and moving to the left, and if this 1 is at position t then . Let c be the constant in (6).
Let be the empty string λ, so that . Let be the string and let . Note that the last digit of is a 0. By (6) there exists an extension of such that and . Then let be the concatenation of with a string such that the length is . Note that is longer than by at least 2 bits, so the last digit of is a 0. Similarly, we can choose an extension of of less than many additional bits such that . As before we let be the concatenation of with a string such that the length of is . Note that is longer than by at least 2 bits, so the last digit of is a 0.
The construction continues similarly, thus defining the computable sequence of lengths for each , where , and the sequences (7) such that for all we have , and the last digit of is 0. If we let X be the infinite extensions of the strings (7) then we have for all i, so X is not Martin-Löf random. On the other hand for all i, and since uniformly computes , we have that the sequence is X-computable. Finally for all i, which concludes the verification of the required properties of X.
Conclusion and discussion
We have generalized the criterion for Martin-Löf randomness by Fortnow (unpublished) and Nies, Stephan and Terwijn [11], which says that if X has incompressible segments of a computable sequence of lengths , then it is Martin-Löf random. We proved that the condition that is computable can be replaced by the weaker condition that is pointedly X-computable, in the sense that is uniformly computable from any extension of . It is a simple exercise to extend our proof of this fact in order to replace the condition of pointed computation with a non-uniform version of it, namely that for all n and all . On the other hand, we showed that this condition is no longer sufficient for Martin-Löf randomness, if we merely require that be computable from X. It would be interesting to refine this analysis and find exactly what kind of computations are allowed of a sequence from an oracle X such that the Martin-Löf randomness of X is equivalent to the segments being incompressible.
Footnotes
Acknowledgements
Barmpalias was supported by the 1000 Talents Program for Young Scholars from the Chinese Government, grant no. D1101130. Additional support was received by the Chinese Academy of Sciences (CAS) and the Institute of Software of the CAS. Lewis-Pye was supported by a Royal Society University Research Fellowship. Angsheng Li was partially supported by the National Basic Science Program (973 Program Group) entitled Cyber Information and Computational Theory on Big Data with Grant No. 2014CB340302.
References
1.
G.J.Chaitin, A theory of program size formally identical to information theory, J. Assoc. Comput. Mach.22 (1975), 329–340. doi:10.1145/321892.321894.
2.
G.J.Chaitin, Incompleteness theorems for random reals, Advances in Applied Mathematics8 (1987), 119–146. doi:10.1016/0196-8858(87)90010-8.
3.
R.G.Downey and D.Hirshfeldt, Algorithmic Randomness and Complexity, Springer, 2010.
4.
P.Gács, The symmetry of algorithmic information, Dokl. Akad. Nauk SSSR218 (1974), 1265–1267.
5.
P.Gács, Every sequence is reducible to a random one, Inform. and Control70(2–3) (1986), 186–192. doi:10.1016/S0019-9958(86)80004-3.
6.
B.Kjos-Hanssen, W.Merkle and F.Stephan, Kolmogorov complexity and the recursion theorem, in: STACS, 2006, pp. 149–161.
7.
B.Kjos-Hanssen, W.Merkle and F.Stephan, Kolmogorov complexity and the recursion theorem, Trans. Amer. Math. Soc.363 (2011).
8.
A.Kučera, Measure, -classes and complete extensions of , in: Recursion Theory Week, Oberwolfach, 1984, Lecture Notes in Math., Vol. 1141, Springer, Berlin, 1985, pp. 245–259. doi:10.1007/BFb0076224.
9.
P.Martin-Löf, The definition of random sequences, Information and Control9 (1966), 602–619. doi:10.1016/S0019-9958(66)80018-9.
10.
J.S.Miller and L.Yu, Oscillation in the initial segment complexity of random reals, Adv. Math.226(6) (2011), 4816–4840. doi:10.1016/j.aim.2010.12.022.
11.
A.Nies, F.Stephan and S.A.Terwijn, Randomness, relativization and Turing degrees, J. Symbolic Logic70(2) (2005), 515–535. doi:10.2178/jsl/1120224726.