Most of the physical processes arising in nature are modeled by differential equations, either ordinary (example: the spring/mass/damper system) or partial (example: heat diffusion). From the point of view of analog computability, the existence of an effective way to obtain solutions (either exact or approximate) of these systems is essential.
A pioneering model of analog computation is the General Purpose Analog Computer (GPAC), introduced by Shannon [Journal of Mathematical Physics20 (1941), 337–354] as a model of the Differential Analyzer and improved by Pour-El [Transactions of the American Mathematical Society199 (1974), 1–28], Lipshitz and Rubel [Proceedings of the American Mathematical Society99(2) (1987)], Costa and Graça [Journal of Complexity19(5) (2003), 644–664] and others. The GPAC is capable of manipulating real-valued data streams. Its power is known to be characterized by the class of differentially algebraic functions, which includes the solutions of initial value problems for ordinary differential equations.
We address one of the limitations of this model, which is its fundamental inability to reason about functions of more than one independent variable (the ‘time’ variable), as noted by Rubel [Advances in Applied Mathematics14(1) (1993), 39–50]. In particular, the Shannon GPAC cannot be used to specify solutions of partial differential equations. We extend the class of data types using networks with channels which carry information on a general complete metric space X; here we take , the class of continuous functions of one real (spatial) variable.
We consider the original modules in Shannon’s construction (constants, adders, multipliers, integrators) and we add a differential module which has one input and one output. For input u, it outputs the spatial derivative .
We then define an X-GPAC to be a network built with X-stream channels and the above-mentioned modules. This leads us to a framework in which the specifications of such analog systems are given by fixed points of certain operators on continuous data streams. Such a framework was considered by Tucker and Zucker [Theoretical Computer Science371 (2007), 115–146]. We study the properties of these analog systems and their associated operators, and present a characterization of the X-GPAC-generable functions which generalizes Shannon’s results.
Analog computation, as conceived by Kelvin [30], Bush [2], and Hartree [10], is a form of experimental computation with physical systems called analog devices or analog computers. Historically, data are represented by measurable physical quantities, including lengths, shaft rotation, voltage, current, resistance, etc., and the analog devices that process these representations are made from mechanical, electromechanical or electronic components [11,13,29].
A general purpose analog computer (GPAC) was introduced by Shannon [28] as a model of Bush’s Differential Analyzer [2]. Shannon discovered that a function can be generated by a GPAC if, and only if, it is differentially algebraic, but his proof was incomplete. A basic study was made by Pour-El [24] who gave some good characterizations of the analog computable functions, focusing on the classic analog systems built from constants, adders, multipliers and integrators. This yielded a stronger model and a new proof of the Shannon’s equivalence (and some new gaps, corrected by Lipshitz and Rubel [18]). Using this characterization in terms of algebraic differential equations, Pour-El showed that not all computable functions on the reals (in the sense of computable analysis) can be obtained with these analog networks.
The theory of analog computing has also been developed by Moore with some very general mathematical models [20]. These models, using schemes rather like Kleene’s [14], but with primitive recursion replaced by integration and others added, define a hierarchy of functions on the reals, which contains the GPAC generable functions at its lowest level, and uncomputable functions (in the sense of computable analysis) at higher levels. Graça and Costa [6] have presented an improved model of the GPAC, and shown this to be equivalent to the lowest level subclass of Moore’s functions.
The contributions of Campagnolo [3] and Mycka [21] have also presented some fine results concerning analog complexity classes. Finally, Pouly [23] studied in his PhD thesis the GPAC (among other models of computation) from the point of view of complexity classes, and with Bournez and Graça [1] they have defined a multidimensional GPAC (however, their model can be formulated as working under a single, ‘implicit time’ variable, as will be discussed below).
The main objects of our study are analog networks or analog systems, [12,32–34], whose main components are described as follows:
We will model data as elements of a complete metric vector space X, such as a Banach or Fréchet space. We will use a bounded interval of the real numbers as a continuous model of time, where T denotes the final time. Each channel carries a continuously differentiable stream, represented as a function (this space is denoted by ). Each module M has zero, one or more input channels, and must have a single output channel; thus it can be specified by a (possibly partially defined) stream function
In the case that , we obtain the Shannon GPAC. We can use four types of modules to describe this model, which are equivalent to the ones originally used by Shannon.
(Shannon modules).
The Shannon modules are defined as follows:
for each , there is a constant module with zero inputs and one output v, given by
the adder module has two inputs u, v and one output w, given by
the multiplier module has two inputs u, v and one output w, given by
the integrator module has an initial setting c, two inputs u, v and one output w, given by the Lebesgue-Stieltjes integral
We can depict the four Shannon modules in box diagrams, as in Fig. 1. We also introduce the symbol ‘’ todenote the operator associated with the integrator module, in order to differentiate from the actual integral; we can then write .
The four Shannon modules.
The continuous differentiability of the streams u, v ensures that the integrator module is well defined; indeed, the Lebesgue-Stieltjes integral is well defined for continuous integrand and continuously differentiable integrator. In other words, for any , the formula defines a function in .
(Shannon GPAC).
A Shannon general purpose analog computer (GPAC) is a network built with the four Shannon modules (constants, adders, multipliers and integrators) and connections between their inputs and outputs, with the following restrictions:
the only connections allowed are between an output and an input;
each input may be connected to either zero or one output.
Of course, there can be cycles in a GPAC, for example, an output connected to an input of its own module. This is called feedback and it is fundamental to develop an interesting theory. A simple example of a Shannon GPAC can be seen in Fig. 2. It has only one module, which is an integrator module, and only one connection, between its output channel and one of its input channels.
In his paper Shannon sets out to characterize the class of functions which can be generated by a GPAC and in doing so he found an equivalence with the class of differentially algebraic functions.
A GPAC for computing the exponential function.
(Differentially algebraic function).
A function is said to be differentially algebraic if there exists and a polynomial P in variables (and real coefficients) such that and
An equation in the form (1) is called a differential algebraic equation.
(GPAC characterization theorem).
Let. Then u is generable by a GPAC if and only if u is differentially algebraic.
The original proof of Theorem 1 can be found in [28], but that proof had flaws, which were corrected in the papers [6,18,24].
In this paper we present a generalization of the Shannon GPAC for channels whose values lie in a general complete metric vector space, i.e. a Banach or Fréchet space. This allows us to, for example, work with functions of more than one variable. Our goal is to obtain an equivalence result similar to Theorem 1, with a larger class of functions which include, in particular, solutions to well-known PDEs, such as the heat equation and wave equation.
The paper is organized as follows. In Section 2 we show some limitations to Shannon’s model and motivate our transition to function data spaces. In Section 3 we present our new model, the X-GPAC, and define its semantics. In Section 4 we introduce normal form systems which are used as an intermediate step towards the main result. In Section 5 we introduce partial differential algebraic systems and prove our main result: a characterization of X-GPAC-generable functions in terms of solutions to such systems. In Section 6 we summarize our findings and propose directions for further research.
Limitations of the Shannon GPAC
The Shannon GPAC is regarded as an important and powerful method of analog computation, thanks largely to Theorem 1. Despite this, many authors have pointed out some limitations to the model. For example, the gamma function
is not differentially algebraic, and so cannot be generated by a GPAC (this was noted by Shannon himself). However, one could expect that, in a ‘sensible’ model of computability on continuous data, this function would be computable. Indeed, the gamma function is effectively computable in the sense of computable analysis, a branch of analog computability studied by Pour-El, Richards [25], Weihrauch [35], Grzegorczyk [7,8], Lacombe [15–17], Tucker, Zucker [32], among others. Some authors have addressed this limitation, and Graça [5] showed that the gamma function can indeed be considered as GPAC computable if
…we redefine our notion of GPAC-computability in a manner that it matches more closely the philosophy underlying computable analysis….
There is, however, another limitation with the Shannon GPAC, that appears to have been overlooked by Shannon, Pour-El and others. It lies in the fact that the Shannon GPAC can fundamentally reason only about real-valued functions of one independent variable t. Ironically, it was stated in [28] and [24] that the generalization to more than one independent variable only requires an obvious modification, but this is by no means the case. In fact, it is hard to conceive a realistic physical interpretation for a formalism involving two (or more) independent “time” variables.
We briefly remark that this limitation was pointed out in [27]. Rubel says:
For one thing, the GPAC works in one (“time”) variable only, while the EAC [Extended Analog Computer] produces functions of any finite number of real variables.
To address this problem, Rubel defined what he called an Extended Analog Computer (EAC).1
An implementation of the EAC (or at least, of some of its components) has been achieved with the work of Mills [19].
However, Rubel stressed that
…the EAC is a conceptual computer – the extent to which it can be realized by actual physical, chemical, or biological devices or systems remains to be investigated.
A different attempt to deal with this problem was recently proposed by Bournez, Graça and Pouly [1,23]. In their approach, channels can carry a n-variable real-valued data stream of type . In this way, they were able to introduce functions with multiple variables by extending the input space; for example, replacing with . This seems to be a very natural way of generalizing the Shannon GPAC.
Despite the fact that [1, Definition 14] uses Jacobians (which imply independent variables), we would like to point out that their model can still be re-expressed in terms of only one (implicit “time”) variable. This idea is present in [1, Examples 12 and 13]. It also occurs in [1, Remark 15], where it is explained that the value of a generable function y at a given point x can be obtained by solving an initial value problem in one independent variable (this is done by introducing a smooth curve γ from , an initial point, to x).
In this paper we adopt an approach which in some way is orthogonal to the one in [1]; our idea is to extend the output space, that is, replacing with , where X is a metric vector space. For example, we can think of X as the space of continuous real-valued functions on a bounded domain , that is, . In this way, our channels will now carry X-valued streams of data , which correspond to functions of real variables, under the uncurrying
It is evident that one of the variables, namely the “time” variable, plays a different role from the others. Our approach is, to some extent, motivated by the theory of Partial Differential Equations, in which some fundamental problems (such as the Heat Equation, Wave Equation and Schrödinger Equation) can be expressed as time evolution problems in a function space.
The X-GPAC
As discussed in the previous section we decide to change our data space X to become a function space. In this paper we shall thus take X to be the space of continuous real functions of a real variable,
We observe that X is a Fréchet space, with the family of pseudonorms
We also consider the subspace of continuously differentiable functions. This is also a Fréchet space, with the family of pseudonorms
Note that D is a linear and dense (under the X-pseudonorms) subspace of X.
We can define a differential operator as
We establish some important properties of the differential operator:
is a partial function from X to X, with domain ;
is linear, that is, for all and we have ;
has dense domain, that is, D is dense in X (under the topology in X induced by its pseudonorms);
has a closed graph, that is, if is a sequence in D with and , then and .
We include here the definition of closed operator, which will play a role in our notion of well-posedness.
(Closed operator).
Let X and Y be metric spaces and a partial function with domain . We say that A is closed if its graph is a closed subset of ; in other words, if for all sequences in X, and we have
Hence is a closed operator on X. We remind the reader that closedness is, in general, a weaker property than continuity. We also remark that both are equivalent in the space of total linear operators between Banach spaces (this basic result is known as the Closed Graph Theorem).
Plot of (left) and (right) for (red, bold), (green, dashed), (blue, dotted).
Consider the sequence , which converges in (that is, in the pseudonorms of X) to 0; for any M, . Moreover, each , and . Note that, for any M, , meaning that the suprema of grow without bounds. Thus is a discontinuous operator. See Fig. 3.
We consider X-streams as elements in the space of X-valued, continuously differentiable functions, for some . By continuous differentiability we mean that, for , the expression
is well-defined for all and v is a continuous function of time.
In this way, is a Fréchet space under the family of pseudonorms
note that in the right-hand side we consider pseudonorms of X.
The Shannon modules are easily defined in this new setting, and we introduce a new module based on the differential operator.
The differential module (see Fig. 4) has one input u and one output v, given by
We remark that the differential module is partially defined and its domain is . As mentioned above, is a closed but discontinuous operator.
The differential module.
With the above considerations in mind we can arrive at the desired generalization of the Shannon GPAC.
(X-GPAC).
An X-valued general purpose analog computer (X-GPAC) is a network built with the five X-modules (constants, adders, multipliers, integrators and differentials) and X-channels connecting their inputs and outputs, with the following restrictions:
the only connections allowed are between an output and an input;
each input may be connected to either zero or one output.
Our next goal is to assign semantics to an X-GPAC, that is, determine how to define generable functions. For that end, we introduce the notion of induced operator.
(X-GPAC induced operator).
Let be an X-GPAC;
the constant space of is the Cartesian product of the spaces associated with all the initial settings occuring in any integrator. The constant space can be written as , for some ;
the proper input space of is the Cartesian product of the spaces associated with all the unconnected input channels. The input space can be written as , for some ;
the proper output space of is the Cartesian product of the spaces associated with all the unconnected output channels. The output space can be written as , for some ;
the mixed space of is the Cartesian product of the spaces associated with all the channels which connect some input with some output. The mixed space can be written as , for some ;
the induced operator of is the function
where g is an X-valued vector and each u is a vector of X-channels. Moreover, each of the components in the codomain of F is given by the module with which it is associated. In other words, for each component of either or ,
if is associated with the output channel of a constant, then , where g is the constant associated with that module;
if is associated with the output channel of an adder, then , where and are the components in or associated with the input channels of that module;
if is associated with the output channel of a multiplier, then , where and are the components in or associated with the input channels of that module;
if is associated with the output channel of an integrator, then , where are the components in or associated with the input channels of that module, and g is the component in g associated with the initial setting of that module;
if is associated with the output channel of a differential, then , where v is the component in or associated with the input channel of that module.
We remark that F may be partially defined; for each differential module occuring in , there is a component of which is restricted to . Hence, to describe the domain of F we must take into special consideration those channels which are inputs of differential modules.
To achieve a better understanding of Definition 3.5 we provide an example in Fig. 5 of an X-GPAC with one constant and four X-channels.
An X-GPAC implementing a transport equation.
In this example there is one constant (associated with the integrator module), one input channel (labeled ), two mixed channels (labeled and ) and one output channel (labeled ). The induced operator simply formalizes the input/output relation between these channels,
Definition 3.4 gives a lot of freedom in the construction of X-GPACs and it turns out that not all of the possible networks lead to ‘valid and interesting’ X-GPACs (similarly to the fact that not all ASCII expressions lead to ‘valid and interesting’ computer programs). Thus we present a well-posedness-like notion to restrict the space of X-GPACs that we wish to consider.
(Quasi-well-posedness of X-GPAC).
Let be an X-GPAC and be its induced operator. Let . We say that is quasi-well-posed on U if
(existence) for every , there exists such that
(uniqueness) for every , the tuple such that Eq. (6) holds is unique;
(closedness) the map , with domain U and codomain , given as the unique solution of Eq. (6), defines a closed operator.
We may refer to Eq. (6) as the fixed point equation; note that the mixed variables are the only ones that appear in both sides of the equation.
If we required continuity instead of closedness (that is, if we required U to be an open set, and the map to be continuous), then our definition would match the three usual principles for well-posedness – existence, uniqueness, continuity of solutions – as presented by Hadamard [9] (see also [4]). Instead, we choose to use closedness (and a non-necessarily open domain U), which is a strictly weaker criterion, hence the term ‘quasi-well-posed’. The reason for choosing closedness is the presence of the differential module, which defines a closed function of type which is not continuous.
Admittedly, some could argue that a discontinuous operation is of little interest in the study of computable functions of continuous spaces. We must then make the important remark that continuity can be obtained from closedness (and thus well-posedness can be obtained by quasi-well-posedness) if we define a finer topology in the domain, induced by graph (pseudo)norms. To be precise, we recall the following basic result in functional analysis.
Letandbe Banach spaces anda closed linear operator with domain. Then
is a Banach space with the graph norm given by
the restrictionis a continuous linear map between Banach spaces.
We first prove that defines a norm:
if , then iff iff iff ;
if and , then ;
if , then .
Next we prove that is complete. Let be a Cauchy sequence in , so that vanishes (uniformly on k) as . In particular, we must have that is a Cauchy sequence in X (under the X-norm) and is a Cauchy sequence in Y. Since X and Y are Banach spaces it follows that there exist and such that and . By closedness of A we conclude that and , so that in (under the graph norm). Thus is a Banach space.
Finally we prove that is continuous. Let be a sequence in and such that in . Then , which implies and , so that, in particular, in Y. □
Let X and Y be Fréchet spaces with families of pseudonormsandanda closed linear operator with domain. Consider the Fréchet spacewith graph pseudonorms given by
Then the restrictionis a continuous linear map between Fréchet spaces.
The proof is similar to that of Proposition 3.8. □
This finer topology is usually equivalent to a topology of interest in the domain space. For example, consider the differential operator given by Eq. (4), which is closed but not continuous under the usual family of pseudonorms in . However, it becomes a continuous operator if we restrict it to the space and consider the graph pseudonorms
under whose topology is a Fréchet space. Moreover, this family of pseudonorms can be seen to be equivalent to the usual family of pseudonorms in given by Eq. (3).
We shall then adopt the notion of quasi-well-posedness in this paper, while reminding ourselves that, if needed, we can in principle express our results in terms of well-posed operators.
The final step in this section is to assign semantics to X-GPACs, that is, to define the notion of X-GPAC-generable functions.
(Semantics of X-GPAC).
Let be an X-GPAC and be its induced operator. Let such that is quasi-well-posed on U. We define the specification of as the (partial) function
whose domain is U and where is given by Eq. (6). We also say that generates Φ on .
A function is X-GPAC-generable if there exists an X-GPAC such that is quasi-well-posed on the domain of Φ and Φ is the specification of .
We remark that every integrator in an X-GPAC has an initial setting (which is one of the constants in the space ) and an output (which is one of the mixed/output channels in ). Since we can define an injective map from the initial settings to the mixed/output channels, we have the following basic property.
Ifis X-GPAC-generable, then.
Normal form systems
We have defined in the previous section the class of X-GPAC-generable functions, which constitute our space of interest. We can state our objective as follows.
Characterize the class of X-GPAC-generable functions in terms of a suitable generalization of the class of differential algebraic equations.
In the study of the GPAC, an intermediate step is usually taken in the transition from generable functions to differential algebraic equations. For example, in [28] a system of equations called a fundamental solvability condition was considered (Theorem I in that paper). Also in [24] a similar system of equations is used in the actual definition of GPAC generable functions (Definition 10 in that paper) instead of the usual definition involving analog networks. We shall generalize that notion into our framework, and refer to the resulting objects as normal form systems.
(Normal form equation).
Let . A normal form equation on the N variables is an equation of the form
under the conventions that and , are real numbers.
We remark that is not a variable, just a notational convenience to obtain a more compact equation. We also note that index i starts at 0 whereas index j starts at 1; thus Eq. (7) will not include the term (which would be equal to 0, and therefore irrelevant).
We also alert the reader to our choice of terms of the form in the second summation in Eq. (7), with derivatives both in time and space. One could think that a similar definition of normal form equations with terms of the form would be more ‘natural’. In fact, both definitions would be equivalent, and we could move from the former to the latter by adding extra variables (namely, one would have to add the extra variable t that specifies “linear time”, ). The main reason for choosing Eq. (7) as our template for normal form equations is of practicality, as it makes the proof of Lemma 4.7 (below) much simpler.
Here are some examples of normal form equations:
(Normal form system over X).
Let and . A normal form system (NFS) on the N variables is a system of the form
under the conventions that , , are real numbers and .
We say that are the (initial) constants, are the inputs or independent variables and are the outputs or dependent variables.
We briefly remark that, in a well-posed system of equations, the number of equations and the number of unknowns must be the same. In the previous definition, these correspond to the outputs ; hence there must be L equations.
(Quasi-well-posedness of NFS).
Let and . Let be an NFS given by Eq. (8) with K inputs and L outputs and consider the spaces
Let . We say that is quasi-well-posed on U if
(existence) for every , there exists such that Eq. (8) holds for , where , , ;
(uniqueness) for every , the tuple such that Eq. (8) holds is unique;
(closedness) the map , with domain U and codomain , given as the unique solution of Eq. (8), defines a closed operator.
(Semantics of NFS).
Let and . Let be an NFS with K inputs and L outputs. Let such that is quasi-well-posed on U. We define the solution of as the (partial) function
whose domain is U and where is given by Eq. (8). We also say that generates Φ on .
A function is NFS-generable if there exists an NFS such that is quasi-well-posed on the domain of Φ and Φ is the solution of .
We remark that in an NFS, there is a bijection between the initial conditions and the outputs; thus we have the following basic property (cf. Proposition 3.11).
Ifis NFS-generable, then.
We have established semantics for NFS, and the next step is to show that every X-GPAC-generable function is a projection of an NFS-generable function, as in the following definition.
(Function projection).
Let and , and let
be their graphs. We say that F is a projection of if for all ,
if then for all , we have ;
if then there exist unique and such that .
We briefly remark that the notion of projection induces a partial order in the class of functions. We have the following lemma.
(X-GPAC-generable implies NFS-generable).
Letbe X-GPAC-generable with domain. Then there existswhich is NFS-generable with domainwith the following properties:
and;
for everysuch that, we havefor any X-vector;
for everysuch that, there exists a unique X-vectorsuch that; moreover, we have
In other words,is a projection of.
Let be X-GPAC-generable with domain . Denote by the X-GPAC that generates and the induced operator.
The important idea of the proof is understanding how to write the equational specification of F as an NFS. We apply the following conversions, for every u appearing in :
We observe that the input/output relation of each module of can be written as a normal form equation coupled with an initial condition. Therefore, we can construct an NFS, , from , including an initial condition for each channel.
However, the constant space appearing in the specification of only takes into account those constants appearing as initial settings of integrators. In order to define the solution mapping, , we need to extend the constant space to include the initial settings of the other types of operations, as they appear in the list of conversions above.
Let and , where K, L are the number of inputs, outputs of . By construction each input of corresponds to an input channel of and each output of corresponds to either a mixed or output channel of . Therefore, we have that and , so that and , which proves the first bullet.
The next step is to find a suitable for the domain of . By quasi-well-posedness of on , we know that, for every , there exists a unique such that . Thus, if we define as the vector of initial conditions2
Possibly after reordering the mixed and output channels; this can be done without loss of generality.
of , we can infer that depends uniquely on , and thus it depends uniquely on . With this in mind we define
By the above construction, and satisfy the second and third bullets, and all is left is to show that is the solution of on . By quasi-well-posedness of on , it is clear that for , the tuple that solves the NFS exists, is unique and given by .
To prove closedness of , consider a sequence such that
then we have
By closedness of , we have
Now define , so that
by taking limits, we conclude that . Thus,
which concludes the proof. □
In order to better understand the construction in the proof of Lemma 4.7, we apply it to the X-GPAC seen on Example 3.6 (repeated in Fig. 6).
An X-GPAC implementing a transport equation.
It can be checked that this X-GPAC is well-posed for and . It generates the function , given by , where
if is linear time, , this has the simpler form
Let us construct an NFS with solution such that is a projection of . The X-GPAC generates the equational relations
which can be converted into an NFS with three constants, one input and three outputs,
We can see that the constant space of the NFS has three parameters g, and , which is two more than in the constant space of the X-GPAC. Therefore any solution of the NFS must be of type .
We also see that if produces a specification of the X-GPAC, then produces a solution of the NFS for the initial conditions g, , ; in other words, the NFS generates a function such that
Thus is a projection of , as expected.
Partial differential algebraic equations
In this section we will define partial differential algebraic systems, which will prove to be the correct generalization of differentially algebraic equations for our purposes, as will be made clear from our main result (Theorem 2).
(Partial differential algebraic equation).
Let . A partial differential algebraic equation (PDAE) on the N variables is an equation of the form
where P is a polynomial in and some of their derivatives, with real coefficients.
(System of PDAEs).
Let and . A partial differential algebraic system (PDAS), also referred to as system of PDAEs, on the N variables is a system of the form
under the conventions that are polynomials in and some of their derivatives, with real coefficients, and .
We say that are the inputs or independent variables and are the outputs or dependent variables.
We provide a short explanation on the notation in the previous definition. Each variable can appear in the polynomial expressions with space derivatives of order at most and time derivatives of order at most ; for each which is an output, we need to provide initial conditions; they correspond to the values of and its space derivatives of order up to at time ,
This is a standard assumption in the theory of PDEs and is a necessary condition for well-posedness (with fewer initial conditions, the system is underdetermined; with more initial conditions, the system is overdetermined).
(Quasi-well-posedness of PDAS).
Let and . Let be a PDAS given by Eq. (12) with K inputs, L outputs and J initial conditions and consider the spaces
Let . We say that is quasi-well-posed on U if
(existence) for every , there exists such that Eq. (12) holds for , where g is the vector of initial conditions, , ;
(uniqueness) for every , the tuple such that Eq. (12) holds is unique;
(closedness) the map , with domain U and codomain , given as the unique solution of Eq. (12), defines a closed operator.
(Semantics of PDAS).
Let and . Let be a PDAS with K inputs and L outputs. Let such that is quasi-well-posed on U. We define the solution of as the (partial) function
whose domain is U and where is given by Eq. (12). We also say that generates Φ on .
A function is PDAS-generable if there exists a PDAS such that is quasi-well-posed on the domain of Φ and Φ is the solution of .
We remark that in a PDAS, there is a correspondence between the outputs and a subset of the initial conditions (namely, those for which ), and so we have the following basic property (cf. Propositions 3.11 and 4.5).
Ifis PDAS-generable, then.
Our next two results will complete the cycle in Fig. 7, showing that generable functions in each mode can be seen as projections of generable functions in the other modes.
Main results.
(NFS-generable implies PDAS-generable).
Any NFS-generable function is PDAS-generable.
Any normal form equation is a partial differential algebraic equation where the variables occur with time (and space) derivatives of order at most 1; thus the initial conditions in an NFS are exactly those appearing as initial conditions in the corresponding PDAS; in other words, every NFS is a PDAS. □
(PDAS-generable implies X-GPAC-generable).
Letbe PDAS-generable with domain. Then there existswhich is X-GPAC-generable with domainwith the following properties:
and;
for everysuch that, we havefor any X-vectorand any X-stream y;
for everysuch that, there exists a unique X-vectorand X-stream y such that; moreover, there exists a unique X-stream vectorsuch that
In other words,is a projection of.
The equality and inequality in the first bullet will be explained below.
Let be PDAS-generable with domain . Denote by the PDAS that generates .
The important idea of the proof is understanding how to write partial differential algebraic equations with X-GPAC modules. We start with channels for all variables . To obtain derivatives in time, we include modules and connections as in Fig. 8.
An X-GPAC for computing time derivatives.
Note that the channels on Fig. 8 must obey the system
so that we obtain in the channel labeled . Observe that we must include an initial setting (in the above case, the initial value ) every time we need to take a time derivative. We also need to include the linear channel given by the map . By composing several of these modules, we can get all time derivatives that appear in , that is, we obtain for and .
Next, by successive applications of the differential module (see Fig. 9) we obtain all the partial derivatives appearing in , which are of the form for , and .
An X-GPAC for computing spatial derivatives.
Next, we compute the polynomial expressions from the partial derivative terms using constants, multipliers and adders. Any term appearing in the polynomials is of the form , where (obtainable from a constant module), each is either t (obtainable using the linear input t) or some , and thus can be obtained by a constant module and a sequence of multipliers. Each polynomial is a finite sum of such terms, and thus can be obtained by a sequence of adders.
Finally, to enforce the relation , we add to both sides of the equation and include an adder and feedback loop, as shown on Fig. 10. We can then loop the channel labeled back to the start, enforcing it to be a mixed channel.
Feedback loop implementing .
Figure 11 illustrates the several steps of our construction, which results in an X-GPAC . We must next address the underlying spaces of . The constant space is constructed with the initial settings of integrators, which only appear in the phase where we build time derivatives. For every original variable which appears in with time derivatives of order up to , we have included the initial settings , . Hence, the constant space of , denoted by , is an extension of , which only takes into account the initial settings associated with the output variables; therefore .
Construction of X-GPAC from a PDAS.
In regards to the input space, the original input variables , appear in as proper input channels. The only other proper input channel is the linear input t, which can be seen as an ‘explicit time’ inserted into the system. In this way, , which proves the first bullet.
Observe that the original output variables , , all appear in as mixed channels because of the feedback loop that ensures . There are (potentially many) other mixed and proper output channels in , which carry the value of either partial derivatives , multiplying terms or sums of multiplying terms; hence .
The next step is to find a suitable for the domain of . By quasi-well-posedness of , we know that, for every , there exists a unique that solves . Thus, if we define as the vector of initial conditions of all time derivatives of the input and output variables, which are of the form for and , we can infer that depends uniquely on , and thus it depends uniquely on . With this in mind we define
To define , we need to define the value of all the mixed and output channels appearing in . As described above, these are either the output variables , or uniquely obtained from the tuple via partial derivatives, products and sums. If we let denote the value of all the mixed and output channels which are not the output variables, then depends uniquely on and thus also on , so that we can define
By this construction, and satisfy the second and third bullets, and all is left is to show that is the specification of on . By quasi-well-posedness of on and the above discussion, it is clear that for , the tuple that solves the equational specification of exists and is unique; that is to say, is given by and is obtained from via partial derivatives, products and sums.
Since the last component of any tuple in must be the linear input t, we only need to consider sequences for the other three subtuples.
such that
by defining , we have
By closedness of , we have
Now corresponds to the values of the variables in and some of their derivatives at . By closedness of the differential operator, we can take limits and conclude that corresponds to the values of the variables in and their derivatives at ; thus, . Also, since partial derivatives, products and sums are closed operators, we infer that , so that , which concludes the proof. □
We provide an example of the construction in the previous Lemma by applying it to the one-dimensional heat equation, which can be written as the following PDAS,
To produce a solution to the heat equation, we consider, for example, a square-integrable initial condition , for which the solution can be obtained via the heat kernel, that is, is given by , where
Let us construct an X-GPAC with specification such that is a projection of . We start with a channel for the variable u. Using the constructions on Figs 8 and 9 we obtain channels with the derivatives , and . We can then construct the partial differential algebraic expression using one constant module, one multiplier module and one adder module. Finally, we include an adder and feedback loop as on Fig. 10 and loop the variable u to the beginning. The final X-GPAC can be seen on Fig. 12.
Construction of X-GPAC from the heat equation.
We can see that the X-GPAC has one additional input t, which specifies linear time. It should also be noted that the heat equation has only one variable u, whereas the X-GPAC has a total of twelve channels and thus twelve variables (of course, most of those are redundant). Therefore, any specification of the X-GPAC must be of type .
We can also see that if produces a solution to the heat equation, then there is a unique tuple u of values that satisfy , where F is the induced operator of the X-GPAC in Fig. 12, g is the initial condition of the integrator and t is the input channel (linear time). In other words, we can construct a specification of the X-GPAC such that is a projection of , as expected.
An X-GPAC that generates solutions to the heat equation.
It should be clear from this example that the construction in Lemma 5.7 is universal (in the sense that it works for any PDAS) but is not necessarily optimal (in the sense that it does not add a minimal number of new variables). In fact, one could construct a much simpler X-GPAC (with only three modules!) that generates solutions to the heat equation, as in Fig. 13. The reader can verify that is also a projection of the specification of this X-GPAC.
Finally we can state and prove our main result.
(X-GPAC characterization theorem).
Let. Then the following are equivalent:
Φ is the projection of an X-GPAC-generable function;
Φ is the projection of an NFS-generable function;
Φ is the projection of a PDAS-generable function.
We prove each implication:
(X-GPAC ⇒ NFS) Let Φ be the projection of an X-GPAC-generable function . By Lemma 4.7, is the projection of an NFS-generable function , and so Φ is a projection of .
(NFS ⇒ PDAS) Similar to the previous case, but use Lemma 5.6 instead.
(PDAS ⇒ X-GPAC) Similar to the previous case, but use Lemma 5.7 instead. □
Conclusion
In this paper we have seen a model of analog computation based on the Shannon GPAC. In this model we have taken streams whose value lie in a general function space X. Theorem 2 is evidence that our model of computation provides a suitable generalization of the original work on the GPAC. We can thus think of solutions to certain differential equations as outputs or fixed points of certain analog networks. We have also seen that (quasi)well-posedness conditions play an important role in this study.
We have only considered the case . A possible direction for research would be considering other function spaces, such as
where Ω is, for example, a domain in , either unbounded (for example, ) or bounded (for example, ), and denotes Sobolev spaces. In the case that Ω is bounded, we may further restrict our space X to functions with prescribed behaviour on the boundary, such as Dirichlet boundary conditions ( on ). We believe that such a direction could allow us to make interesting connections with the field of partial differential equations, where such spaces are ubiquitous.
Another possible direction would be to consider modules operating on multiple data types, which could be written as
in this way we would have channels of different types and would be able to define a notion of many-typed analog networks. This direction will probably have a strongly technical aspect, but it could lead to a model of computation on many-sorted algebras as studied by Tucker and Zucker [31,32,34].
As an interesting question we may wonder whether our framework allows computability of functions which are known not to be Shannon GPAC-generable, such as the gamma function (as noted by Shannon)
There are well-known differential equations in two variables related to the gamma function; for example (see [22, p. 174]), if we define the incomplete gamma functions
then both incomplete gamma functions satisfy the differential equation (for )
and we have in addition
we may ask whether such relations could be implemented on a more general analog network.
Footnotes
Acknowledgements
The research of Diogo Poças and Jeffery Zucker was funded, respectively, by Fundação para a Ciência e Tecnologia (Doctoral Grant, Portugal) and the Natural Sciences and Engineering Research Council (Canada).
References
1.
O.Bournez, D.Graça and A.Pouly, On the functions generated by the general purpose analog computer, 2016, submitted on 21 Jan 2016, arXiv:1602.00546.
2.
V.Bush, The differential analyzer. A new machine for solving differential equations, Journal of the Franklin Institute212(4) (1931), 447–488. doi:10.1016/S0016-0032(31)90616-9.
3.
M.Campagnolo, C.Moore and J.F.Costa, An analog characterization of the Grzegorczyk hierarchy, Journal of Complexity18(4) (2002), 977–1000. doi:10.1006/jcom.2002.0655.
4.
R.Courant and D.Hilbert, Methods of Mathematical Physics, Vol. 2, Interscience Publishers, Inc., 1953.
5.
D.Graça, Some recent developments on Shannon’s general purpose analog computer, Mathematical Logic Quarterly50(4–5) (2004), 473–485.
6.
D.Graça and J.F.Costa, Analog computers and recursive functions over the reals, Journal of Complexity19(5) (2003), 644–664. doi:10.1016/S0885-064X(03)00034-7.
A.Grzegorczyk, On the definitions of computable real continuous functions, Fundamenta Mathematicae44 (1957), 61–71.
9.
J.Hadamard, Lectures on Cauchy’s Problem in Linear Partial Differential Equations, Dover, 1952.
10.
D.R.Hartree, Calculating Instruments and Machines, Cambridge University Press, 1950.
11.
P.A.Holst, Svein Rosseland and the Oslo Analyzer, IEEE Annals of the History of Computing18(4) (1996), 16–26. doi:10.1109/85.539912.
12.
N.D.James and J.I.Zucker, A class of contracting stream operators, The Computer Journal56 (2013), 15–33. doi:10.1093/comjnl/bxs054.
13.
M.Johansson, Early analog computers in Sweden – With examples from Chalmers University of Technology and the Swedish aerospace industry, IEEE Annals of the History of Computing18(4) (1996), 27–33. doi:10.1109/85.539913.
14.
S.Kleene, Arithmetical predicates and function quantifiers, Transactions of the American Mathematical Society79 (1955), 312–340. doi:10.1090/S0002-9947-1955-0070594-4.
15.
D.Lacombe, Extension de la notion de fonction récursive aux fonctions d’une ou plusieurs variables réelles I, Comptes Rendus des Séances d l’Académie des Sciences, Paris240 (1955), 2478–2480.
16.
D.Lacombe, Extension de la notion de fonction récursive aux fonctions d’une ou plusieurs variables réelles II, Comptes Rendus des Séances d l’Académie des Sciences, Paris241 (1955), 13–14.
17.
D.Lacombe, Extension de la notion de fonction récursive aux fonctions d’une ou plusieurs variables réelles III, Comptes Rendus des Séances d l’Académie des Sciences, Paris241 (1955), 151–153.
18.
L.Lipshitz and L.Rubel, A differentially algebraic replacement theorem, Proceedings of the American Mathematical Society99(2) (1987), 367–372. doi:10.1090/S0002-9939-1987-0870803-1.
19.
J.W.Mills, The nature of the extended analog computer, Physica D: Nonlinear Phenomena237(9) (2008), 1235–1256. doi:10.1016/j.physd.2008.03.041.
20.
C.Moore, Recursion theory on the reals and continuous-time computation, Theoretical Computer Science162(1) (1996), 23–44. doi:10.1016/0304-3975(95)00248-0.
21.
J.Mycka and J.F.Costa, Real recursive functions and their hierarchy, Journal of Complexity20(6) (2004), 835–857. doi:10.1016/j.jco.2004.06.001.
22.
F.W.J.Olver, D.W.Lozier, R.F.Boisvert and C.W.Clark, NIST Handbook of Mathematical Functions, Cambridge University Press, 2010.
23.
A.Pouly, Continuous models of computation: from computability to complexity, PhD thesis, École Polytechnique and Universidade do Algarve, 2015.
24.
M.Pour-El, Abstract computability and its relations to the general purpose analog computer, Transactions of the American Mathematical Society199 (1974), 1–28. doi:10.1090/S0002-9947-1974-0347575-8.
25.
M.Pour-El and I.Richards, Computability in Analysis and Physics, Springer-Verlag, 1989. doi:10.1007/978-3-662-21717-7.
26.
M.Renardy and R.C.Rogers, An Introduction to Partial Differential Equations, Vol. 13, 2nd edn, Springer-Verlag, New York, 2006.
27.
L.A.Rubel, The extended analog computer, Advances in Applied Mathematics14(1) (1993), 39–50. doi:10.1006/aama.1993.1003.
28.
C.Shannon, Mathematical theory of the differential analyser, Journal Mathematical Physics20 (1941), 337–354. doi:10.1002/sapm1941201337.
29.
J.S.Small, General-purpose electronic analog computing: 1945–1965, IEEE Annals of the History of Computing15(2) (1993), 8–18. doi:10.1109/85.207740.
30.
W.Thompson and P.G.Tait, Treatise on Natural Philosophy, Vol. 1, 2nd edn, Cambridge University Press, 1880, Part I.
31.
J.V.Tucker and J.I.Zucker, Computable functions and semicomputable sets on many sorted algebras, in: Handbook of Logic for Computer Science, S.Abramsky, D.Gabbay and T.Maibaum, eds, University Series in Mathematics, Vol. V, Oxford University Press, 2000, pp. 317–523.
32.
J.V.Tucker and J.I.Zucker, Computability of analog networks, Theoretical Computer Science371 (2007), 115–146. doi:10.1016/j.tcs.2006.10.018.
33.
J.V.Tucker and J.I.Zucker, Continuity of operators on continuous and discrete time streams, Theoretical Computer Science412 (2011), 3378–3403. doi:10.1016/j.tcs.2011.04.012.
34.
J.V.Tucker and J.I.Zucker, Computability of operators on continuous and discrete time streams, Computability3 (2014), 9–44.
35.
K.Weihrauch, Computable Analysis – An Introduction, Texts in Theoretical Computer Science, Springer-Verlag, Berlin, Heidelberg, 2000. doi:10.1007/978-3-642-56999-9.