2 Basic notation
We freely assume the axiom of choice in this blueprint.
Throughout this blueprint we adopt following notation. If \(\theta \) is a real number, then we write
where \(i\) is the imaginary unit. The indicator function \(1_I(n)\) of a set \(I\) is defined to equal \(1\) when \(n \in I\), and \(0\) otherwise.
We adopt the convention that an empty supremum is \(-\infty \), and an empty infimum is \(+\infty \). Thus, for instance, \(\sup _{\sigma _0 \leq \sigma \leq \sigma _1} f(\sigma )\) would equal \(-\infty \) if \(\sigma _1 {\lt} \sigma _0\). Related to this, we also adopt the convention that \(N^{-\infty }=0\) when \(N {\gt} 1\).
The cardinality of a finite set \(W\) will be denoted \(|W|\).
A sequence \(a_n, n \in I\) of real or complex numbers indexed by some index set is said to be \(1\)-bounded if \(|a_n| \leq 1\) for all \(n \in I\). Similarly, a set \(W\) of real numbers is said to be \(1\)-separated if \(|t-t'| \geq 1\) for all distinct \(t,t' \in W\). One can define more general notions of \(\lambda \)-bounded or \(\lambda \)-separated for other \(\lambda {\gt}0\) in the obvious fashion.
2.1 Asymptotic (or “cheap nonstandard”) notation
It is convenient to use a “cheap nonstandard analysis” framework for asymptotic notation, in the spirit of [ 269 ] , as this will reduce the amount of “epsilon management” one has to do in the arguments. This framework is inspired by nonstandard analysis, but we will avoid explicitly using such nonstandard constructions as ultraproducts in the discussion below, relying instead on the more familiar notion of sequential limits.
In this framework, we assume there is some ambient index parameter \({\mathrm{i}}\), which ranges over some ambient sequence of natural numbers going to infinity. All mathematical objects \(X\) (numbers, sequences, sets, functions, etc.), will either be fixed - i.e., independent of \({\mathrm{i}}\) - or variable - i.e., dependent on \({\mathrm{i}}\). (These correspond to the notions of standard and non-standard objects in nonstandard analysis.) Of course, fixed objects can be considered as special cases of variable objects, in which the dependency is constant. By default, objects should be understood to be variable if not explicitly declared to be fixed. For emphasis, we shall sometimes write \(X = X_{{\mathrm{i}}}\) to explicitly indicate that an object \(X\) is variable; however, to reduce clutter, we shall generally omit explicit mention of the parameter \({\mathrm{i}}\) in most of our arguments. We will often reserve the right to refine the ambient sequence to a subsequence as needed, usually in order to apply a compactness theorem such as the Bolzano–Weierstrass theorem; we refer to this process as “passing to a subsequence if necessary”. When we say that a statement involving variable objects is true, we mean that it is true for all \({\mathrm{i}}\) in the ambient sequence. For instance, a variable set \(E\) of real numbers is a set \(E = E_{{\mathrm{i}}}\) indexed by the ambient parameter \({\mathrm{i}}\), and by an element of such a set, we mean a variable real number \(x = x_{{\mathrm{i}}}\) such that \(x_{{\mathrm{i}}} \in E_{{\mathrm{i}}}\) for all \({\mathrm{i}}\) in the ambient sequence.
We isolate some special types of variable numerical quantities \(X = X_{{\mathrm{i}}}\) (which could be a natural number, real number, or complex number):
\(X\) is bounded if there exists a fixed \(C\) such that \(|X| \leq C\). In this case we also write \(X = O(1)\).
\(X\) is unbounded if \(|X_{{\mathrm{i}}}| \to \infty \) as \({\mathrm{i}}\to \infty \); equivalently, for every fixed \(C\), one has \(|X| \geq C\) for \({\mathrm{i}}\) sufficiently large.
\(X\) is infinitesimal if \(|X_{{\mathrm{i}}}| \to 0\) as \({\mathrm{i}}\to \infty \); equivalently, for every fixed \(\varepsilon {\gt}0\), one has \(|X| \leq \varepsilon \) for \({\mathrm{i}}\) sufficiently large. In this case we also write \(X = o(1)\).
Note that any quantity \(X\) will be either bounded or unbounded, after passing to a subsequence if necessary; similarly, by the Bolzano–Weierstrass theorem, any bounded (variable) quantity \(X\) will be of the form \(X_0+o(1)\) for some fixed \(X_0\), after passing to a subsequence if necessary. Thus, for instance, if \(T, N {\gt} 1\) are (variable) quantities with \(N = T^{O(1)}\) (or equivalently, \(T^{-C} \leq N \leq T^C\) for some fixed \(C\)), then, after passing to a subsequence if necessary, we may write \(N = T^{\alpha +o(1)}\) for some fixed real number \(\alpha \). Note that any further passage to subsequences do not alter these concepts; quantities that are bounded, unbounded, or infinitesimal remain so under any additional restriction to subsequences.
We observe the underspill principle: if \(X,Y\) are (variable) real numbers, then the relation
is equivalent to the relation
holding for all fixed \(\varepsilon {\gt}0\).
We can develop other standard asymptotic notation in the natural fashion: given two (variable) quantities \(X,Y\), we write \(X = O(Y)\), \(X \ll Y\), or \(Y \gg X\) if \(|X| \leq CY\) for some fixed \(C\), and \(X = o(Y)\) if \(|X| \leq cY\) for some infinitesimal \(c\). We also write \(X \asymp Y\) for \(X \ll Y \ll X\).
A convenient property of this asymptotic formalism, analogous to the property of \(\omega \)-saturation in nonstandard analysis, is that certain asymptotic bounds are automatically uniform in variable parameters.
Let \(E = E_{{\mathrm{i}}}\) be a non-empty variable set, and let \(f = f_{{\mathrm{i}}}: E \to \mathbf{C}\) be a variable function.
Suppose that \(f(x)=O(1)\) for all (variable) \(x \in E\). Then after passing to a subsequence if necessary, the bound is uniform, that is to say, there exists a fixed \(C\) such that \(|f(x)| \leq C\) for all \(x \in E\).
Suppose that \(f(x)=o(1)\) for all (variable) \(x \in E\). Then after passing to a subsequence if necessary, the bound is uniform, that is to say, there exists an infinitesimal \(c\) such that \(|f(x)| \leq c\) for all \(x \in E\).
We begin with (i). Suppose that there is no uniform bound. Then for any fixed natural number \(n\), one can find arbitrarily large \({\mathrm{i}}_n\) in the sequence and \(x_{{\mathrm{i}}_n} \in E_{{\mathrm{i}}_n}\) such that \(|f_{{\mathrm{i}}_n}(x_{{\mathrm{i}}_n})| \geq n\). Clearly one can arrange matters so that the sequence \({\mathrm{i}}_n\) is increasing. If one then restricts to this sequence and sets \(x\) to be the variable element \(x_{{\mathrm{i}}_n}\) of \(E\), then \(f(x)\) is unbounded, a contradiction.
Now we prove (ii). We can assume for each fixed \(n\) that there exists \({\mathrm{i}}_n\) in the ambient sequence such that \(|f_{{\mathrm{i}}}(x_{{\mathrm{i}}})| \leq 1/n\) for all \({\mathrm{i}}\geq {\mathrm{i}}_n\) and \(x_{{\mathrm{i}}} \in E_{{\mathrm{i}}}\), since if this were not the case one can construct an \(x = x_{{\mathrm{i}}} \in E\) such that \(|f_{{\mathrm{i}}}(x_{{\mathrm{i}}})| \geq 1/n\) for \({\mathrm{i}}\) sufficiently large, contradicting the hypothesis. Again, we may take the \({\mathrm{i}}_n\) to be increasing. Restricting to this sequence, and writing \(c_{{\mathrm{i}}_n} := 1/n\), we see that \(c=o(1)\) and \(|f(x)| \leq c\) for all \(x \in E\), as required.
It is important in Proposition 2.1 that the hypotheses in (i), (ii) are assumed for all variable \(x \in E\), rather than merely all fixed \(x \in E\). For instance, let \(E = \mathbf{R}\) and consider the variable function \(f_{{\mathrm{i}}}(x) := x/{\mathrm{i}}\). Then \(f(x) = o(1)\) for any fixed \(x \in E\), but the decay rate is not uniform, and we do not have \(f(x) = o(1)\) for all variable \(x \in E\) (e.g., \(x_{\mathrm{i}}:= {\mathrm{i}}\) is a counterexample).
There are two caveats to keep in mind when using this asymptotic formalism. Firstly, the law of the excluded middle is only valid after passing to subsequences. For instance, it is possible for a nonstandard natural number to neither be even or odd, since it could be even for some \({\mathrm{i}}\) and odd for others. However, one can pass to a subsequence in which it becomes either even or odd. Secondly, one cannot combine the “external” concepts of asymptotic notation with the “internal” framework of (variable) set theory. For instance, one cannot view the collection of all bounded (variable) real numbers as a variable set, since the notion of boundedness is not “pointwise” to each index \({\mathrm{i}}\), but instead describes the “global” behavior of this index set. Thus, for instance, set builder notation such as \(\{ x: x = O(1) \} \) should be avoided.