Motivation: Functional Analysis (FA) is 'infinite dimensional linear algebra' - the study of infinte dimensional vector spaces and of linear maps between them. It is a 'fusion' of Linear Algebra (LA) and Analysis.

(From LA, the following are assumed to be known: vector, matrix, linear (in)dependence, span, basis, linear map and its matrix, range, kernel, rank, Gauss elimination, scalar product, positive definite matrix, norm of a vector and a matrix, orthonormal basis, orthogonal and unitary matrix, orthogonal projection, change of basis formula.)

Both of these - LA and Analysis - are very much about studying equations and their solutions (example given: linear systems, eigenvalue eq, Intermediate Value Thm).

Lots of the motivation in FA comes from studying equations - mostly differential and integral eq's. Example of general ODE (Gewoehnliche Diff Gleichung) and of 'integral operators' (linear map K given by integrating (in t) function x(s) against a function k(t,s) of two variables (s,t)).

Start on recalling Euclidean topology on R^n (distance, open sets).

Definition of topology and topological space (the members of the topology are the open sets), discussion of discrete and in-discrete topology: Any set (with more than two points) can be equipped with more than one topology. Weaker/stronger topologies (not all topologies can be compared! - but discrete/indiscrete topologies can be compared to all topologies).

Definition of continuity of maps between topological spaces by open sets; definition of continuity AT a point. The identity map is continuous (using the same topology on the two copies!), any constant map is continuous, composition of continuous maps is continuous.

Definition of subspace/induced/relative topology on H (H subset A, {A,T} topological space).

(The material can be found in many books; for instance W A Sutherland,

H is closed iff it equals its closure. H subset K implies closure H subset closure K. closure of closure H equal closure H; closure H is a closed set.

Definition of (everywhere) dense subset of a topological space, and of separable topological space.

Definition of interior (examples), and of nowhere dense. H subset A is nowhere dense in T={A,T} iff A\closure(H) is dense in T. Corollary: A closed subset is nowhere dense iff its complement is dense. Definition of boundary of a set.

Definition of sequence, and of convergence of a sequence in a topological space. Claim that this definition can lead to non-unique limits of convergent sequences.

Definition of metric spaces. Euclidean metric, discrete metric, metrics d_p on R^2, metric on C. Definition of B_r(x;d). Any metric space is a topological space. A topological space is metrizable if its topological arises from a metric. (This is not always the case (example; more to come)). Any notion for topological spaces (closed set, limit points, closure etc etc) therefore makes sense for metric spaces.

Every metric space is Hausdorff. Re-writing (using metric / B_r(x;d) ) definition of a dense subset. Definition of a bounded subset in a metric space.

Definition of metrics d_p on R^n; Hoelder's and Minkowski's inequalities (proofs in tutorium). Definition of the sequence space l_p, l_infinity, and the metrics d_p, d_infinity on them.

Compactness: Definition of cover, open cover, subcover, compactness. Re-formulation for induced topologies on subsets of topological spaces (i.e. 'compact subset'). Heine-Borel: In R^n, compactness of a subset is equivalent to 'closed and bounded'. In general, this is not the case!

The image of a compact space by a continuous function is compact. A continuous map from a compact space to a metric space is bounded. A continuous map from a compact space into the reals (with the Euclidean topology) attains its bounds (max and min).

Definition of Cauchy-sequences in a metric space. Any convergent sequence is Cauchy (but not all Cauchy sequences are convergent). Definition of complete metric space. R^n with the Euclidean metric is complete (known).

A subset K of a metric space A is closed iff ( {a_n} in K, a_n -> a, a in A implies a in K ). If a Cauchy sequence has a convergent subsequence, then it is convergent (to the same limit).

Definition of sequentially compact (in itself/in M) of a subset C of a metric space M. A subspace C of a metric space M is compact iff it is sequentially compact (proof later!). Consequence: Any bounded (in Euclidean metric) sequence in R^n has a convergent (in Euclidean metric) subsequence.

Any compact metric space is complete. A complete subspace of a metric space is closed. A closed subset of a complete metric space is a complete metric space.

For M_1={A_1,d_1}, M_2={A_2,d_2} two metric spaces, let C(A_1,A_2) be the set of (d_1,d_2)-continuous maps from A_1 to A_2, and let C_b(A_1,A_2) be the set of maps from A_1 to A_2 which are (d_1,d_2)-continuous and bounded. C_b(A_1,A_2) subset C(A_1,A_2), C_b(A_1,A_2) subset B(A_1,A_2). If M_1 is compact, then C_b(A_1,A_2)=C(A_1,A_2) for all A_2.

{ C_b(A_1,A_2), d_{infinity} } is complete iff M_2 is complete. I.e., the uniform limit of a sequence of continuous and bounded maps is continuous and bounded.

Definition of uniform continuity. A continuous map from a compact metric space to a metric space is uniform continuous. Ex. f:[0,1] -> R.

Definition of totally bounded. For a subset C of a metric space the following is equivalent: (a) C is compact (b) C is sequentially compact (c) C is totally bounded and complete. (a) implies (b) proved.

Arzela-Ascoli's Theorem:

Let A_1 be compact metric space, A_2 complete metric space. A subset M of C(A_1,A_2) is compact iff

(a) For all x in A_1 the set { f(x) | f in M } is compact in A_2

(b) M is equicontinuous

(c) M is closed.

Motivation and discussion on Linear Algebra - the study of linear equations, matrices, vector spaces, linear maps. The axioms of vector spaces assumed known (Shall almost only study real or complex vector spaces).

Definition of semi-norms, norms, and the metric induced by a norm. Addtion of vectors, and multiplication by scalars are continuous operations with respect to this metric: The linear and the topologival structures are compatible.

Definition of Banach space.

Examples: R^n -- l_{infinity} -- l_{infinity}(M,Y) for M any non-empty set, Y Banach space -- C_b(A,X) for A metric space, X Banach space -- ( C^{alpha}, ||.||_{alpha} ) -- ( C^1, ||.||_{C^1} )

Definition of convex set, convex hull, absolutely convex set, absolutely convex hull, strictly normed/strictly convex space, uniformly convex space, open unit ball, unit sphere. Closure of open unit ball is "closed unit ball"; both are convex.

Definition of linear subspace and of quotient space. Discussion about linear/topological subspaces. Given a semi-normed space, the null-set of the semi-norm is a linear subspace, and dividing out and using the semi-norm on representatives gives a norm on the quotient space.

Definition of (equivalent) l_p norms on the direct sum of two normed spaces. Gives a Banach space if each component is Banach.

Definition of distance between a point x and a subset U of a metric space A, and of a "best approximation" a to x in A. This may not exist, and if it does, may not be unique. If U is compact, there is at least one.

Riesz' lemma: For a non-trivial closed subspace U, and d in (0,1), there exists x_d of length 1 s.t. ||x_d - u || >= 1-d for all u in U.

Definition of linear maps (called linear operators), kernel, and image of linear maps. A linear operator is continuous at a single point iff it is bounded on the unit ball iff it is uniformly continuous iff there is a C such that ||Tx|| =< C ||x|| for all x. In this case, T is called a bounded linar operator (Discussion on connection to bounded maps). Not all linear maps are bounded: Example of a discontinuous linear map given (d/dx from C^1 to C, both with sup-norm).

The set B(X,Y) of bounded linear maps is a vectorspace, and the operator norm IS a norm. Furthermore, ||ST|| <= ||S|| ||T||. If X is K vectorspace, then X'=B(X,K) is called the dual space (space of bounded linear functionals). Examples of various linear bounded functionals.

If Y is Banach, then B(X,Y) is Banach; in particular, X' is always Banach.

Definition of isomorphism, isometry on/in Y, and of isomorphic/isometrically isomorphic normed space. These are both equivalence relations. Any two normed spaces of same finite dimension are isomorphic, but not necessarily isometrically. Definition of embedding, and (linear) projections.

Unique extension of a bounded operator from a subspace V (of X) to a Banach space Y, to a bounded linear operator on the closure (in X) of V (still to Y), and with same norm. Example: When V is dense in X. If original operator an isometry, then also extension. However, injectivity may not be preserved. Extension of bounded linear functionals.

Definition of scalar (inner) product, pre-Hilbert space. Scalar product gives a norm; Cauchy-Schwarz' inequality, parallelogram rule. Definition of a Hilbert space. Polarization identity. Criterion for a norm to come from a scalar product: It has to satisfy (it is enough it satisfies) the paralellogram rule. Continuity of the scalar product. Examples (to be continued).

Definition of orthogonality of vectors (and Pythagoras), and orthogonality of subsets. Definition of orthogonal complement A^perp of subset A. This is always a closed subspace, and the orthogonal complement of the closure of A is A^perp. A subset (A^perp)^perp.

For a closed and convex subset of a Hilbert space H, and any x_0 in H, there is a unique best approximation (called P(x_0)) to x_0 in K. P is a projection (P^2=P). P(x_0) can be characterised by

Re < x_0-P(x_0),y-P(x_0) > <= 0 for all y in K.

Theorem on the orthogonal projection on a closed linear subspace U of a Hilbert space, and its properties; H can be written as an (orthogonal) direct sum of U and U^perp.

Frechet-Riesz' Representation Theorem: The dual of a Hilbert space H is isometrically (conjugate) isomorph to H.

Definition of algebraic basis of a vector space. Every vector space has a basis (using Zorn's Lemma: Every totally ordered subset of a partially ordered set has a maximal element). However, the number of elements on a basis is either finite or uncountable. Hence, useless (!) for infinite dimensional vector spaces.

Definition of a 'family' (a map from an index set I to a Banach space X - generalisation of sequence). Definition of absolutely summable families, and of l_1(I). Definition of support of a family, and of the sum of a family in l_1(I). Definition of square summable families and l_2(I); this is a Hilbert space. Definition of orthonormal system (ONS), and of a maximal ONS. Examples. Definition of Fourier-coefficients wrt. an ONS.

An ONS satisfying the above is called complete, or an orthonormal basis (ONB) for H (a Hilbert space basis). If dim H is infinite it is NOT an algebraic basis! Every Hilbert space has an ONB (using Zorn's Lemma). Every ONB of H has the same cardinality. If the ONB is countable, then H is separable. In this case, H is isometrically isomorph to l_2(N).

Discussion of the 'measure-problem' (existence of sigma additive, translation and rotational invariant measure on ALL subsets of R^n) (Vitali, Banach-Tarski). Definition of sigma-algebra and examples.

Definition of measure, and examples (counting measure, Dirac measure). Construction of measures: Definition of semi-ring; example: 'boxes' in R^n. Definition of content and pre-measure; examples (Lebesgue content in R^n; Lebesgue-Stieltje content, for a monotone increasing function F).

How to get from pre-measure via exterior measure to a measure. Definition of measurable sets. Caratheodory's extension theorem. Example (Lebesgue measure on R^n) and discussion. Definition of sigma-finiteness of a content or pre-measure. Uniqueness of extension of a sigma-finite pre-measure to a measure. Example: Lebesgue pre-measure on R^n and Lebesgue-Stieltje pre-measures are sigma-finite.

Definition of integral (and of "f is integrable") for positive measurable step functions, positive measurable functions, real valued functions, and complex valued functions. Definition of "almost everywhere" (a.e. wrt measure mu). If the integral of f (non-negative and measurable) is 0, then f is 0 mu-a.e. If f=g mu-a.e. for integrable f, g, then their integrals are equal. If f is Riemann integrable on [0,1], then it is Lebesque-integrable (integrable wrt lambda^1 on [0,1]).

Definition of space of p-integrable functions, and the p-(semi)norm. Definition of the space L^p by defining f to be equivalent to g iff f=g mu-a.e. Discussions. Proof that L^p is a vector space, and that the (semi)norm IS a (semi)norm (to be continued).

Defintion of L^infty, essential supremum, completeness, Hoelder's inequality.

Discussion on bounded linear functionals.

Hahn-Banach's theorem: A linear functional f on a subspace V_0 of a real linear space E, which is bounded by a sublinear functional p can be extended to all of E, maintaining the bound.

Hahn-Banach for functionals bounded by semi-norms, on a K-vector space.

Hahn-Banach for linear functionals: extension to the whole vector space.

Corollaries: For non-zero elements x, there is an f in X' such that f(x) not eq 0. In particular, X' separates points in X.

Defintion of open map. Remarks. Lemma: T open iff there is a ball contained in T(B_1(0)). Open Mapping Theorem (pf to be continued). Corollories: T in B(X,Y) bijective, then T^{-1} bounded. Equivalence of norms. T in B(X,Y) injective, then T^{-1} (from R(T)) bounded iff R(T) closed.

Definition of closed operator. Discussions on relationship to continuity. Definition of graph gr(T), and of graph norm. Lemma: (1) graph linear subspace, (2) T closed iff gr(T) closed in X x Y (with l_1-norm). Lemma: T closed, then (1) domain with graph norm is Banach (2) T is bounded from D with graph norm.

Theorem: T closed and surjectiv implies T open, if also injective, then T^{-1} bounded.

Closed Graph Theorem. Discussions. Theorem: The pointwise limit of bounded operators is a bounded operator.

Computing the norm of x in X as max over |f(x)| for f in X', ||f|| le 1. The bi-dual X'', and the canonical embedding of X in X''.

Definition of weak convergence (in X), and of weak* convergence (in X'). Similarly for weak and weak* Cauchy. Definition of weakly sequentially compact, and same for weak*. These notions can be defined via a topology, but not given here (yet). Convergence in the norm is called strong convergence.

Remark: Weak limits are unique (using Hahn-Banach). Strong convergence implies weak and weak* convergence. Opposite not true (ex: {e_n} in l_p). The norm (in X) is lower semi-continuous wrt. weak convergence, and ( the norm in X') wrt. weak* convergence. Weak and weak* convergent sequences are bounded.

For X separable, the closed unit ball in X' is weak* sequentially compact. (proof next time).

Definition of the topology behind weak convergence, and discussions. Similarly for weak*.

On reflexivity: For a reflexiv space, weak (in X') and weak* (also in X') convergence is the same. If V subset X, closed linear subspace, X reflexiv, then V reflexiv. X reflexiv implies X' reflexiv. X' separable implies X separable (no proofs).

Banach-Alaoglu: In a reflexiv Banach space, the closed unit ball is weakly sequentially compact. Special case: Any Hilbert space. Discussions.

Definition of compact operators. Remarks and discussions. Example: Integral operators (defined through continuous kernels) on C[0,1] (Problem 24).

Definition of resolvent set, resolvent (operator), and spectrum of an operator. Splitting of spectrum in point, continuous, and rest spectrum. Discussion.

The resolvent set is an open subset of C, and the resolvent function is an analytic map. Nuemann-series. The set of invertible operators is open in B(X,Y).

Functions of operators: Polynomials, analytic functions (power series). Examples. Discussion of FA2 and spectral theory.

Definition of Fredholm operator and index. I-K is Fredholm if K is compact operator. Spectral Theorem for compact operators (on Banach space!) - statement and discussion (proof in FA2). Consequence for resolvent function: isolated poles of finite order. Fredholm Alternative and discussion.

Schauder: X is compact iff X' (adjoint) is compact.

Spectral Theorem for normal operators on Hilbert space.

Last update: October 11th., 2012 by Thomas Østergaard Sørensen.