<![CDATA[Sri's Blog]]>https://blag.sric.mehttps://cdn.hashnode.com/res/hashnode/image/upload/v1634931463077/U7xaJ4OeA.pngSri's Bloghttps://blag.sric.meRSS for NodeThu, 15 Aug 2024 19:41:43 GMT60<![CDATA[Hearing the Shape of A Drum]]>https://blag.sric.me/isospectralizationhttps://blag.sric.me/isospectralizationSun, 28 Jun 2020 15:38:25 GMT<![CDATA[<p>Spectral geometry is the study of the relationships between geometric properties of the manifold and properties of its spectrum.</p><p>The Notion of spectrum is an essential part in various fields including classical mechanics, quantum mechanics, analysis, and of course, geometry that wed discuss more here. Both quantum physics and general relativity also try to drive through the spectral approach - Can one hear the shape of the universe?</p><p>I am in no way a mathematician and my knowledge on this topic is very limited. I would like present this as an introduction and from a computer scientists persepective. I aim to discuss if these ideas can be extended to shape analysis applications like correspondence matching, style transfer and interpolation. This post will be a primer to a follow up article on ..</p><p>Lets start with the basic idea of a (Riemannian) manifold and the Laplace-Beltrami operator.</p><h3 id="heading-first-the-riemannian-manifold">First, the Riemannian manifold...</h3><p>Flat earthers are right. The surface of the earth is a 2D manifold. Every region around it looks like a region of the Euclidean plane.</p><p><img src="https://upload.wikimedia.org/wikipedia/commons/f/f0/Polar_stereographic_projections.jpg" alt="By User:RokerHRO - Combination of Stereographic Projection Water Hemisphere and Stereographic Projection Polar Extreme into a single image, CC BY-SA 3.0, Link" /></p><blockquote><p>By User:RokerHRO - Combination of Stereographic Projection Water Hemisphere and Stereographic Projection Polar Extreme into a single image, CC BY-SA 3.0</p></blockquote><p>A manifold is defined as a topological space that locally resembles Euclidean space near each point. This notion allows complicated systems to be explained in simpler terms of local topological properties of Euclidean space.</p><p>In computer vision, the notion a manifold is used quite frequently in rotation averaging \( SO3 \), structure and motion (Essential manifold), to capture the shape of an object (Shape manifolds), to model a set of images (Grassman manifolds) or to simply represent a sphere \( S^n \).</p><p><img src="http://sites.bu.edu/tron/files/2016/08/essentialManifold.png" alt="The space of essential matrices as a Riemannian manifold, C: Roboerto Tron ]" /></p><blockquote><p>The space of essential matrices as a Riemannian manifold, C: Roboerto Tron</p></blockquote><p>A Hilbert space is an abstract vector space with an inner product which has to be complete under convergence (i.e. to allow calculus to be used). This generalises the notion of Euclidean space by extending the methods of vector algebra and calculus from 2D Euclidean plane and 3D spaces to higher dimensions.</p><p>Thus, we can define norms in Hilbert space to allow us to measure distances, and inner products to allow us to measure angles.</p><p>On a Riemannian manifold, you get to measure lengths of the curves. A Riemannian manifold is a manifold with an inner product defined in the tangent space at each point. Riemannian geometry is a field by itself.</p><p>A Riemannian metric (tensor) makes it possible to define several geometric notions on a Riemannian manifold, such as angle at an intersection, length of a curve, area of a surface and higher-dimensional analogues (volume, etc.), extrinsic curvature of submanifolds, and intrinsic curvature of the manifold itself. It also allows us to define geodesic distance on the manifold.</p><h3 id="heading-geodesics">Geodesics</h3><p>Geodesics are locally shortest curves. They preserve a direction on a surface and have many interesting properties. In a plane, the geodesics are straight lines. On a sphere, the geodesics are great circles (like the equator). The geodesics in a space depend on the Riemannian metric, which affects the notions of distance and acceleration. Again, metric geometry is a field by itself.</p><p>Equivalently in other areas, it can be defined as a path that a particle which is not accelerating would follow.</p><p>In Riemannian geometry, all geodesics are locally distance-minimizing paths, but the converse is not true.</p><p><img src="https://upload.wikimedia.org/wikipedia/commons/6/6a/Spherical_triangle.svg" alt=" By derivative work: Pbroks13 (talk) A geodesic triangle on the sphere. The geodesics are great circle arcs." /></p><blockquote><p> By derivative work: Pbroks13 (talk) A geodesic triangle on the sphere. The geodesics are great circle arcs.</p></blockquote><h3 id="heading-isometry-and-isomorphism">Isometry and Isomorphism</h3><p>Without going into too much details on metrics and (pseudo-) Riemannian manifolds, an isometry of a manifold can be defined in simpler terms as any (smooth) mapping of that manifold (into itself, or into another manifold) that preserves the notion of distance between points.</p><p>When such a mapping is on smooth manifolds (and is a diffeomorphism: the mapping is a bijection and its inverse is differentiable), it is called isometry, and provides a notion of isomorphism (sameness).</p><h3 id="heading-notations">Notations</h3><p>Terminology : Let \( M \) be a smooth manifold. Denote the tangent space at \( x \in M \) by \( T_x{M} \).</p><p>If \( f: M \rightarrow N \) is a smooth map between smooth manifolds, denote the associated map on \( T_x{M} \) by \( (Df)_x : T_x{M} \rightarrow T_fN \). If \( I \) is an open interval in \( \mathbb{R} \) and \( \alpha : I \rightarrow M \) is a smooth path, then for \( t \in I, \alpha (t) \) denotes, \( (D \alpha )_t (I) \in T_aM \).</p><p>Definition : A Riemannian metric on a smooth manifold \( M \) is a choice at each point \( x \in M \) of a positive definite inner product \( , \) on \( T_xM \), the inner products varying smoothly with \( x \). Then \( M \) is known as a Riemannian manifold.</p><p>A local isometry between two Riemannian manifolds \( M \) and \( N \) is a local diffeomorphism \( h : M \rightarrow N \), such that, for all points \( x \in M \) and all vectors \( v \) and \( w \) in \( T_xM \):</p><p> \( v, w = (Dh)_x(v), (Dh)_x(w) \).</p><p>A (Riemannian) isometry is a local isometry that is also a diffeomorphism.</p><p>Now, that we have a basic idea about the Riemannian manifolds, lets have a very quick look at the Laplace-Beltrami operator.</p><h3 id="heading-next-the-laplacian">Next, the Laplacian</h3><p>The Laplace operator is a fundamental concept in calculus, given by the divergence of the gradient of a function on Euclidean space. The laplacian of a function \( f \) at point \( p \) is the rate at which the average value of \( f \) over spheres centered at \( p \) deviates from \( f(p) \) as the radius of the sphere shrinks towards 0.</p><p>Initially introduced in the study of celestial mechanics, solutions of the equation f=0, now called Laplaces equation, are the so-called harmonic functions and represent the possible gravitational fields in regions of vacuum.</p><h3 id="heading-laplace-beltrami-operator">Laplace-Beltrami operator</h3><p>The Laplacian generalized to the Riemannian manifold \( (M,g) \) by the Laplace-Beltrami operator (g).</p><p>Equivalently other areas (esp. in diffusion processes) utilize this idea - Fluid mechanics (the Navier-stokes equation), potential theory (Poisson equation), heat diffusion (heat equation), wave equation, quantum physics (Schrodinger equation) and so on.</p><h3 id="heading-now-what-is-spectral-geometry">Now, what is Spectral Geometry?</h3><p>Spectral geometry is a field in mathematics which concerns relationships between geometric structures of manifolds and spectra of canonically defined differential operators.</p><p>Given a compact Riemannian manifold, we can associate to it the (linear unbounded) Laplace-Beltrami operator. This operator is self-adjoint and its spectrum is discrete : namely the spectrum consists of a increasing sequence of real eigenvalues with finite multiplicity.</p><p>Two closed Riemannian manifolds are said to be isospectral if the eigenvalues of their LaplaceBeltrami operator (Laplacians), counted multiplicities, coincide.</p><p>Thus, spectral geometry is the connection between the spectrum \( Spec(M,g) \) and the geometry of the manifold \( (M,g) \) . This fundamentally deals with two kinds of problems:</p><h3 id="heading-direct-problems">Direct Problems</h3><p>A problem that arises a lot in physics, the analysis of PDEs, probabilty etc is to compute the spectrum of Laplacian (or other operators). The main idea is to find a lower bound estimate on the eigenvalues of the spectrum on a Riemannian manifold. This is we,</p><blockquote><p>compute (exactly or not) the spectrum \( Spec(M,g) \)? And (or) find properties on the spectrum \( Spec(M,g) \)</p></blockquote><p>Direct problems attempt to infer the behavior of the eigenvalues of a Riemannian manifold from knowledge of the geometry.</p><h3 id="heading-inverse-problems">Inverse Problems</h3><p>The problem well look more into detail in the next post, is the inverse problem. One of fundamental problems in spectral geometry is to ask to what extent the eigenvalues determine the geometry of a given manifold.</p><p>If the notion that a Riemannian invariant is true: if two Riemannian manifolds \( (M,g) \) and \( (M',g') \) are isometric, then they are isospectral i.e., \( Spec(M,g) == Spec(M',g') \).</p><blockquote><p>which geometric information of the manifold can we determine from the spectrum? does the data of the spectrum \( Spec(M,g) \) determine the shape of the manifold \( (M,g) \)?</p></blockquote><h3 id="heading-hearing-the-shape-of-a-drum">Hearing the shape of a drum</h3><p>This question of isospectrality (spectral alignment) in Riemannian geometry may be traced back to H. Weyl in 19111912 and became popularized thanks to M. Kacs article of 1966. The famous sentence of Kac Can one hear the shape of a drum? refers to this type of isospectral problem.</p><p>Spoiler: The answer is theoretically <a target="_blank" href="https://en.wikipedia.org/wiki/Hearing_the_shape_of_a_drum#The_answer">false</a>. There exists isospectral manifolds that are nonisometric.</p><h3 id="heading-isospectralization">Isospectralization</h3><p>A formulation of this inverse problem in terms of computer vision and shape analysis, is isospectralization, a numerical optimisation procedure in relation with interpolation, correspondence matching and style transfer. More details of this can be found in my presentation for "Recent Advances in the Analysis of 3D Shapes" seminar at TU Munich.</p><iframe class="speakerdeck-iframe" src="https://speakerdeck.com/player/bb785583287644c2803276db84c7d64e" style="border:0px;background:padding-box padding-box rgba(0, 0, 0, 0.1);margin:0px;padding:0px;border-radius:6px;box-shadow:rgba(0, 0, 0, 0.2) 0px 5px 40px;width:560px;height:420px"></iframe><h3 id="heading-source-code-and-demo">Source Code and Demo</h3><p>Checkout my isospectralization pytorch implementation <a target="_blank" href="https://github.com/raincrash/shapeanalysis-seminar">notebooks</a>.</p><h1 id="heading-references">References</h1><ul><li>Notes for Analysis on Manifolds via the Laplacian by Yaiza Canzani.</li><li>Old and new aspects in Spectral Geometry. By M. Craiveanu, M. Puta and T. Rassias.</li><li>https://www.ems-ph.org/books/186/9783037191514_introduction.pdf</li><li>https://en.wikipedia.org/wiki/Laplace_operator</li><li>http://people.maths.ox.ac.uk/lackenby/intriem.pdf</li><li>https://sites.google.com/site/olivierlablee/spectral-geometry</li><li>https://en.wikipedia.org/wiki/Hearing_the_shape_of_a_drum</li></ul>]]><![CDATA[<p>Spectral geometry is the study of the relationships between geometric properties of the manifold and properties of its spectrum.</p><p>The Notion of spectrum is an essential part in various fields including classical mechanics, quantum mechanics, analysis, and of course, geometry that wed discuss more here. Both quantum physics and general relativity also try to drive through the spectral approach - Can one hear the shape of the universe?</p><p>I am in no way a mathematician and my knowledge on this topic is very limited. I would like present this as an introduction and from a computer scientists persepective. I aim to discuss if these ideas can be extended to shape analysis applications like correspondence matching, style transfer and interpolation. This post will be a primer to a follow up article on ..</p><p>Lets start with the basic idea of a (Riemannian) manifold and the Laplace-Beltrami operator.</p><h3 id="heading-first-the-riemannian-manifold">First, the Riemannian manifold...</h3><p>Flat earthers are right. The surface of the earth is a 2D manifold. Every region around it looks like a region of the Euclidean plane.</p><p><img src="https://upload.wikimedia.org/wikipedia/commons/f/f0/Polar_stereographic_projections.jpg" alt="By User:RokerHRO - Combination of Stereographic Projection Water Hemisphere and Stereographic Projection Polar Extreme into a single image, CC BY-SA 3.0, Link" /></p><blockquote><p>By User:RokerHRO - Combination of Stereographic Projection Water Hemisphere and Stereographic Projection Polar Extreme into a single image, CC BY-SA 3.0</p></blockquote><p>A manifold is defined as a topological space that locally resembles Euclidean space near each point. This notion allows complicated systems to be explained in simpler terms of local topological properties of Euclidean space.</p><p>In computer vision, the notion a manifold is used quite frequently in rotation averaging \( SO3 \), structure and motion (Essential manifold), to capture the shape of an object (Shape manifolds), to model a set of images (Grassman manifolds) or to simply represent a sphere \( S^n \).</p><p><img src="http://sites.bu.edu/tron/files/2016/08/essentialManifold.png" alt="The space of essential matrices as a Riemannian manifold, C: Roboerto Tron ]" /></p><blockquote><p>The space of essential matrices as a Riemannian manifold, C: Roboerto Tron</p></blockquote><p>A Hilbert space is an abstract vector space with an inner product which has to be complete under convergence (i.e. to allow calculus to be used). This generalises the notion of Euclidean space by extending the methods of vector algebra and calculus from 2D Euclidean plane and 3D spaces to higher dimensions.</p><p>Thus, we can define norms in Hilbert space to allow us to measure distances, and inner products to allow us to measure angles.</p><p>On a Riemannian manifold, you get to measure lengths of the curves. A Riemannian manifold is a manifold with an inner product defined in the tangent space at each point. Riemannian geometry is a field by itself.</p><p>A Riemannian metric (tensor) makes it possible to define several geometric notions on a Riemannian manifold, such as angle at an intersection, length of a curve, area of a surface and higher-dimensional analogues (volume, etc.), extrinsic curvature of submanifolds, and intrinsic curvature of the manifold itself. It also allows us to define geodesic distance on the manifold.</p><h3 id="heading-geodesics">Geodesics</h3><p>Geodesics are locally shortest curves. They preserve a direction on a surface and have many interesting properties. In a plane, the geodesics are straight lines. On a sphere, the geodesics are great circles (like the equator). The geodesics in a space depend on the Riemannian metric, which affects the notions of distance and acceleration. Again, metric geometry is a field by itself.</p><p>Equivalently in other areas, it can be defined as a path that a particle which is not accelerating would follow.</p><p>In Riemannian geometry, all geodesics are locally distance-minimizing paths, but the converse is not true.</p><p><img src="https://upload.wikimedia.org/wikipedia/commons/6/6a/Spherical_triangle.svg" alt=" By derivative work: Pbroks13 (talk) A geodesic triangle on the sphere. The geodesics are great circle arcs." /></p><blockquote><p> By derivative work: Pbroks13 (talk) A geodesic triangle on the sphere. The geodesics are great circle arcs.</p></blockquote><h3 id="heading-isometry-and-isomorphism">Isometry and Isomorphism</h3><p>Without going into too much details on metrics and (pseudo-) Riemannian manifolds, an isometry of a manifold can be defined in simpler terms as any (smooth) mapping of that manifold (into itself, or into another manifold) that preserves the notion of distance between points.</p><p>When such a mapping is on smooth manifolds (and is a diffeomorphism: the mapping is a bijection and its inverse is differentiable), it is called isometry, and provides a notion of isomorphism (sameness).</p><h3 id="heading-notations">Notations</h3><p>Terminology : Let \( M \) be a smooth manifold. Denote the tangent space at \( x \in M \) by \( T_x{M} \).</p><p>If \( f: M \rightarrow N \) is a smooth map between smooth manifolds, denote the associated map on \( T_x{M} \) by \( (Df)_x : T_x{M} \rightarrow T_fN \). If \( I \) is an open interval in \( \mathbb{R} \) and \( \alpha : I \rightarrow M \) is a smooth path, then for \( t \in I, \alpha (t) \) denotes, \( (D \alpha )_t (I) \in T_aM \).</p><p>Definition : A Riemannian metric on a smooth manifold \( M \) is a choice at each point \( x \in M \) of a positive definite inner product \( , \) on \( T_xM \), the inner products varying smoothly with \( x \). Then \( M \) is known as a Riemannian manifold.</p><p>A local isometry between two Riemannian manifolds \( M \) and \( N \) is a local diffeomorphism \( h : M \rightarrow N \), such that, for all points \( x \in M \) and all vectors \( v \) and \( w \) in \( T_xM \):</p><p> \( v, w = (Dh)_x(v), (Dh)_x(w) \).</p><p>A (Riemannian) isometry is a local isometry that is also a diffeomorphism.</p><p>Now, that we have a basic idea about the Riemannian manifolds, lets have a very quick look at the Laplace-Beltrami operator.</p><h3 id="heading-next-the-laplacian">Next, the Laplacian</h3><p>The Laplace operator is a fundamental concept in calculus, given by the divergence of the gradient of a function on Euclidean space. The laplacian of a function \( f \) at point \( p \) is the rate at which the average value of \( f \) over spheres centered at \( p \) deviates from \( f(p) \) as the radius of the sphere shrinks towards 0.</p><p>Initially introduced in the study of celestial mechanics, solutions of the equation f=0, now called Laplaces equation, are the so-called harmonic functions and represent the possible gravitational fields in regions of vacuum.</p><h3 id="heading-laplace-beltrami-operator">Laplace-Beltrami operator</h3><p>The Laplacian generalized to the Riemannian manifold \( (M,g) \) by the Laplace-Beltrami operator (g).</p><p>Equivalently other areas (esp. in diffusion processes) utilize this idea - Fluid mechanics (the Navier-stokes equation), potential theory (Poisson equation), heat diffusion (heat equation), wave equation, quantum physics (Schrodinger equation) and so on.</p><h3 id="heading-now-what-is-spectral-geometry">Now, what is Spectral Geometry?</h3><p>Spectral geometry is a field in mathematics which concerns relationships between geometric structures of manifolds and spectra of canonically defined differential operators.</p><p>Given a compact Riemannian manifold, we can associate to it the (linear unbounded) Laplace-Beltrami operator. This operator is self-adjoint and its spectrum is discrete : namely the spectrum consists of a increasing sequence of real eigenvalues with finite multiplicity.</p><p>Two closed Riemannian manifolds are said to be isospectral if the eigenvalues of their LaplaceBeltrami operator (Laplacians), counted multiplicities, coincide.</p><p>Thus, spectral geometry is the connection between the spectrum \( Spec(M,g) \) and the geometry of the manifold \( (M,g) \) . This fundamentally deals with two kinds of problems:</p><h3 id="heading-direct-problems">Direct Problems</h3><p>A problem that arises a lot in physics, the analysis of PDEs, probabilty etc is to compute the spectrum of Laplacian (or other operators). The main idea is to find a lower bound estimate on the eigenvalues of the spectrum on a Riemannian manifold. This is we,</p><blockquote><p>compute (exactly or not) the spectrum \( Spec(M,g) \)? And (or) find properties on the spectrum \( Spec(M,g) \)</p></blockquote><p>Direct problems attempt to infer the behavior of the eigenvalues of a Riemannian manifold from knowledge of the geometry.</p><h3 id="heading-inverse-problems">Inverse Problems</h3><p>The problem well look more into detail in the next post, is the inverse problem. One of fundamental problems in spectral geometry is to ask to what extent the eigenvalues determine the geometry of a given manifold.</p><p>If the notion that a Riemannian invariant is true: if two Riemannian manifolds \( (M,g) \) and \( (M',g') \) are isometric, then they are isospectral i.e., \( Spec(M,g) == Spec(M',g') \).</p><blockquote><p>which geometric information of the manifold can we determine from the spectrum? does the data of the spectrum \( Spec(M,g) \) determine the shape of the manifold \( (M,g) \)?</p></blockquote><h3 id="heading-hearing-the-shape-of-a-drum">Hearing the shape of a drum</h3><p>This question of isospectrality (spectral alignment) in Riemannian geometry may be traced back to H. Weyl in 19111912 and became popularized thanks to M. Kacs article of 1966. The famous sentence of Kac Can one hear the shape of a drum? refers to this type of isospectral problem.</p><p>Spoiler: The answer is theoretically <a target="_blank" href="https://en.wikipedia.org/wiki/Hearing_the_shape_of_a_drum#The_answer">false</a>. There exists isospectral manifolds that are nonisometric.</p><h3 id="heading-isospectralization">Isospectralization</h3><p>A formulation of this inverse problem in terms of computer vision and shape analysis, is isospectralization, a numerical optimisation procedure in relation with interpolation, correspondence matching and style transfer. More details of this can be found in my presentation for "Recent Advances in the Analysis of 3D Shapes" seminar at TU Munich.</p><iframe class="speakerdeck-iframe" src="https://speakerdeck.com/player/bb785583287644c2803276db84c7d64e" style="border:0px;background:padding-box padding-box rgba(0, 0, 0, 0.1);margin:0px;padding:0px;border-radius:6px;box-shadow:rgba(0, 0, 0, 0.2) 0px 5px 40px;width:560px;height:420px"></iframe><h3 id="heading-source-code-and-demo">Source Code and Demo</h3><p>Checkout my isospectralization pytorch implementation <a target="_blank" href="https://github.com/raincrash/shapeanalysis-seminar">notebooks</a>.</p><h1 id="heading-references">References</h1><ul><li>Notes for Analysis on Manifolds via the Laplacian by Yaiza Canzani.</li><li>Old and new aspects in Spectral Geometry. By M. Craiveanu, M. Puta and T. Rassias.</li><li>https://www.ems-ph.org/books/186/9783037191514_introduction.pdf</li><li>https://en.wikipedia.org/wiki/Laplace_operator</li><li>http://people.maths.ox.ac.uk/lackenby/intriem.pdf</li><li>https://sites.google.com/site/olivierlablee/spectral-geometry</li><li>https://en.wikipedia.org/wiki/Hearing_the_shape_of_a_drum</li></ul>]]>https://cdn.hashnode.com/res/hashnode/image/unsplash/xYlf6Edpc-k/upload/v1641572987248/iGEkcBEr6.jpeg