{ "links": { "bibtex": "https://inspirehep.net/api/literature/2729540?format=bibtex", "latex-eu": "https://inspirehep.net/api/literature/2729540?format=latex-eu", "latex-us": "https://inspirehep.net/api/literature/2729540?format=latex-us", "json": "https://inspirehep.net/api/literature/2729540?format=json", "json-expanded": "https://inspirehep.net/api/literature/2729540?format=json-expanded", "cv": "https://inspirehep.net/api/literature/2729540?format=cv", "citations": "https://inspirehep.net/api/literature/?q=refersto%3Arecid%3A2729540" }, "updated": "2025-10-08T20:09:32.363169+00:00", "id": "2729540", "revision_id": 2, "uuid": "b878e1d5-1866-479b-85ba-960dbd325a4e", "created": "2023-12-04T12:37:29.817144+00:00", "metadata": { "citation_count_without_self_citations": 37, "citation_count": 38, "core": false, "titles": [ { "title": "Gauge Equivariant Convolutional Networks and the Icosahedral CNN", "source": "submitter" } ], "$schema": "https://inspirehep.net/schemas/records/hep.json", "authors": [ { "uuid": "bb63c49c-de8c-49ae-a72d-07fcdd0f8ced", "record": { "$ref": "https://inspirehep.net/api/authors/2500703" }, "full_name": "Cohen, Taco S." }, { "uuid": "b95b64cb-afbf-4e00-8f8b-65c99b72ad62", "record": { "$ref": "https://inspirehep.net/api/authors/1047569" }, "full_name": "Weiler, Maurice" }, { "uuid": "2cdf8d09-808d-4341-aa67-66be4be3a469", "record": { "$ref": "https://inspirehep.net/api/authors/2729543" }, "full_name": "Kicanaoglu, Berkay" }, { "uuid": "3e7be60e-e6d1-48c7-b0a6-3304d74313c8", "record": { "$ref": "https://inspirehep.net/api/authors/983812" }, "full_name": "Welling, Max", "curated_relation": true } ], "curated": false, "figures": [ { "key": "2e2c24b1780e194ed9a234ce7e7b6fd9", "url": "https://inspirehep.net/files/2e2c24b1780e194ed9a234ce7e7b6fd9", "label": "fig:gauge_trafo", "source": "arxiv", "caption": "A gauge is a smoothly varying choice of tangent frame on a subset $U$ of a manifold $M$. A gauge is needed to represent geometrical quantities such as convolutional filters and feature maps (i.e. fields), but the choice of gauge is ultimately arbitrary. Hence, the network should be equivariant to gauge transformations, such as the change between red and blue gauge pictured here.", "filename": "sphere_gauge.png", "material": "preprint" }, { "key": "481b7f952b394345586eff89c4a23a19", "url": "https://inspirehep.net/files/481b7f952b394345586eff89c4a23a19", "label": "fig:parallel_transport", "source": "arxiv", "caption": "On curved spaces, parallel transport is path dependent. The black vector is transported to the same point via two different curves, yielding different results. The same phenomenon occurs for other geometric objects, including filters.", "filename": "parallel_transport.png", "material": "preprint" }, { "key": "457a37b4fc918cf4426c119c9e05e8e6", "url": "https://inspirehep.net/files/457a37b4fc918cf4426c119c9e05e8e6", "label": "fig:exponential_map", "source": "arxiv", "caption": "The exponential map and the gauge $w_p$.", "filename": "expmap_and_frame.png", "material": "preprint" }, { "key": "09110e4a3fb84491e7fa1af7fe84aeb7", "url": "https://inspirehep.net/files/09110e4a3fb84491e7fa1af7fe84aeb7", "label": "fig:atlas", "source": "arxiv", "caption": "The Icosahedron with grid $\\mathcal{H}_r$ for $r=2$ (left). We define $5$ overlapping charts that cover the grid (center). Chart $V_5$ is highlighted in gray (left). Colored edges that appear in multiple charts are to be identified. In each chart, we define the gauge by the standard axis aligned basis vectors $e_1, e_2 \\in V_i$. For points $p \\in U_i \\cap U_j$, the transition between charts involves a change of gauge, shown as $+1 \\cdot 2\\pi/6$ and $-1 \\cdot 2\\pi /6$ (elements of $G=C_6$). On the right we show how the signal is represented in a padded array of shape $5 \\cdot (2^r + 2) \\times (2^{r+1}+2)$.", "filename": "charts.png", "material": "preprint" }, { "key": "9fd40edac67085dfe552289b7446be89", "url": "https://inspirehep.net/files/9fd40edac67085dfe552289b7446be89", "label": "fig:gpad", "source": "arxiv", "caption": "G-Padding (scalar signal)", "filename": "gpad.png", "material": "preprint" }, { "key": "8d1929e46027426661aebd1388193c67", "url": "https://inspirehep.net/files/8d1929e46027426661aebd1388193c67", "label": "fig:kexp", "source": "arxiv", "caption": "Kernel expansion for scalar-to-regular ($R_\\text{in}=1, R_\\text{out}=6$; left) and regular-to-regular ($R_\\text{in} = R_\\text{out}=6$; right) convolution. Top: free parameters. Bottom: expanded kernel used in conv2d.", "filename": "kexp.png", "material": "preprint" }, { "key": "689e8428d5de061839b9cc4a6ac45469", "url": "https://inspirehep.net/files/689e8428d5de061839b9cc4a6ac45469", "label": "fig:compute_comparison", "source": "arxiv", "caption": "Comparison of computational cost (in wallclock time) of Icosahedral CNNs (IcoNet) and Spherical CNNs (S2CNN, \\cite{cohenSphericalCNNs2018}), at increasing grid resolution $r$.", "filename": "compute_comparison.png", "material": "preprint" }, { "key": "b96a30e8f11468c43bebd4074a51bf3a", "url": "https://inspirehep.net/files/b96a30e8f11468c43bebd4074a51bf3a", "label": "fig:memory_comparison", "source": "arxiv", "caption": "Comparison of memory usage of Icosahedral CNNs (IcoNet) and Spherical CNNs (S2CNN, \\cite{cohenSphericalCNNs2018}), at increasing grid resolution $r$.", "filename": "memory_comparison.png", "material": "preprint" } ], "texkeys": [ "Cohen:2019ikq" ], "citeable": true, "abstracts": [ { "value": "The principle of equivariance to symmetry transformations enables a theoretically grounded approach to neural network architecture design. Equivariant networks have shown excellent performance and data efficiency on vision and medical imaging problems that exhibit symmetries. Here we show how this principle can be extended beyond global symmetries to local gauge transformations. This enables the development of a very general class of convolutional neural networks on manifolds that depend only on the intrinsic geometry, and which includes many popular methods from equivariant and geometric deep learning. We implement gauge equivariant CNNs for signals defined on the surface of the icosahedron, which provides a reasonable approximation of the sphere. By choosing to work with this very regular manifold, we are able to implement the gauge equivariant convolution using a single conv2d call, making it a highly scalable and practical alternative to Spherical CNNs. Using this method, we demonstrate substantial improvements over previous methods on the task of segmenting omnidirectional images and global climate patterns.", "source": "submitter" } ], "references": [ { "raw_refs": [ { "value": "Armeni, I., Sax, A., Zamir, A. R., and Savarese, S. Joint", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "Joint" ], "authors": [ { "full_name": "Armeni, I." }, { "full_name": "Sax, A." }, { "full_name": "Zamir, A.R." }, { "full_name": "Savarese, S." } ] } }, { "raw_refs": [ { "value": "2D-3D-Semantic Data for Indoor Scene Understanding.", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "2D-3D-Semantic Data for Indoor Scene Understanding" ] } }, { "raw_refs": [ { "value": "ArXiv e-prints, February 2017.", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "ArXiv e-prints, February" ], "publication_info": { "year": 2017 } } }, { "raw_refs": [ { "value": "Bekkers, E. J., Lafarge, M. W., Veta, M., Eppenhof, K. A. J., Pluim, J. P. W., and Duits, R. Roto-Translation Covariant", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "Roto-Translation Covariant" ], "authors": [ { "full_name": "Bekkers, E.J." }, { "full_name": "Lafarge, M.W." }, { "full_name": "Veta, M." }, { "full_name": "Eppenhof, K.A.J." }, { "full_name": "Pluim, J.P.W." }, { "full_name": "Duits, R." } ] } }, { "raw_refs": [ { "value": "Convolutional Networks for Medical Image Analysis. In", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "Convolutional Networks for Medical Image Analysis. In" ] } }, { "raw_refs": [ { "value": "MICCAI, 2018.", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "MICCAI" ], "publication_info": { "year": 2018 } } }, { "raw_refs": [ { "value": "Boomsma, W. and Frellsen, J. Spherical convolutions and their application in molecular modelling. In NIPS, 2017.", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "Spherical convolutions and their application in molecular modelling. In NIPS" ], "authors": [ { "full_name": "Boomsma, W." }, { "full_name": "Frellsen, J." } ], "publication_info": { "year": 2017 } } }, { "raw_refs": [ { "value": "Boscaini, D., Masci, J., Melzi, S., Bronstein, M. M., Castellani, U., and Vandergheynst, P. Learning class-specific descriptors for deformable shapes using localized spectral convolutional networks. Computer Graphics Forum, 2015.", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "Learning class-specific descriptors for deformable shapes using localized spectral convolutional networks. Computer Graphics Forum" ], "authors": [ { "full_name": "Boscaini, D." }, { "full_name": "Masci, J." }, { "full_name": "Melzi, S." }, { "full_name": "Bronstein, M.M." }, { "full_name": "Castellani, U." }, { "full_name": "Vandergheynst, P." } ], "publication_info": { "year": 2015 } } }, { "raw_refs": [ { "value": "Boscaini, D., Masci, J., Rodolà, E., and Bronstein, M. M.", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "Rodolà, E., and Bronstein, M. M" ], "authors": [ { "full_name": "Boscaini, D." }, { "full_name": "Masci, J." } ] } }, { "raw_refs": [ { "value": "Learning shape correspondence with anisotropic convolutional neural networks. In NIPS, 2016.", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "Learning shape correspondence with anisotropic convolutional neural networks. In NIPS" ], "publication_info": { "year": 2016 } } }, { "raw_refs": [ { "value": "Bronstein, M. M., Bruna, J., LeCun, Y., Szlam, A., and Vandergheynst, P. Geometric deep learning: Going beyond", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "Geometric deep learning: Going beyond" ], "authors": [ { "full_name": "Bronstein, M.M." }, { "full_name": "Bruna, J." }, { "full_name": "LeCun, Y." }, { "full_name": "Szlam, A." }, { "full_name": "Vandergheynst, P." } ] } }, { "raw_refs": [ { "value": "Euclidean data. IEEE Signal Processing Magazine, 2017.", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "Euclidean data. IEEE Signal Processing Magazine" ], "publication_info": { "year": 2017 } } }, { "raw_refs": [ { "value": "Bruna, J., Zaremba, W., Szlam, A., and LeCun, Y. Spectral Networks and Deep Locally Connected Networks on", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "Spectral Networks and Deep Locally Connected Networks on" ], "authors": [ { "full_name": "Bruna, J." }, { "full_name": "Zaremba, W." }, { "full_name": "Szlam, A." }, { "full_name": "LeCun, Y." } ] } }, { "raw_refs": [ { "value": "Graphs. In ICLR, 2014.", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "Graphs. In ICLR" ], "publication_info": { "year": 2014 } } }, { "raw_refs": [ { "value": "Cohen, T., Geiger, M., and Weiler, M. A General Theory of", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "General Theory of" ], "authors": [ { "full_name": "Cohen, T." }, { "full_name": "Geiger, M." }, { "full_name": "Weiler, M.A" } ] } }, { "raw_refs": [ { "value": "Equivariant CNNs on Homogeneous Spaces. 2018a.", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "Equivariant CNNs on Homogeneous Spaces.a" ], "publication_info": { "year": 2018 } } }, { "raw_refs": [ { "value": "Cohen, T. S. and Welling, M. Group equivariant convolutional networks. In ICML, 2016.", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "Group equivariant convolutional networks. In ICML" ], "authors": [ { "full_name": "Cohen, T.S." }, { "full_name": "Welling, M." } ], "publication_info": { "year": 2016 } } }, { "raw_refs": [ { "value": "Cohen, T. S. and Welling, M. Steerable CNNs. In ICLR, 2017.", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "Steerable CNNs. In ICLR" ], "authors": [ { "full_name": "Cohen, T.S." }, { "full_name": "Welling, M." } ], "publication_info": { "year": 2017 } } }, { "raw_refs": [ { "value": "Cohen, T. S., Geiger, M., Koehler, J., and Welling, M. Spherical CNNs. In ICLR, 2018b.", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "Spherical CNNs. In ICLR,b" ], "authors": [ { "full_name": "Cohen, T.S." }, { "full_name": "Geiger, M." }, { "full_name": "Koehler, J." }, { "full_name": "Welling, M." } ], "publication_info": { "year": 2018 } } }, { "raw_refs": [ { "value": "Cohen, T. S., Geiger, M., and Weiler, M. Intertwiners between Induced Representations (with Applications to the Theory of Equivariant Neural Networks). 2018c.", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "Intertwiners between Induced Representations (with Applications to the Theory of Equivariant Neural Networks).c" ], "authors": [ { "full_name": "Cohen, T.S." }, { "full_name": "Geiger, M." }, { "full_name": "Weiler, M." } ], "publication_info": { "year": 2018 } } }, { "raw_refs": [ { "value": "Crane, K. Discrete Differential Geometry: An Applied", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "Discrete Differential Geometry: An Applied" ], "authors": [ { "full_name": "Crane, K." } ] } }, { "raw_refs": [ { "value": "Introduction. 30664:1–6, 2014.", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "Introduction. 30664:1-6" ], "publication_info": { "year": 2014 } } }, { "raw_refs": [ { "value": "The climate dataset released by (Jiang et al., 2018) and the", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "The climate dataset released by", "and the" ], "authors": [ { "full_name": "Jiang" } ], "publication_info": { "year": 2018 } } }, { "raw_refs": [ { "value": "Stanford 2D-3D-S datasets were downloaded and evaluated by", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "Stanford 2D-3D-S datasets were downloaded and evaluated by" ] } }, { "raw_refs": [ { "value": "QUvA researchers.", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "QUvA researchers" ] } }, { "raw_refs": [ { "value": "Esteves, C., Allen-Blanchette, C., Makadia, A., and Daniilidis, K. Learning SO(3) equivariant representations with spherical cnns. In ECCV, 2018.", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "Learning SO(3) equivariant representations with spherical cnns. In ECCV" ], "authors": [ { "full_name": "Esteves, C." }, { "full_name": "Allen-Blanchette, C." }, { "full_name": "Makadia, A." }, { "full_name": "Daniilidis, K." } ], "publication_info": { "year": 2018 } } }, { "raw_refs": [ { "value": "Hartford, J. S., Graham, D. R., Leyton-Brown, K., and", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "and" ], "authors": [ { "full_name": "Hartford, J.S." }, { "full_name": "Graham, D.R." }, { "full_name": "Leyton-Brown, K." } ] } }, { "raw_refs": [ { "value": "Ravanbakhsh, S. Deep models of interactions across sets.", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "Deep models of interactions across sets" ], "authors": [ { "full_name": "Ravanbakhsh, S." } ] } }, { "raw_refs": [ { "value": "In ICML, 2018.", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "In ICML" ], "publication_info": { "year": 2018 } } }, { "raw_refs": [ { "value": "He, K., Zhang, X., Ren, S., and Sun, J. Deep Residual", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "He, K", "Deep Residual" ], "authors": [ { "full_name": "Zhang, X." }, { "full_name": "Ren, S." }, { "full_name": "Sun, J." } ] } }, { "raw_refs": [ { "value": "Learning for Image Recognition. In CVPR, 2016.", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "Learning for Image Recognition. In CVPR" ], "publication_info": { "year": 2016 } } }, { "raw_refs": [ { "value": "Hoogeboom, E., Peters, J. W. T., Cohen, T. S., and Welling, M. HexaConv. In ICLR, 2018.", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "HexaConv. In ICLR" ], "authors": [ { "full_name": "Hoogeboom, E." }, { "full_name": "Peters, J.W.T." }, { "full_name": "Cohen, T.S." }, { "full_name": "Welling, M." } ], "publication_info": { "year": 2018 } } }, { "raw_refs": [ { "value": "Husemöller, D. Fibre Bundles. Number 20 in Graduate", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "Husemöller", "Number 20 in Graduate" ], "authors": [ { "full_name": "Bundles, D. Fibre" } ] } }, { "raw_refs": [ { "value": "Texts in Mathematics. Springer-Verlag, New York, 3rd ed edition, 1994. ISBN 978-0-387-94087-8.", "schema": "text", "source": "submitter" } ], "reference": { "isbn": "9780387940878", "misc": [ "Texts in Mathematics", "-Verlag, New York, 3rd ed edition" ], "imprint": { "publisher": "Springer" }, "publication_info": { "year": 1994 } } }, { "raw_refs": [ { "value": "Hy, T. S., Trivedi, S., Pan, H., Anderson, B. M., and Kondor, R. Predicting molecular properties with covariant compositional networks. The Journal of Chemical Physics, 148", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "Hy, T. S", "Predicting molecular properties with covariant compositional networks. The Journal of Chemical Physics, 148" ], "authors": [ { "full_name": "Trivedi, S." }, { "full_name": "Pan, H." }, { "full_name": "Anderson, B.M." }, { "full_name": "Kondor, R." } ] } }, { "raw_refs": [ { "value": "(24), 2018.", "schema": "text", "source": "submitter" } ], "reference": { "label": "24", "publication_info": { "year": 2018 } } }, { "record": { "$ref": "https://inspirehep.net/api/literature/1690634" }, "raw_refs": [ { "value": "Ioffe, S. and Szegedy, C. Batch normalization: Accelerating deep network training by reducing internal covariate shift. arXiv:1502.03167 [cs], Feb 2015. URL http://arxiv.org/abs/1502.03167. arXiv:", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "Batch normalization: Accelerating deep network training by reducing internal covariate shift", "Feb. URL", "arXiv:" ], "authors": [ { "full_name": "Ioffe, S." }, { "full_name": "Szegedy, C." } ], "arxiv_eprint": "1502.03167", "publication_info": { "year": 2015 } } }, { "record": { "$ref": "https://inspirehep.net/api/literature/1690634" }, "raw_refs": [ { "value": "1502.03167.", "schema": "text", "source": "submitter" } ], "reference": { "arxiv_eprint": "1502.03167" } }, { "raw_refs": [ { "value": "Jiang, C., Huang, J., Kashinath, K., Prabhat, Marcus, P., and", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "Prabhat, Marcus, P", "and" ], "authors": [ { "full_name": "Jiang, C." }, { "full_name": "Huang, J." }, { "full_name": "Kashinath, K." } ] } }, { "raw_refs": [ { "value": "Niessner, M. Spherical CNNs on Unstructured Grids. In", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "Spherical CNNs on Unstructured Grids. In" ], "authors": [ { "full_name": "Niessner, M." } ] } }, { "raw_refs": [ { "value": "ICLR, 2018.", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "ICLR" ], "publication_info": { "year": 2018 } } }, { "raw_refs": [ { "value": "Kipf, T. N. and Welling, M. Semi-supervised classification with graph convolutional networks. In ICLR, 2017.", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "Semi-supervised classification with graph convolutional networks. In ICLR" ], "authors": [ { "full_name": "Kipf, T.N." }, { "full_name": "Welling, M." } ], "publication_info": { "year": 2017 } } }, { "raw_refs": [ { "value": "Kondor, R. and Trivedi, S. On the Generalization of Equivariance and Convolution in Neural Networks to the Action of Compact Groups. In ICML, 2018.", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "On the Generalization of Equivariance and Convolution in Neural Networks to the Action of Compact Groups. In ICML" ], "authors": [ { "full_name": "Kondor, R." }, { "full_name": "Trivedi, S." } ], "publication_info": { "year": 2018 } } }, { "raw_refs": [ { "value": "Kondor, R., Lin, Z., and Trivedi, S. Clebsch–Gordan Nets:", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "Clebsch-Gordan Nets:" ], "authors": [ { "full_name": "Kondor, R." }, { "full_name": "Lin, Z." }, { "full_name": "Trivedi, S." } ] } }, { "raw_refs": [ { "value": "A Fully Fourier Space Spherical Convolutional Neural", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "Space Spherical Convolutional Neural" ], "authors": [ { "full_name": "Fourier, A. Fully" } ] } }, { "raw_refs": [ { "value": "Network. In NIPS, 2018a.", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "Network. In NIPS,a" ], "publication_info": { "year": 2018 } } }, { "raw_refs": [ { "value": "Kondor, R., Son, H. T., Pan, H., Anderson, B., and Trivedi, S.", "schema": "text", "source": "submitter" } ], "reference": { "authors": [ { "full_name": "Kondor, R." }, { "full_name": "Son, H.T." }, { "full_name": "Pan, H." }, { "full_name": "Anderson, B." }, { "full_name": "Trivedi, S." } ] } }, { "raw_refs": [ { "value": "Covariant Compositional Networks For Learning Graphs.", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "Covariant Compositional Networks For Learning Graphs" ] } }, { "raw_refs": [ { "value": "January 2018b.", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "Januaryb" ], "publication_info": { "year": 2018 } } }, { "raw_refs": [ { "value": "Kostelec, P. J. and Rockmore, D. N. SOFT:", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "SOFT:" ], "authors": [ { "full_name": "Kostelec, P.J." }, { "full_name": "Rockmore, D.N." } ] } }, { "raw_refs": [ { "value": "SO(3) Fourier Transforms. 2007. URL https:", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "SO(3) Fourier Transforms.. URL https:" ], "publication_info": { "year": 2007 } } }, { "raw_refs": [ { "value": "//www.cs.dartmouth.edu/˜geelong/soft/ soft20_fx.pdf.", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "//www.cs.dartmouth.edu/˜geelong/soft/ soft20_fx.pdf" ] } }, { "raw_refs": [ { "value": "Kunis, S. and Potts, D. Fast spherical Fourier algorithms.", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "Fast spherical Fourier algorithms" ], "authors": [ { "full_name": "Kunis, S." }, { "full_name": "Potts, D." } ] } }, { "raw_refs": [ { "value": "161:75–98, 2003. ISSN 0377-0427.", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "161:75-98,. ISSN 0377-0427" ], "publication_info": { "year": 2003 } } }, { "raw_refs": [ { "value": "Lee, J. Introduction to Riemannian Manifolds. Graduate", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "Introduction to Riemannian Manifolds. Graduate" ], "authors": [ { "full_name": "Lee, J." } ] } }, { "raw_refs": [ { "value": "Texts in Mathematics. Springer International Publishing, 2 edition. ISBN 978-3-319-91754-2.", "schema": "text", "source": "submitter" } ], "reference": { "isbn": "9783319917542", "misc": [ "Texts in Mathematics", "International Publishing, 2 edition" ], "imprint": { "publisher": "Springer" } } }, { "raw_refs": [ { "value": "Liu, M., Yao, F., Choi, C., Ayan, S., and Karthik, R. Deep", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "Deep" ], "authors": [ { "full_name": "Liu, M." }, { "full_name": "Yao, F." }, { "full_name": "Choi, C." }, { "full_name": "Ayan, S." }, { "full_name": "Karthik, R." } ] } }, { "raw_refs": [ { "value": "Learning 3D Shapes using Alt-Az Anisotropic 2-Sphere", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "Learning 3D Shapes using Alt-Az Anisotropic 2-Sphere" ] } }, { "raw_refs": [ { "value": "Convolution. In ICLR, 2019.", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "Convolution. In ICLR" ], "publication_info": { "year": 2019 } } }, { "raw_refs": [ { "value": "Lunter, G. and Brown, R. An Equivariant Bayesian Convolutional Network predicts recombination hotspots and accurately resolves binding motifs. Bioinformatics, 2018.", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "An Equivariant Bayesian Convolutional Network predicts recombination hotspots and accurately resolves binding motifs. Bioinformatics" ], "authors": [ { "full_name": "Lunter, G." }, { "full_name": "Brown, R." } ], "publication_info": { "year": 2018 } } }, { "raw_refs": [ { "value": "Marcos, D., Volpi, M., Komodakis, N., and Tuia, D. Rotation equivariant vector field networks. In ICCV, 2017.", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "Rotation equivariant vector field networks. In ICCV" ], "authors": [ { "full_name": "Marcos, D." }, { "full_name": "Volpi, M." }, { "full_name": "Komodakis, N." }, { "full_name": "Tuia, D." } ], "publication_info": { "year": 2017 } } }, { "raw_refs": [ { "value": "Maron, H., Ben-Hamu, H., Shamir, N., and Lipman, Y. Invariant and Equivariant Graph Networks. In arXiv:1812.09902 [Cs, Stat], 2019.", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "Invariant and Equivariant Graph Networks. In", "[Cs, Stat]" ], "authors": [ { "full_name": "Maron, H." }, { "full_name": "Ben-Hamu, H." }, { "full_name": "Shamir, N." }, { "full_name": "Lipman, Y." } ], "arxiv_eprint": "1812.09902", "publication_info": { "year": 2019 } } }, { "raw_refs": [ { "value": "Masci, J., Boscaini, D., Bronstein, M. M., and Vandergheynst, P. Geodesic convolutional neural networks on riemannian manifolds. ICCVW, 2015.", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "Geodesic convolutional neural networks on riemannian manifolds. ICCVW" ], "authors": [ { "full_name": "Masci, J." }, { "full_name": "Boscaini, D." }, { "full_name": "Bronstein, M.M." }, { "full_name": "Vandergheynst, P." } ], "publication_info": { "year": 2015 } } }, { "raw_refs": [ { "value": "Mudigonda, M., Kim, S., Mahesh, A., Kahou, S., Kashinath, K., Williams, D., Michalski, V., O’Brien, T., and Prabhat, M. Segmenting and Tracking Extreme Climate Events using Neural Networks. 2017.", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "Segmenting and Tracking Extreme Climate Events using Neural Networks" ], "authors": [ { "full_name": "Mudigonda, M." }, { "full_name": "Kim, S." }, { "full_name": "Mahesh, A." }, { "full_name": "Kahou, S." }, { "full_name": "Kashinath, K." }, { "full_name": "Williams, D." }, { "full_name": "Michalski, V." }, { "full_name": "O'Brien, T." }, { "full_name": "Prabhat, M." } ], "publication_info": { "year": 2017 } } }, { "raw_refs": [ { "value": "Nakahara, M. Geometry, Topology, and Physics. 2003.", "schema": "text", "source": "submitter" } ], "reference": { "title": { "title": "Geometry, topology and physics" }, "authors": [ { "full_name": "Nakahara, M." } ], "publication_info": { "year": 2003 } } }, { "raw_refs": [ { "value": "ISBN 978-0-7503-0606-5.", "schema": "text", "source": "submitter" } ], "reference": { "isbn": "9780750306065" } }, { "raw_refs": [ { "value": "Oyallon, E. and Mallat, S. Deep roto-translation scattering for object classification. In CVPR, 2015.", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "Deep roto-translation scattering for object classification. In CVPR" ], "authors": [ { "full_name": "Oyallon, E." }, { "full_name": "Mallat, S." } ], "publication_info": { "year": 2015 } } }, { "raw_refs": [ { "value": "Perraudin, N., Defferrard, M., Kacprzak, T., and Sgier, R.", "schema": "text", "source": "submitter" } ], "reference": { "authors": [ { "full_name": "Perraudin, N." }, { "full_name": "Defferrard, M." }, { "full_name": "Kacprzak, T." }, { "full_name": "Sgier, R." } ] } }, { "raw_refs": [ { "value": "DeepSphere: Efficient spherical Convolutional Neural", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "DeepSphere: Efficient spherical Convolutional Neural" ] } }, { "record": { "$ref": "https://inspirehep.net/api/literature/1700821" }, "raw_refs": [ { "value": "Network with HEALPix sampling for cosmological applications. arXiv:1810.12186 [astro-ph], October 2018.", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "Network with HEALPix sampling for cosmological applications", "October" ], "arxiv_eprint": "1810.12186", "publication_info": { "year": 2018 } } }, { "raw_refs": [ { "value": "Poulenard, A. and Ovsjanikov, M. Multi-directional geodesic neural networks via equivariant convolution.", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "Multi-directional geodesic neural networks via equivariant convolution" ], "authors": [ { "full_name": "Poulenard, A." }, { "full_name": "Ovsjanikov, M." } ] } }, { "raw_refs": [ { "value": "ACM Transactions on Graphics, 2018.", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "ACM Transactions on Graphics" ], "publication_info": { "year": 2018 } } }, { "raw_refs": [ { "value": "Ravanbakhsh, S., Schneider, J., and Póczos, B. Equivariance through parameter-sharing. In ICML, 2017.", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "and Póczos, B. Equivariance", "through parameter-sharing. In ICML" ], "authors": [ { "full_name": "Ravanbakhsh, S." }, { "full_name": "Schneider, J." } ], "publication_info": { "year": 2017 } } }, { "raw_refs": [ { "value": "Ronneberger, O., P.Fischer, and Brox, T. U-net: Convolutional networks for biomedical image segmentation. In", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "U-net: Convolutional networks for biomedical image segmentation. In" ], "authors": [ { "full_name": "Ronneberger, O." }, { "full_name": "P.Fischer" }, { "full_name": "Brox, T." } ] } }, { "raw_refs": [ { "value": "MICCAI, 2015.", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "MICCAI" ], "publication_info": { "year": 2015 } } }, { "raw_refs": [ { "value": "Schonsheck, S. C., Dong, B., and Lai, R. Parallel Transport", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "Parallel Transport" ], "authors": [ { "full_name": "Schonsheck, S.C." }, { "full_name": "Dong, B." }, { "full_name": "Lai, R." } ] } }, { "raw_refs": [ { "value": "Convolution: A New Tool for Convolutional Neural Networks on Manifolds. arXiv:1805.07857 [cs, math, stat], May 2018.", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "Convolution:", "for Convolutional Neural Networks on Manifolds", "[cs, math, stat], May" ], "authors": [ { "full_name": "Tool, A. New" } ], "arxiv_eprint": "1805.07857", "publication_info": { "year": 2018 } } }, { "raw_refs": [ { "value": "Schuller, F. Lectures on the Geometrical Anatomy of Theoretical Physics, 2016.", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "Lectures on the Geometrical Anatomy of Theoretical Physics" ], "authors": [ { "full_name": "Schuller, F." } ], "publication_info": { "year": 2016 } } }, { "raw_refs": [ { "value": "Sharpe, R. W. Differential Geometry: Cartan’s Generalization of Klein’s Erlangen Program. 1997.", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "Differential Geometry: Cartan’s Generalization of Klein’s Erlangen Program" ], "authors": [ { "full_name": "Sharpe, R.W." } ], "publication_info": { "year": 1997 } } }, { "raw_refs": [ { "value": "Shoshichi Kobayashi, K. N. Foundations of Differential", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "Shoshichi", "Foundations of Differential" ], "authors": [ { "full_name": "Kobayashi, K.N." } ] } }, { "raw_refs": [ { "value": "Geometry (Volume 1). 1963.", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "Geometry (Volume 1)" ], "publication_info": { "year": 1963 } } }, { "raw_refs": [ { "value": "Steenrod, N. The Topology of Fibre Bundles. 1951.", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "The Topology of Fibre Bundles" ], "authors": [ { "full_name": "Steenrod, N." } ], "publication_info": { "year": 1951 } } }, { "raw_refs": [ { "value": "Su, Y.-C. and Grauman, K. Flat2sphere: Learning spherical convolution for fast features from 360 imagery. In NIPS, 2017.", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "Su, Y.-C. and Grauman, K. Flat2sphere: Learning spherical convolution for fast features from 360 imagery. In NIPS" ], "publication_info": { "year": 2017 } } }, { "raw_refs": [ { "value": "Thomas, N., Smidt, T., Kearnes, S., Yang, L., Li, L., Kohlhoff, K., and Riley, P. Tensor Field Networks:", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "Li, L., Kohlhoff, K., and Riley, P", "Tensor Field Networks:" ], "authors": [ { "full_name": "Thomas, N." }, { "full_name": "Smidt, T." }, { "full_name": "Kearnes, S." }, { "full_name": "Yang, L." } ] } }, { "raw_refs": [ { "value": "Rotation- and Translation-Equivariant Neural Networks for 3D Point Clouds. February 2018.", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "Rotation- and Translation-Equivariant Neural Networks for 3D Point Clouds. February" ], "publication_info": { "year": 2018 } } }, { "raw_refs": [ { "value": "Veeling, B. S., Linmans, J., Winkens, J., Cohen, T. S., and Welling, M. Rotation Equivariant CNNs for Digital Pathology. In MICCAI, 2018.", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "Rotation Equivariant CNNs for Digital Pathology. In MICCAI" ], "authors": [ { "full_name": "Veeling, B.S." }, { "full_name": "Linmans, J." }, { "full_name": "Winkens, J." }, { "full_name": "Cohen, T.S." }, { "full_name": "Welling, M." } ], "publication_info": { "year": 2018 } } }, { "raw_refs": [ { "value": "Weiler, M., Geiger, M., Welling, M., Boomsma, W., and", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "and" ], "authors": [ { "full_name": "Weiler, M." }, { "full_name": "Geiger, M." }, { "full_name": "Welling, M." }, { "full_name": "Boomsma, W." } ] } }, { "raw_refs": [ { "value": "Cohen, T. S. 3D Steerable CNNs: Learning Rotationally", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "3D Steerable CNNs: Learning Rotationally" ], "authors": [ { "full_name": "Cohen, T.S." } ] } }, { "raw_refs": [ { "value": "Equivariant Features in Volumetric Data. In NeurIPS, 2018a.", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "Equivariant Features in Volumetric Data. In NeurIPS,a" ], "publication_info": { "year": 2018 } } }, { "raw_refs": [ { "value": "Weiler, M., Hamprecht, F. A., and Storath, M. Learning Steerable Filters for Rotation Equivariant CNNs. In", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "Learning Steerable Filters for Rotation Equivariant CNNs. In" ], "authors": [ { "full_name": "Weiler, M." }, { "full_name": "Hamprecht, F.A." }, { "full_name": "Storath, M." } ] } }, { "raw_refs": [ { "value": "CVPR, 2018b.", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "CVPR,b" ], "publication_info": { "year": 2018 } } }, { "raw_refs": [ { "value": "Wendl, C. Lecture Notes on Bundles and Connections. 2008. URL https://www.mathematik. hu-berlin.de/˜wendl/connections.html.", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "Lecture Notes on Bundles and Connections.. URL", "hu-berlin.de/˜wendl/connections.html" ], "urls": [ { "value": "https://www.mathematik" } ], "authors": [ { "full_name": "Wendl, C." } ], "publication_info": { "year": 2008 } } }, { "raw_refs": [ { "value": "Winkels, M. and Cohen, T. S. 3D G-CNNs for Pulmonary", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "3D G-CNNs", "for Pulmonary" ], "authors": [ { "full_name": "Winkels, M." }, { "full_name": "Cohen, T.S." } ] } }, { "raw_refs": [ { "value": "Nodule Detection. In International Conference on Medical Imaging with Deep Learning (MIDL), 2018.", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "Nodule Detection. In International Conference on Medical Imaging with Deep Learning (MIDL)" ], "publication_info": { "year": 2018 } } }, { "raw_refs": [ { "value": "Worrall, D. E. and Brostow, G. J. Cubenet: Equivariance to", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "Cubenet: Equivariance to" ], "authors": [ { "full_name": "Worrall, D.E." }, { "full_name": "Brostow, G.J." } ] } }, { "raw_refs": [ { "value": "3d rotation and translation. In ECCV, 2018.", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "3d rotation and translation. In ECCV" ], "publication_info": { "year": 2018 } } }, { "raw_refs": [ { "value": "Worrall, D. E., Garbin, S. J., Turmukhambetov, D., and", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "and" ], "authors": [ { "full_name": "Worrall, D.E." }, { "full_name": "Garbin, S.J." }, { "full_name": "Turmukhambetov, D." } ] } }, { "raw_refs": [ { "value": "Brostow, G. J. Harmonic Networks: Deep Translation and Rotation Equivariance. In CVPR, 2017.", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "Harmonic Networks: Deep Translation and Rotation Equivariance. In CVPR" ], "authors": [ { "full_name": "Brostow, G.J." } ], "publication_info": { "year": 2017 } } }, { "raw_refs": [ { "value": "Zaheer, M., Kottur, S., Ravanbakhsh, S., Poczos, B., Salakhutdinov, R. R., and Smola, A. J. Deep sets. In", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "Deep sets. In" ], "authors": [ { "full_name": "Zaheer, M." }, { "full_name": "Kottur, S." }, { "full_name": "Ravanbakhsh, S." }, { "full_name": "Poczos, B." }, { "full_name": "Salakhutdinov, R.R." }, { "full_name": "Smola, A.J." } ] } }, { "raw_refs": [ { "value": "Guyon, I., Luxburg, U. V., Bengio, S., Wallach, H., Fergus, R., Vishwanathan, S., and Garnett, R. (eds.), NIPS, 2017.", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "NIPS" ], "authors": [ { "full_name": "Guyon, I." }, { "full_name": "Luxburg, U.V." }, { "full_name": "Bengio, S." }, { "full_name": "Wallach, H." }, { "full_name": "Fergus, R." }, { "full_name": "Vishwanathan, S." }, { "full_name": "Garnett, R." } ], "publication_info": { "year": 2017 } } }, { "raw_refs": [ { "value": "Supplementary Material", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "Supplementary Material" ] } }, { "raw_refs": [ { "value": "7. Recommended reading", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "Recommended reading" ], "label": "7" } }, { "raw_refs": [ { "value": "For more information on manifolds, fiber bundles, connections, parallel transport, the exponential map, etc., we highly recommend the lectures by Schuller (2016), as well as the book Nakahara (2003) which explain these concepts very clearly and at a useful level of abstraction.", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "For more information on manifolds, fiber bundles, connections, parallel transport, the exponential map, etc., we highly recommend the lectures by Schuller , as well as the book Nakahara (2003) which explain these concepts very clearly and at a useful level of abstraction" ], "publication_info": { "year": 2016 } } }, { "raw_refs": [ { "value": "For further study, we recommend (Sharpe, 1997;", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "For further study, we recommend (Sharpe" ], "publication_info": { "year": 1997 } } }, { "raw_refs": [ { "value": "For further study, we recommend (Sharpe, 1997;", "schema": "text", "source": "submitter" } ] }, { "raw_refs": [ { "value": "Shoshichi Kobayashi, 1963; Husemöller, 1994; Steenrod, 1951; Wendl, 2008; Crane, 2014).", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "Shoshichi Kobayashi" ], "publication_info": { "year": 1963 } } }, { "raw_refs": [ { "value": "Shoshichi Kobayashi, 1963; Husemöller, 1994; Steenrod, 1951; Wendl, 2008; Crane, 2014).", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "Husemöller,; Steenrod, 1951; Wendl, 2008; Crane, 2014)" ], "publication_info": { "year": 1994 } } }, { "raw_refs": [ { "value": "8. Mathematical Theory & Physics Analogy", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "Mathematical Theory & Physics Analogy" ], "label": "8" } }, { "raw_refs": [ { "value": "From the perspective of the theory of principal fiber bundles, our work can be understood as follows. A fiber bundle E is a space consisting of a base space B (the manifold M in our paper), with at each point p ∈ B a space Fp called the fiber at p. The bundle is defined in terms of a projection map", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "From the perspective of the theory of principal fiber bundles, our work can be understood as follows. A fiber bundle E is a space consisting of a base space B (the manifold M in our paper), with at each point p ∈ B a space Fp called the fiber at p. The bundle is defined in terms of a projection map" ] } }, { "raw_refs": [ { "value": "π : E → B, which determines the fibers as Fp = π−1", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "π : E → B, which determines the fibers as Fp = π-1" ] } }, { "raw_refs": [ { "value": "(p).", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "(p)" ] } }, { "raw_refs": [ { "value": "A principal bundle is a fiber bundle where the fiber F carries a transitive and free right action of a group G (the structure group).", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "A principal bundle is a fiber bundle where the fiber F carries a transitive and free right action of a group G (the structure group)" ] } }, { "raw_refs": [ { "value": "One can think of the fiber Fp of a principal bundle as a", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "One can think of the fiber Fp of a principal bundle as a" ] } }, { "raw_refs": [ { "value": "(generalized) space of frames at p. Due to the free and transitive action of G on Fp, we have that Fp is isomoprhic to G as a G-space, meaning that it looks like G except that it does not have a distinguished origin or identity element as G does (i.e. there is no natural choice of frame).", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "(generalized) space of frames at p. Due to the free and transitive action of", "we have that Fp is isomoprhic to G as a G-space, meaning that it looks like G except that it does not have a distinguished origin or identity element as G does (i.e. there is no natural choice of frame)" ], "authors": [ { "full_name": "Fp, G. on" } ] } }, { "raw_refs": [ { "value": "A gauge transformation is then defined as a principal bundle automorphism, i.e. a map from P → P that maps fibers to fibers in a G-equivariant manner. Sometimes the automorphism is required to fix the base space, i.e. project down to the identity map via π. Such a B-automorphism will map each fiber onto itself, so it restricts to a G-space automorphism on each fiber.", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "A gauge transformation is then defined as a principal bundle automorphism, i.e. a map from P → P that maps fibers to fibers in a G-equivariant manner. Sometimes the automorphism is required to fix the base space, i.e. project down to the identity map via π. Such a B-automorphism will map each fiber onto itself, so it restricts to a G-space automorphism on each fiber" ] } }, { "raw_refs": [ { "value": "Given a principal bundle P and a vector space V with representation ρ of G, we can construct the associated bundle", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "Given a principal bundle P and a vector space V with representation ρ of G, we can construct the associated bundle" ] } }, { "raw_refs": [ { "value": "P ×ρ V , whose elements are the equivalence classes of the following equivalence relation on P × V :", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "P ×ρ V, whose elements are the equivalence classes of the following equivalence relation on P × V :" ] } }, { "raw_refs": [ { "value": "(p, v) ∼ (pg, ρ(g−1", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "(p, v) ∼ (pg, ρ(g-1" ] } }, { "raw_refs": [ { "value": ")v). (8)", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "v). (8)" ] } }, { "raw_refs": [ { "value": "The associated bundle is a fiber bundle over the same base space as P, with fiber isomorphic to V .", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "The associated bundle is a fiber bundle over the same base space as P, with fiber isomorphic to V" ] } }, { "raw_refs": [ { "value": "A (matter) field is described as a section of the associated bundle A, i.e. a map σ : B → A that satisfies π ◦ σ = 1B.", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "A (matter) field is described as a section of the associated bundle A, i.e. a map σ : B → A that satisfies π ◦ σ = 1B" ] } }, { "raw_refs": [ { "value": "Locally, one can describe a section as a function B → V (as we do in the paper), but globally this is not possible unless the bundle is trivial.", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "Locally, one can describe a section as a function B → V (as we do in the paper), but globally this is not possible unless the bundle is trivial" ] } }, { "raw_refs": [ { "value": "The group of automorphisms of P (gauge transformations) acts on the space of fields (sections of the associated bundle).", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "The group of automorphisms of P (gauge transformations) acts on the space of fields (sections of the associated bundle)" ] } }, { "raw_refs": [ { "value": "It is this group that we wish to be equivariant to.", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "It is this group that we wish to be equivariant to" ] } }, { "raw_refs": [ { "value": "From this mathematical perspective, our work amounts to replacing the principal G bundle3", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "From this mathematical perspective, our work amounts to replacing the principal G bundle3" ] } }, { "raw_refs": [ { "value": "H → H/G used in the work on regular and steerable G-CNNs of Cohen et al. (2018a;c), by another principal G bundle, namely the frame bundle of M. Hence, this general theory can describe in a unified way the most prominent and geometrically natural methods of geometrical deep learning (Masci et al., 2015; Boscaini et al., 2016), as well as all G-CNNs on homogeneous spaces.", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "H → H/G used in the work on regular and steerable", "(a" ], "authors": [ { "full_name": "G-CNNs of Cohen" } ], "publication_info": { "year": 2018 } } }, { "raw_refs": [ { "value": "H → H/G used in the work on regular and steerable G-CNNs of Cohen et al. (2018a;c), by another principal G bundle, namely the frame bundle of M. Hence, this general theory can describe in a unified way the most prominent and geometrically natural methods of geometrical deep learning (Masci et al., 2015; Boscaini et al., 2016), as well as all G-CNNs on homogeneous spaces.", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "c), by another principal G bundle, namely the frame bundle of" ], "authors": [ { "full_name": "Hence, M." } ], "publication_info": { "year": 2015 } } }, { "raw_refs": [ { "value": "H → H/G used in the work on regular and steerable G-CNNs of Cohen et al. (2018a;c), by another principal G bundle, namely the frame bundle of M. Hence, this general theory can describe in a unified way the most prominent and geometrically natural methods of geometrical deep learning (Masci et al., 2015; Boscaini et al., 2016), as well as all G-CNNs on homogeneous spaces.", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "as well as all G-CNNs", "on homogeneous spaces" ], "authors": [ { "full_name": "Boscaini" } ], "publication_info": { "year": 2016 } } }, { "raw_refs": [ { "value": "Indeed, if we build a gauge equivariant CNN on a homogeneous space H/G (e.g. the sphere S2", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "Indeed, if we build a gauge equivariant CNN on a homogeneous space H/G (e.g. the sphere S2" ] } }, { "raw_refs": [ { "value": "= SO(3)/ SO(2)), it will (under mild conditions) automatically be equivariant to the left action of H also. To see this, note that the left action of H on itself (the total space of the principal G bundle) can be decomposed into an action on the base space H/G", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "= SO(3)/ SO(2)), it will (under mild conditions) automatically be equivariant to the left action of H also. To see this, note that the left action of H on itself (the total space of the principal G bundle) can be decomposed into an action on the base space H/G" ] } }, { "raw_refs": [ { "value": "(permuting the fibers), and an action on the fibers (cosets) that factors through G (see e.g. Sec. 2.1 of (Cohen et al., 2018c)). The action on the base space preserves the local neighbourhoods from which we compute filter responses, and equivariance to the action of G is ensured by the kernel constraint. Since G-CNNs (Cohen et al., 2018a) and gauge equivariant CNNs employ the most general equivariant map, we conclude that they are indeed the same, for bundles H → H/G. Thus, “gauge theory is all you need”.", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "(permuting the fibers), and an action on the fibers (cosets) that factors through G (see e.g. Sec. 2.1 of", "c)). The action on the base space preserves the local neighbourhoods from which we compute filter responses, and equivariance to the action of G is ensured by the kernel constraint. Since G-CNNs", "Cohen et al", "a) and gauge equivariant CNNs employ the most general equivariant map, we conclude that they are indeed the same, for bundles H → H/G. Thus" ], "title": { "title": "gauge theory is all you need" }, "authors": [ { "full_name": "Cohen" } ], "publication_info": { "year": 2018 } } }, { "raw_refs": [ { "value": "(We plan to expand this argument in a future paper)", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "(We plan to expand this argument in a future paper)" ] } }, { "raw_refs": [ { "value": "Most modern theories of physics are gauge theories, meaning they are based on this mathematical framework. In such theories, any construction is required to be gauge invariant", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "Most modern theories of physics are gauge theories, meaning they are based on this mathematical framework. In such theories, any construction is required to be gauge invariant" ] } }, { "raw_refs": [ { "value": "(i.e. the coefficients must be gauge equivariant), for otherwise the predictions will depend on the way in which we choose to represent physical quantities. This logic applies not just to physics theories, but, as we have argued in the paper, also to neural networks and other models used in machine learning. Hence, it is only natural that the same mathematical framework is applicable in both fields.", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "(i.e. the coefficients must be gauge equivariant), for otherwise the predictions will depend on the way in which we choose to represent physical quantities. This logic applies not just to physics theories, but, as we have argued in the paper, also to neural networks and other models used in machine learning. Hence, it is only natural that the same mathematical framework is applicable in both fields" ] } }, { "raw_refs": [ { "value": "9. Deriving the kernel constraint", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "Deriving the kernel constraint" ], "label": "9" } }, { "raw_refs": [ { "value": "The gauge equivariant convolution is given by", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "The gauge equivariant convolution is given by" ] } }, { "raw_refs": [ { "value": "(K ? f)(p) =", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "(K ? f)(p) =" ] } }, { "raw_refs": [ { "value": "Z", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "Z" ] } }, { "raw_refs": [ { "value": "Rd", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "Rd" ] } }, { "raw_refs": [ { "value": "K(v)ρin(gp←qv )f(qv)dv. (9)", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "K(v)ρin(gp←qv )f(qv)dv. (9)" ] } }, { "raw_refs": [ { "value": "Under a gauge transformation, we have: v 7→ g−1 p v, f(qv) 7→ ρin(g−1 qv", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "Under a gauge transformation, we have: v 7→ g-1 p v, f(qv) 7→ ρin(g-1 qv" ] } }, { "raw_refs": [ { "value": ")f(qv), wp 7→ wpgp, gp←qv 7→ g−1 p gp←qv gqv .", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "f(qv), wp 7→ wpgp, gp←qv 7→ g-1 p gp←qv gqv" ] } }, { "raw_refs": [ { "value": "(10)", "schema": "text", "source": "submitter" } ], "reference": { "label": "10" } }, { "raw_refs": [ { "value": "3", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "3" ] } }, { "raw_refs": [ { "value": "It is more common to use the letter G for the supergroup and H for the subgroup, but that leads to a principal H-bundle", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "It is more common to use the letter G for the supergroup and H for the subgroup, but that leads to a principal H-bundle" ] } }, { "raw_refs": [ { "value": "G → G/H, which is inconsistent with the main text, where we use a principal G bundle. So we swap H and G here.", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "G → G/H, which is inconsistent with the main text, where we use a principal G bundle. So we swap H and G here" ] } }, { "raw_refs": [ { "value": "It follows that qv is unchanged, because qv = expp wpv 7→ expp(wpgp)(g−1 p v) = qv. Substituting the rest in the convolution equation, we find", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "It follows that qv is unchanged, because qv = expp wpv 7→ expp(wpgp)(g-1 p v) = qv. Substituting the rest in the convolution equation, we find" ] } }, { "raw_refs": [ { "value": "K(g−1 p v)ρin(g−1 p gp←qv gqv", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "K(g-1 p v)ρin(g-1 p gp←qv gqv" ] } }, { "raw_refs": [ { "value": ")ρin(g−1 qv", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "ρin(g-1 qv" ] } }, { "raw_refs": [ { "value": ")f(qv)dv", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "f(qv)dv" ] } }, { "raw_refs": [ { "value": "=", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "=" ] } }, { "raw_refs": [ { "value": "K(g−1 p v)ρin(g−1 p )ρin(gp←qv", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "K(g-1 p v)ρin(g-1 p )ρin(gp←qv" ] } }, { "raw_refs": [ { "value": "(11)", "schema": "text", "source": "submitter" } ], "reference": { "label": "11" } }, { "raw_refs": [ { "value": "Now if K(g−1 p v) = ρout(g−1 p )K(v)ρin(gp) (i.e. K satisfies the kernel constraint), then we get", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "Now if K(g-1 p v) = ρout(g-1 p )K(v)ρin(gp) (i.e. K satisfies the kernel constraint), then we get" ] } }, { "raw_refs": [ { "value": "(K ? f)(p) 7→ ρout(g−1 p )(K ? f)(p), (12) i.e. K ? f transforms as a ρout-field under gauge transformations.", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "(K ? f)(p) 7→ ρout(g-1 p )(K ? f)(p), (12) i.e. K ? f transforms as a ρout-field under gauge transformations" ] } }, { "raw_refs": [ { "value": "10. Additional information on experiments", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "Additional information on experiments" ], "label": "10" } }, { "raw_refs": [ { "value": "10.1. MNIST experiments", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "10.1. MNIST experiments" ] } }, { "raw_refs": [ { "value": "Our main model consists of 7 convolution layers and 3 linear layers. The first layer is a scalar-to-regular gauge equivariant convolution layer, and the following 6 layers are regularto-regular layers. These layers have 8, 16, 16, 24, 24, 32, 64 output channels, and stride 1, 2, 1, 2, 1, 2, 1, respectively.", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "Our main model consists of 7 convolution layers and 3 linear layers. The first layer is a scalar-to-regular gauge equivariant convolution layer, and the following 6 layers are regularto-regular layers. These layers have 8, 16, 16, 24, 24, 32, 64 output channels, and stride 1, 2, 1, 2, 1, 2, 1, respectively" ] } }, { "raw_refs": [ { "value": "In between convolution layers, we use batch normalization", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "In between convolution layers, we use batch normalization" ] } }, { "raw_refs": [ { "value": "(Ioffe & Szegedy, 2015) and ReLU nonlinearities. When using batch normalization, we average over groups of 6 feature maps, to make sure the operation is equivariant. Any pointwise nonlinearity (like ReLU) is equivariant, because we use only trivial and regular representations realized by permutation matrices.", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "(Ioffe & Szegedy,) and ReLU nonlinearities. When using batch normalization, we average over groups of 6 feature maps, to make sure the operation is equivariant. Any pointwise nonlinearity (like ReLU) is equivariant, because we use only trivial and regular representations realized by permutation matrices" ], "publication_info": { "year": 2015 } } }, { "raw_refs": [ { "value": "After the convolution layers, we perform global pooling over spatial and orientation channels, yielding an invariant representation. We map these through 3 FC layers (with", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "After the convolution layers, we perform global pooling over spatial and orientation channels, yielding an invariant representation. We map these through 3 FC layers (with" ] } }, { "raw_refs": [ { "value": "64, 32, 10 channels) before applying softmax.", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "64, 32, 10 channels) before applying softmax" ] } }, { "raw_refs": [ { "value": "The other models are obtained from this one by replacing the convolution layers by scalar-to-regular + orientation pooling (S2R) or scalar-to-scalar (S2S) layers, or by disabling G-padding (NP) and/or kernel expansion (NE), always adjusting the number of channels to keep the number of parameters roughly the same.", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "The other models are obtained from this one by replacing the convolution layers by scalar-to-regular + orientation pooling (S2R) or scalar-to-scalar (S2S) layers, or by disabling G-padding (NP) and/or kernel expansion (NE), always adjusting the number of channels to keep the number of parameters roughly the same" ] } }, { "raw_refs": [ { "value": "The Spherical CNN (S2CNN) is obtained from the R2R model by replacing the S2R and R2R layers by spherical and", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "The Spherical CNN (S2CNN) is obtained from the R2R model by replacing the S2R and R2R layers by spherical and" ] } }, { "raw_refs": [ { "value": "SO(3) convolution layers, respectively, keeping the number of channels and strides the same. The Spherical CNN uses a different grid than the Icosahedral CNN, so we adapt the resolution / bandwidth parameter B to roughly match the resolution of the Icosahedral CNN. We use B = 26, to get a spherical grid of size 2B × 2B = 52 × 52. Note that this grid has higher resolution at the poles, and lower resolution near the equator, which explains why the S2CNN performs a bit worse when trained on rotated data instead of digits projected onto the north-pole. To implement strides, we reduce the output bandwidth by 2 at each layer with stride.", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "SO(3) convolution layers, respectively, keeping the number of channels and strides the same. The Spherical CNN uses a different grid than the Icosahedral CNN, so we adapt the resolution / bandwidth parameter B to roughly match the resolution of the Icosahedral CNN. We use B = 26, to get a spherical grid of size 2B × 2B = 52 × 52. Note that this grid has higher resolution at the poles, and lower resolution near the equator, which explains why the S2CNN performs a bit worse when trained on rotated data instead of digits projected onto the north-pole. To implement strides, we reduce the output bandwidth by 2 at each layer with stride" ] } }, { "raw_refs": [ { "value": "The spherical convolution takes a scalar signal on the sphere as input, and outputs scalar signals on SO(3), which is analogous to a regular field over the sphere. SO(3) convolutions are analogous to R2R layers. We note that this is a stronger Spherical CNN architecture than the one used by", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "The spherical convolution takes a scalar signal on the sphere as input, and outputs scalar signals on SO(3), which is analogous to a regular field over the sphere. SO(3) convolutions are analogous to R2R layers. We note that this is a stronger Spherical CNN architecture than the one used by" ] } }, { "raw_refs": [ { "value": "(Cohen et al., 2018b), which achieves only 96% accuracy on spherical MNIST.", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "b), which achieves only 96% accuracy on spherical MNIST" ], "authors": [ { "full_name": "Cohen" } ], "publication_info": { "year": 2018 } } }, { "raw_refs": [ { "value": "The models were trained for 60 epochs, or 1 epoch of the", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "The models were trained for 60 epochs, or 1 epoch of the" ] } }, { "raw_refs": [ { "value": "60× augmented dataset (where each instance is transformed by each icosahedron symmetry g ∈ I, or by a random rotation g ∈ SO(3)).", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "60× augmented dataset (where each instance is transformed by each icosahedron symmetry g ∈ I, or by a random rotation g ∈ SO(3))" ] } }, { "raw_refs": [ { "value": "10.2. Climate experiments", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "10.2. Climate experiments" ] } }, { "raw_refs": [ { "value": "For the climate experiments, we used a U-net with regularto-regular convolutions. The first layer is a scalar-to-regular convolution with 16 output channels. The downsampling path consists of 5 regular-to-regular layers with stride 2, and", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "For the climate experiments, we used a U-net with regularto-regular convolutions. The first layer is a scalar-to-regular convolution with 16 output channels. The downsampling path consists of 5 regular-to-regular layers with stride 2, and" ] } }, { "raw_refs": [ { "value": "32, 64, 128, 256, 256 output channels. The downsampling path takes as input a signal with resolution r = 5 (i.e. 10242 pixels), and outputs one at r = 0 (i.e. 12 pixels).", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "32, 64, 128, 256, 256 output channels. The downsampling path takes as input a signal with resolution r = 5 (i.e. 10242 pixels), and outputs one at r = 0 (i.e. 12 pixels)" ] } }, { "raw_refs": [ { "value": "The decoder is the reverse of the encoder in terms of resolution and number of channels. Upsampling is performed by bilinear interpolation (which is exactly equivariant), before each convolution layer (which uses stride 1). As usual in the U-net architecture, each layer in the upsampling path takes as input the output of the previous layer, as well as the output of the encoder path at the same resolution.", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "The decoder is the reverse of the encoder in terms of resolution and number of channels. Upsampling is performed by bilinear interpolation (which is exactly equivariant), before each convolution layer (which uses stride 1). As usual in the U-net architecture, each layer in the upsampling path takes as input the output of the previous layer, as well as the output of the encoder path at the same resolution" ] } }, { "raw_refs": [ { "value": "Each convolution layer is followed by equivariant batchnorm and ReLU.", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "Each convolution layer is followed by equivariant batchnorm and ReLU" ] } }, { "raw_refs": [ { "value": "The model was trained for 15 epochs with batchsize 15.", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "The model was trained for 15 epochs with batchsize 15" ] } }, { "raw_refs": [ { "value": "10.3. 2D-3D-S experiments", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "10.3. 2D-3D-S experiments" ] } }, { "raw_refs": [ { "value": "For the 2D-3D-S experiments, we used a residual U-Net with the following architecture.", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "For the 2D-3D-S experiments, we used a residual", "with the following architecture" ], "authors": [ { "full_name": "U-Net" } ] } }, { "raw_refs": [ { "value": "The input layer is a scalar-to-regular layer with 8 channels, followed by batchnorm and relu. Then we apply 4 residual blocks with 16, 32, 64, 64 output channels, each of which uses stride=2. In the upsampling stream, we use 32, 16, 8, 8 channels, for the residual blocks, respectively. Each upsampling layer receives input from the corresponding downsampling layer, as well as the previous layer. Upsampling is performed using bilinear interpolation, and downsampling by hexagonal max pooling.", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "The input layer is a scalar-to-regular layer with 8 channels, followed by batchnorm and relu. Then we apply 4 residual blocks with 16, 32, 64, 64 output channels, each of which uses stride=2. In the upsampling stream, we use 32, 16, 8, 8 channels, for the residual blocks, respectively. Each upsampling layer receives input from the corresponding downsampling layer, as well as the previous layer. Upsampling is performed using bilinear interpolation, and downsampling by hexagonal max pooling" ] } }, { "raw_refs": [ { "value": "The input resolution is r = 5, which is downsampled to r = 1 by the downsampling stream.", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "The input resolution is r = 5, which is downsampled to r = 1 by the downsampling stream" ] } }, { "raw_refs": [ { "value": "Each residual block consists of a convolution, batchnorm, skipconnection, and ReLU.", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "Each residual block consists of a convolution, batchnorm, skipconnection, and ReLU" ] } }, { "raw_refs": [ { "value": "11. Computational complexity analysis of", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "Computational complexity analysis of" ], "label": "11" } }, { "raw_refs": [ { "value": "Spherical and Icosahedral CNNs", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "Spherical and Icosahedral CNNs" ] } }, { "raw_refs": [ { "value": "One of the primary motivations for the development of the", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "One of the primary motivations for the development of the" ] } }, { "raw_refs": [ { "value": "Icosahedral CNN is that it is faster and more scalable than", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "Icosahedral CNN is that it is faster and more scalable than" ] } }, { "raw_refs": [ { "value": "Spherical CNNs as originally proposed. The Spherical CNN as implemented by (Cohen et al., 2018b) uses feature maps on the sphere S2 and rotation group SO(3) (the latter of which can be thought of a regular field on the sphere), sampled on the SOFT grids defined by (Kostelec & Rockmore, 2007), which have shape 2B × 2B and 2B × 2B × 2B, respectively (here B is the bandwidth / resolution parameter).", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "Spherical CNNs as originally proposed. The Spherical CNN as implemented by", "b) uses feature maps on the sphere S2 and rotation group SO(3) (the latter of which can be thought of a regular field on the sphere), sampled on the SOFT grids defined by (Kostelec & Rockmore, 2007), which have shape 2B × 2B and 2B × 2B × 2B, respectively (here B is the bandwidth / resolution parameter)" ], "authors": [ { "full_name": "Cohen" } ], "publication_info": { "year": 2018 } } }, { "raw_refs": [ { "value": "Specifically, the grid points are:", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "Specifically, the grid points are:" ] } }, { "raw_refs": [ { "value": "αj1", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "αj1" ] } }, { "raw_refs": [ { "value": "2πj1", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "2πj1" ] } }, { "raw_refs": [ { "value": "2B", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "2B" ] } }, { "raw_refs": [ { "value": ", βk =", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "βk =" ] } }, { "raw_refs": [ { "value": "π(2k + 1)", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "π(2k + 1)" ] } }, { "raw_refs": [ { "value": "4B", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "4B" ] } }, { "raw_refs": [ { "value": ", γj2", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "γj2" ] } }, { "raw_refs": [ { "value": "2πj2", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "2πj2" ] } }, { "raw_refs": [ { "value": ", (13) where (αj1", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "(13) where (αj1" ] } }, { "raw_refs": [ { "value": ", βk) form a spherical grid and (αj1", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "βk) form a spherical grid and (αj1" ] } }, { "raw_refs": [ { "value": ", βk, γj2", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "βk, γj2" ] } }, { "raw_refs": [ { "value": ") form an SO(3) grid (for j1, k, j2 = 0, . . . 2B − 1). These grids have two downsides.", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "form an SO(3) grid (for j1, k, j2 = 0,... 2B - 1). These grids have two downsides" ] } }, { "raw_refs": [ { "value": "Firstly, because the SOFT grid consists of equal-lattitude rings with a fixed number of points (2B), the spatial density of points is inhomogeneous, with a higher concentration of points near the poles. To get a sufficiently high sampling near the equator, we are forced to oversample the poles, and thus waste computational resources. For almost all applications, a more homogeneous grid is more suitable.", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "Firstly, because the SOFT grid consists of equal-lattitude rings with a fixed number of points (2B), the spatial density of points is inhomogeneous, with a higher concentration of points near the poles. To get a sufficiently high sampling near the equator, we are forced to oversample the poles, and thus waste computational resources. For almost all applications, a more homogeneous grid is more suitable" ] } }, { "raw_refs": [ { "value": "The second downside of the SOFT grid on SO(3) is that the spatial resolution (2B × 2B; α, β) and angular resolution", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "The second downside of the SOFT grid on SO(3) is that the spatial resolution (2B × 2B" ] } }, { "raw_refs": [ { "value": "The second downside of the SOFT grid on SO(3) is that the spatial resolution (2B × 2B; α, β) and angular resolution", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "α, β) and angular resolution" ] } }, { "raw_refs": [ { "value": "(2B; γ) are both coupled to the same resolution / bandwidth parameter B. Thus, as we increase the resolution of the spherical image, the number of rotations applied to each filter is increased as well, which is undesirable.", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "(2B" ] } }, { "raw_refs": [ { "value": "(2B; γ) are both coupled to the same resolution / bandwidth parameter B. Thus, as we increase the resolution of the spherical image, the number of rotations applied to each filter is increased as well, which is undesirable.", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "γ) are both coupled to the same resolution / bandwidth parameter", "as we increase the resolution of the spherical image, the number of rotations applied to each filter is increased as well, which is undesirable" ], "authors": [ { "full_name": "Thus, B." } ] } }, { "raw_refs": [ { "value": "The grid used in the Icosahedral CNN addresses both concerns. It is spatially very homogeneous, and we apply the filters in 6 orientations, regardless of spatial resolution.", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "The grid used in the Icosahedral CNN addresses both concerns. It is spatially very homogeneous, and we apply the filters in 6 orientations, regardless of spatial resolution" ] } }, { "raw_refs": [ { "value": "The generalized FFT algorithm used by (Cohen et al., 2018a) only works on the SOFT grid. Generalized FFTs for other grids exist (Kunis & Potts, 2003), but are harder to implement. Moreover, although the (generalized) FFT can improve the asymptotic complexity of convolution for large input signals, the FFT-based convolution actually has worse complexity if we assume a fixed filter size. That is, the", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "The generalized FFT algorithm used by", "a) only works on the SOFT grid. Generalized FFTs for other grids exist (Kunis & Potts, 2003), but are harder to implement. Moreover, although the (generalized) FFT can improve the asymptotic complexity of convolution for large input signals, the FFT-based convolution actually has worse complexity if we assume a fixed filter size. That is, the" ], "authors": [ { "full_name": "Cohen" } ], "publication_info": { "year": 2018 } } }, { "raw_refs": [ { "value": "SO(3) convolution (used in most layers of a typical Spherical CNN) has complexity O(B3 log B) which compares favorably to the naive O(B6", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "SO(3) convolution (used in most layers of a typical Spherical CNN) has complexity O(B3 log B) which compares favorably to the naive O(B6" ] } }, { "raw_refs": [ { "value": ") spatial implementation. However, if we use filters with a fixed (and usually small) size, the complexity of a naive spatial implementation reduces to O(B3", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "spatial implementation. However, if we use filters with a fixed (and usually small) size, the complexity of a naive spatial implementation reduces to O(B3" ] } }, { "raw_refs": [ { "value": "), which is slightly better than the FFT-based implementation. Furthermore, because the Icosahedral CNN uses a fixed number of orientations per filter (i.e. 6), its computational complexity is even better: it is linear in the number of pixels of the grid, and so comparable to O(B2", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "which is slightly better than the FFT-based implementation. Furthermore, because the Icosahedral CNN uses a fixed number of orientations per filter (i.e. 6), its computational complexity is even better: it is linear in the number of pixels of the grid, and so comparable to O(B2" ] } }, { "raw_refs": [ { "value": ") for the SOFT grid.", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "for the SOFT grid" ] } }, { "raw_refs": [ { "value": "The difference in complexity is clearly visible in Figures 7 and 8, below. On the horizonal axis, we show the grid resolution r for the icosahedral grid Hr (for the spherical CNN, we a SOFT grid with roughly the same number of spatial points).", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "The difference in complexity is clearly visible in Figures 7 and 8, below. On the horizonal axis, we show the grid resolution r for the icosahedral grid Hr (for the spherical CNN, we a SOFT grid with roughly the same number of spatial points)" ] } }, { "raw_refs": [ { "value": "On the vertical axis, we show the amount of wallclock time", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "On the vertical axis, we show the amount of wallclock time" ] } }, { "raw_refs": [ { "value": "(averaged over 100 runs) and memory required to run an", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "(averaged over 100 runs) and memory required to run an" ] } }, { "raw_refs": [ { "value": "SO(3) convolution (S2CNN) or a regular-to-regular gauge equivariant convolution (IcoNet) at that resolution. Note that since the number of grid pionts is exponential in r, and we use a logarithmic vertical axis, the figures can be considered log-log plots. Both plots were generated by running a single regular to regular convolution layer at the corresponding resolution r with 12 input and output channels. For a fair comparison with IcoCNNs we chose filter grid parameters so3 near identity grid(n alpha=6, max beta=np.pi/16, n beta=1, max gamma=2*np.pi, n gamma=6) for the spherical convolution layer. To guarantee a full GPU utilization, results were measured on an as large as possible batch size per datapoint and subsequently normalized by that batch size.", "schema": "text", "source": "submitter" } ], "reference": { "misc": [ "SO(3) convolution (S2CNN) or a regular-to-regular gauge equivariant convolution (IcoNet) at that resolution. Note that since the number of grid pionts is exponential in r, and we use a logarithmic vertical axis, the figures can be considered log-log plots. Both plots were generated by running a single regular to regular convolution layer at the corresponding resolution r with 12 input and output channels. For a fair comparison with IcoCNNs we chose filter grid parameters so3 near identity grid(n alpha=6, max beta=np.pi/16, n beta=1, max gamma=2*np.pi, n gamma=6) for the spherical convolution layer. To guarantee a full GPU utilization, results were measured on an as large as possible batch size per datapoint and subsequently normalized by that batch size" ] } } ], "arxiv_eprints": [ { "value": "1902.04615", "categories": [ "cs.LG", "cs.CV", "cs.NE", "stat.ML" ] } ], "document_type": [ "conference paper" ], "preprint_date": "2019-02-11", "control_number": 2729540, "inspire_categories": [ { "term": "Computing" }, { "term": "Data Analysis and Statistics" } ] } }