FORGET LOCAL GEOMETRY. “The description of the neural network in terms of Fourier components of a local field, allows to give a geometric interpretation to something intrinsically non‐local. Indeed, neurons interact non‐locally: Everybody talks to each other according to the rules determined by the synaptic connections, with no real sense of local geometry.”
https://onlinelibrary.wiley.com/doi/full/10.1002/prop.201800007?casa_token=GdPRXs_tGLEAAAAA%3Ag-pxPMtkcleTYDUNK3mYGfpEzKRyc2LqQknTgFFB7dkYFDL8rDe2s0f4_0Q0oKjXD4_AEgFPGWolVTQ