Results 11 to 20 of about 17,553 (306)
On Isotropy Calibration of Transformer Models [PDF]
Proceedings of the Third Workshop on Insights from Negative Results in NLP, 2022 Different studies of the embedding space of transformer models suggest that the distribution of contextual representations is highly anisotropic - the embeddings are distributed in a narrow cone. Meanwhile, static word representations (e.g., Word2Vec or GloVe) have been shown to benefit from isotropic spaces.
Ding, Yue +4 more
openaire +3 more sources
Isotropy, Clusters, and Classifiers [PDF]
Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers)Whether embedding spaces use all their dimensions equally, i.e., whether they are isotropic, has been a recent subject of discussion. Evidence has been accrued both for and against enforcing isotropy in embedding spaces. In the present paper, we stress that isotropy imposes requirements on the embedding space that are not compatible with the presence ...
Timothee Mickus +2 more
core +7 more sources
spTest: An R Package Implementing Nonparametric Tests of Isotropy [PDF]
Journal of Statistical Software, 2018 An important step in modeling spatially-referenced data is appropriately specifying the second order properties of the random field. A scientist developing a model for spatial data has a number of options regarding the nature of the dependence between ...
Zachary D. Weller
doaj +2 more sources
On Isotropy Calibration of Transformers
CoRR, 2021 Different studies of the embedding space of transformer models suggest that the distribution of contextual representations is highly anisotropic - the embeddings are distributed in a narrow cone. Meanwhile, static word representations (e.g., Word2Vec or GloVe) have been shown to benefit from isotropic spaces.
Ding, Yue +4 more
openaire +4 more sources
The scale of cosmic isotropy [PDF]
Journal of Cosmology and Astroparticle Physics, 2012 The most fundamental premise to the standard model of the universe, the Cosmological Principle (CP), states that the large-scale properties of the universe are the same in all directions and at all comoving positions. Demonstrating this theoretical hypothesis has proven to be a formidable challenge.
Marinoni, Christian, Bel, J, Buzzi, A
openaire +3 more sources
Journal of Microwaves, Optoelectronics and Electromagnetic Applications, 2021 Electric field module for any isotropic multilayer thin film structure, is presented as analytical deduction. Analytic expressions for the electric field distribution are developed initially for a monolayer isotropic system based on Airy's formulae and ...
B. Garibello, Y. Martín
doaj +1 more source
The isotropy of compact universes [PDF]
Classical and Quantum Gravity, 2001 22 pages in LaTeX2e with the amsmath ...
Barrow, John D., Kodama, Hideo
openaire +3 more sources
Kinematic Analysis of a Parallel Manipulator Driven by Perpendicular Linear Actuators
Actuators, 2021 In this paper, a goniometer-type specimen stage with a linear actuation mechanism mounted on a rotation mechanism is introduced. The linear actuation mechanism was modeled as a spatial parallel manipulator consisting of a moving body, three linear ...
Kee-Bong Choi +4 more
doaj +1 more source
Dynamic stability of heated geometrically irregular cylindrical shell in supersonic gas flow
Vestnik Samarskogo Gosudarstvennogo Tehničeskogo Universiteta. Seriâ: Fiziko-Matematičeskie Nauki, 2018 On the basis of the Love model, a geometrically irregular heated cylindrical shell blown by a supersonic gas flow from one of its main surfaces is considered.
Grigory N Belostochnyi, Olga A Myltcina
doaj +1 more source
Wave Propagation in Periodic Metallic Structures with Equilateral Triangular Holes
Applied Sciences, 2020 This paper studies wave propagation in a periodic parallel-plate waveguide with equilateral triangular holes. A mode-matching method is implemented to analyze the dispersion diagram of the structure possessing glide and mirror symmetries. Both structures
Antonio Alex-Amor +6 more
doaj +1 more source