Mokey: enabling narrow fixed-point inference for out-of-the-box floating-point transformer models [PDF]
International Symposium on Computer Architecture, 2022 Increasingly larger and better Transformer models keep advancing state-of-the-art accuracy and capability for Natural Language Processing applications. These models demand more computational power, storage, and energy.
Ali Hadi Zadeh +3 more
semanticscholar +1 more source
Are We There Yet? Timing and Floating-Point Attacks on Differential Privacy Systems [PDF]
IEEE Symposium on Security and Privacy, 2021 Differential privacy is a de facto privacy framework that has seen adoption in practice via a number of mature software platforms. Implementation of differentially private (DP) mechanisms has to be done carefully to ensure end-to-end security guarantees.
Jiankai Jin +3 more
semanticscholar +1 more source
Acta Numerica, 2023 Floating-point numbers have an intuitive meaning when it comes to physics-based numerical computations, and they have thus become the most common way of approximating real numbers in computers.
S. Boldo +3 more
semanticscholar +1 more source
High-Performance Computing in Meteorology under a Context of an Era of Graphical Processing Units
Computers, 2022 This short review shows how innovative processing units—including graphical processing units (GPUs)—are used in high-performance computing (HPC) in meteorology, introduces current scientific studies relevant to HPC, and discusses the latest topics in ...
Tosiyuki Nakaegawa
doaj +1 more source
Detecting Floating-Point Expression Errors Based Improved PSO Algorithm
IET Software, 2023 The use of floating-point numbers inevitably leads to inaccurate results and, in certain cases, significant program failures. Detecting floating-point errors is critical to ensuring that floating-point programs outputs are proper.
Hongru Yang +4 more
doaj +1 more source
ALP: Adaptive Lossless floating-Point Compression
Proc. ACM Manag. Data, 2023 IEEE 754 doubles do not exactly represent most real values, introducing rounding errors in computations and [de]serialization to text. These rounding errors inhibit the use of existing lightweight compression schemes such as Delta and Frame Of Reference (
Azim Afroozeh, Leonardo Kuffò, P. Boncz
semanticscholar +1 more source
Floating Point Optimization Using VHDL [PDF]
Engineering and Technology Journal, 2009 Due to inherent limitations of the fixed-point representation, it is sometimes desirable to perform arithmetic operations in the floating-point format.
Manal Hammadi Jassim
doaj +1 more source
FPnew: An Open-Source Multiformat Floating-Point Unit Architecture for Energy-Proportional Transprecision Computing [PDF]
IEEE Transactions on Very Large Scale Integration (VLSI) Systems, 2020 The slowdown of Moore’s law and the power wall necessitates a shift toward finely tunable precision (a.k.a. transprecision) computing to reduce energy footprint.
Stefan Mach +3 more
semanticscholar +1 more source
Snitch: A Tiny Pseudo Dual-Issue Processor for Area and Energy Efficient Execution of Floating-Point Intensive Workloads [PDF]
IEEE transactions on computers, 2020 Data-parallel applications, such as data analytics, machine learning, and scientific computing, are placing an ever-growing demand on floating-point operations per second on emerging systems.
Florian Zaruba +3 more
semanticscholar +1 more source
Hadamard product-based in-memory computing design for floating point neural network training
Neuromorphic Computing and Engineering, 2023 Deep neural networks (DNNs) are one of the key fields of machine learning. It requires considerable computational resources for cognitive tasks. As a novel technology to perform computing inside/near memory units, in-memory computing (IMC) significantly ...
Anjunyi Fan +9 more
doaj +1 more source