Results 1 to 10 of about 24,192 (166)
Qsparse-Local-SGD: Distributed SGD With Quantization, Sparsification, and Local Computations [PDF]
IEEE Journal on Selected Areas in Information Theory, 2020 Communication bottleneck has been identified as a significant issue in distributed optimization of large-scale learning models. Recently, several approaches to mitigate this problem have been proposed, including different forms of gradient compression or computing local models and mixing them iteratively.
Can Karakus, Debraj Basu
exaly +4 more sources
SQuARM-SGD: Communication-Efficient Momentum SGD for Decentralized Optimization [PDF]
2021 IEEE International Symposium on Information Theory (ISIT), 2021 In this paper, we propose and analyze SQuARM-SGD, a communication-efficient algorithm for decentralized training of large-scale machine learning models over a network. In SQuARM-SGD, each node performs a fixed number of local SGD steps using Nesterov's momentum and then sends sparsified and quantized updates to its neighbors regulated by a locally ...
Navjot Singh +3 more
openaire +5 more sources
Mosque Management as Islamic Religious Education Laboratory (Research Study at SMPN 17 Bandung)
Fitrah: Jurnal Kajian Ilmu-Ilmu Keislaman, 2021 The function and role of the mosque which was carried out by the Prophet Muhammad when he first founded the mosque, that is, apart from being a place of worship, it is also a place of education. Based on the researcher's observations from the preliminary
Andedes Prameswari +2 more
doaj +1 more source
Matrix Factorization Based Recommendation System using Hybrid Optimization Technique [PDF]
EAI Endorsed Transactions on Energy Web, 2021 In this paper, a matrix factorization recommendation algorithm is used to recommend items to the user by inculcating a hybrid optimization technique that combines Alternating Least Squares (ALS) and Stochastic Gradient Descent (SGD) in
P. Rao +3 more
doaj +1 more source
Fitting ReLUs via SGD and Quantized SGD [PDF]
2019 IEEE International Symposium on Information Theory (ISIT), 2019 In this paper we focus on the problem of finding the optimal weights of the shallowest of neural networks consisting of a single Rectified Linear Unit (ReLU). These functions are of the form $\mathbf{x}\rightarrow \max(0,\langle\mathbf{w},\mathbf{x}\rangle)$ with $\mathbf{w}\in\mathbb{R}^d$ denoting the weight vector.
Seyed Mohammadreza Mousavi Kalan +2 more
openaire +3 more sources
Self Disclosure Santri Remaja di Media Sosial: Peran Self Identity Status dan Affiliation Motive
Psympathic: Jurnal Ilmiah Psikologi, 2021 One of the most important developmental tasks for adolescents is to find self-identity. Some of the teenagers take education in Islamic boarding schools so that they have a special predicate as Islamic students or santri. For this reason, it is important
Fenti Hikmawati +2 more
doaj +1 more source
Hanifiya, 2020 This study discusses religious explanations as a form of communication behavior among public relations officers at Pakuwon General Hospital, Sumedang. Here discussed how the adaptation of a hospital to the times, including an outbreak of a disease, such ...
Asep Muhyidin +3 more
doaj +1 more source
DQ-SGD: Dynamic Quantization in SGD for Communication-Efficient Distributed Learning [PDF]
2021 IEEE 18th International Conference on Mobile Ad Hoc and Smart Systems (MASS), 2021 10 pages, 7 ...
Guangfeng Yan +3 more
openaire +3 more sources
Konstruksi Alat Ukur Kepemimpinan Spiritual dalam Keluarga
JPIB: Jurnal Psikologi Islam dan Budaya, 2020 This study aims to examine spiritual leadership in the context of the head of the family. The spiritual leadership concept is lifted from Fry (2003) which is defined as a matter that consists of values, attitudes, and behaviors needed to intrinsically ...
Hasna Esa Nisrina +4 more
doaj +1 more source
The Bingah Scale: A Development of the Happiness Measurement Scale in the Sundanese
JPIB: Jurnal Psikologi Islam dan Budaya, 2020 This study was conducted to create an instrument that measures the conditions of happiness felt by the Sundanese in Indonesia. This scale is named the Bingah Scale.
Tasya Augustiya +4 more
doaj +1 more source