Online Clustered Codebook [PDF]
Vector Quantisation (VQ) is experiencing a comeback in machine learning, where it is increasingly used in representation learning. However, optimizing the codevectors in existing VQ-VAE is not entirely trivial. A problem is codebook collapse, where only a small subset of codevectors receive gradients useful for their optimisation, whereas a majority of
Zheng, C, Vedaldi, A
openaire +3 more sources
Codebook / Data Dictionary TCoA
This codebook/data dictionary provides users of the Teacher Conceptions of Assessment Inventory details of the structure of the data files used to analyse the New Zealand data. This codebook needs to be read in conjunction with the following complementary files: 1. The Teacher Conceptions of Assessment Questionnaire or Inventory a. Long with 50 items b.
Brown Gavin
openaire +2 more sources
Towards Robust Blind Face Restoration with Codebook Lookup Transformer [PDF]
Blind face restoration is a highly ill-posed problem that often requires auxiliary guidance to 1) improve the mapping from degraded inputs to desired outputs, or 2) complement high-quality details lost in the inputs.
Shangchen Zhou +3 more
semanticscholar +1 more source
Supporting Qualitative Analysis with Large Language Models: Combining Codebook with GPT-3 for Deductive Coding [PDF]
Qualitative analysis of textual contents unpacks rich and valuable information by assigning labels to the data. However, this process is often labor-intensive, particularly when working with large datasets. While recent AI-based tools demonstrate utility,
Ziang Xiao +4 more
semanticscholar +1 more source
RIDCP: Revitalizing Real Image Dehazing via High-Quality Codebook Priors [PDF]
Existing dehazing approaches struggle to process real-world hazy images owing to the lack of paired real data and robust priors. In this work, we present a new paradigm for real image dehazing from the perspectives of synthesizing more realistic hazy ...
Ruixia Wu +4 more
semanticscholar +1 more source
Robust Semantic Communications With Masked VQ-VAE Enabled Codebook [PDF]
Although semantic communications have exhibited satisfactory performance on a large number of tasks, the impact of semantic noise and the robustness of the systems have not been well investigated.
Qiyu Hu +5 more
semanticscholar +1 more source
Codebook-Based Solutions for Reconfigurable Intelligent Surfaces and Their Open Challenges [PDF]
Reconfigurable intelligent surfaces (RIS) is a revolutionary technology to cost-effectively improve the performance of wireless networks. We first review the existing framework of channel estimation and passive beamforming (CE & PBF) in RIS-assisted ...
Jiancheng An +6 more
semanticscholar +1 more source
Near-Field Beam Training: Joint Angle and Range Estimation With DFT Codebook [PDF]
Prior works on near-field beam training have mostly assumed dedicated polar-domain codebook and on-grid range estimation, which, however, may suffer long training overhead, high codebook storage requirement, and degraded estimation accuracy.
Xun Wu +3 more
semanticscholar +1 more source
Environment-Aware Codebook for Reconfigurable Intelligent Surface-Aided MISO Communications [PDF]
Reconfigurable intelligent surface (RIS) is a revolutionary technology that can customize the wireless channel and improve the energy efficiency of next-generation cellular networks.
Xing Jia +5 more
semanticscholar +1 more source
PeCo: Perceptual Codebook for BERT Pre-training of Vision Transformers [PDF]
This paper explores a better prediction target for BERT pre-training of vision transformers. We observe that current prediction targets disagree with human perception judgment. This contradiction motivates us to learn a perceptual prediction target.
Xiaoyi Dong +8 more
semanticscholar +1 more source

