Results 11 to 20 of about 402,756 (276)

MI-PRUN: Optimize Large Language Model Pruning via Mutual Information [PDF]

Large Language Models (LLMs) have become indispensable across various domains, but this comes at the cost of substantial computational and memory resources. Model pruning addresses this by removing redundant components from models. In particular, block pruning can achieve significant compression and inference acceleration.
Hao Zhang, Zhibin Zhang, Guangxin Wu, He Chen, Jiafeng Guo, Xueqi Cheng   +5 more
  +6 more sources

An Integrated Approach to Air Passenger Index Prediction: Mutual Information Principle and Support Vector Regression (MI-Svr) Blended Model

, 2020
Air passenger traffic prediction is crucial for the effective operation of civil aviation airports. Despite some progress in this field, the prediction accuracy and methods need further improvement. This paper proposes an integrated approach to the prediction of air passenger index as follows.
Honglin Xiong, Chongjun Fan, Collins Opoku Antwi, Yun Yang, Xiaomao Fan   +4 more
  +6 more sources

MI^2GAN: Generative Adversarial Network for Medical Image Domain Adaptation using Mutual Information Constraint [PDF]

, 2020
The first two authors contributed ...
Xinpeng Xie, Jiawei Chen, Yuexiang Li, Linlin Shen, Kai Ma, Yefeng Zheng   +5 more
  +6 more sources

VBO-MI: A Fully Gradient-Based Bayesian Optimization Framework Using Variational Mutual Information Estimation [PDF]

Many real-world tasks require optimizing expensive black-box functions accessible only through noisy evaluations, a setting commonly addressed with Bayesian optimization (BO). While Bayesian neural networks (BNNs) have recently emerged as scalable alternatives to Gaussian Processes (GPs), traditional BNN-BO frameworks remain burdened by expensive ...
Farhad Mirkarimi
  +5 more sources

MI-Pruner: Crossmodal Mutual Information-guided Token Pruner for Efficient MLLMs [PDF]

9 ...
Jiameng Li, Aleksei Tiulpin, Matthew B. Blaschko   +2 more
  +4 more sources

MI-GCN: Node Mutual Information-based Graph Convolutional Network [PDF]

Companion Proceedings of the Web Conference 2022, 2022
Lei Tian, Huaming Wu
openalex   +2 more sources

Using Pearson Correlation and Mutual Information (PC-MI) to Select Features for Accurate Breast Cancer Diagnosis Based on a Soft Voting Classifier

Iraqi Journal for Electrical and Electronic Engineering, 2023
Breast cancer is one of the most critical diseases suffered by many people around the world, making it the most common medical risk they will face. This disease is considered the leading cause of death around the world, and early detection is difficult. In the field of healthcare, where early diagnosis based on machine learning (ML) helps save patients’
Mohammed Hashim, Ali Yassin
openalex   +2 more sources

Uncovering Neural Learning Dynamics Through Latent Mutual Information [PDF]

Entropy
We study how convolutional neural networks reorganize information during learning in natural image classification tasks by tracking mutual information (MI) between inputs, intermediate representations, and labels. Across VGG-16, ResNet-18, and ResNet-50,
Arianna Issitt, Alex Merino, Lamine Deen, Ryan T. White, Mackenzie J. Meni   +4 more
doaj   +2 more sources

Pengenalan Aktivitas Manusia dengan Seleksi Fitur Analysis of Variance (ANOVA) dan Mutual Information (MI) pada Data Sensor Accelerometer Berbasis Machine Learning

Jurnal Sistem dan Informatika (JSI)
Pengenalan aktivitas manusia telah banyak dikembangkan untuk berbagai keperluan, seperti kesehatan, olahraga, hingga pengawasan lanjut usia. Penggunaan perangkat sensor menjadi salah satu pilihan dalam melakukan pengenalan aktivitas manusia. Sensor accelerometer adalah salah satu perangkat yang umum digunakan dalam pengenalan aktivitas. Data sensor ini
Made Liandana, I Made Darma Susila, Yohanes Priyo Atmojo   +2 more
openalex   +3 more sources

GCNS-MI: EEG Recognition of Depression Based on Graph Mutual Information Maximization

SSRN Electronic Journal, 2022
Wei Li, Hong Wang, Luhe Zhuang, Hui Zhang, Shu Han, Yuanjie Zheng   +5 more
openalex   +2 more sources