Results 71 to 80 of about 33,388 (259)

Gradient-based Parameter Selection for Efficient Fine-Tuning

2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
With the growing size of pre-trained models, full fine-tuning and storing all the parameters for various downstream tasks is costly and infeasible. In this paper, we propose a new parameter-efficient fine-tuning method, Gradient-based Parameter Selection (GPS), demonstrating that only tuning a few selected parameters from the pre-trained model while ...
Zhang, Z., Zhang, Q., Gao, Z., Zhang, R., Shutova, E., Zhou, S., Zhang, S.   +6 more
openaire   +3 more sources

Exploring Dipolar Dynamics and Ionic Transport in Metal‐Organic Frameworks: Experimental and Theoretical Insights

Advanced Functional Materials, EarlyView.
In this study, the interplay of dipolar dynamics and ionic charge transport in MOF compounds is investigated. Synthesizing the novel structure CFA‐25 with integrated freely rotating dipolar groups, local and macroscopic effects, including interactions with Cs cations are explored.
Ralph Freund, Arthur Schulz, Peter Lunkenheimer, Maryana Kraft, Thomas Bergler, Harald Oberhofer, Dirk Volkmer   +6 more
wiley   +1 more source

Parameter efficient vs full fine-tuning for building children’s myopia prediction models

Systems and Soft Computing
Background and objective:: The prevalence of myopia is increasing globally, with projections suggesting that by 2050, half of the population could be affected and 10% may experience high myopia.
Elena Ros-Sánchez, César Domínguez, Jónathan Heras, David Oliver-Gutiérrez, Didac Royo, Anna Boixadera Espax, Miguel Ángel Zapata   +6 more
doaj   +1 more source

MambaPEFT: Exploring Parameter-Efficient Fine-Tuning for Mamba

An ecosystem of Transformer-based models has been established by building large models with extensive data. Parameter-efficient fine-tuning (PEFT) is a crucial technology for deploying these models to downstream tasks with minimal cost while achieving effective performance. Recently, Mamba, a State Space Model (SSM)-based model, has attracted attention
Yoshimura, Masakazu, Hayashi, Teruaki, Maeda, Yota   +2 more
openaire   +2 more sources

Organic Electrochemical Transistor Channel Materials: Copolymerization Versus Physical Mixing of Glycolated and Alkoxylated Polymers

Advanced Functional Materials, EarlyView.
This work discusses the use of blended channel materials in OECTs. It explores how mixing glycolated and alkoxylated polymers in various ratios offers a simpler and more efficient route to tuning OECT properties. The performance of the polymer blends is compared to the corresponding copolymers, demonstrating similar OECT characteristics, swelling ...
Lize Bynens, Kaishuai Zhang, Priscila Cavassin, Arwin Goossens, Jochen Vanderspikken, Tania C. H. Castillo, Demetra Tsokkou, Adam Marks, Arianna Magni, Karrie Weaver, Laurence Lutsen, Sahika Inal, Koen Vandewal, Natalie Banerji, Wouter Maes   +14 more
wiley   +1 more source

Fine-tuning protein language models boosts predictions across diverse tasks

Nature Communications
Prediction methods inputting embeddings from protein language models have reached or even surpassed state-of-the-art performance on many protein prediction tasks.
Robert Schmirler, Michael Heinzinger, Burkhard Rost   +2 more
doaj   +1 more source

ANALYSIS OF WHISPER AUTOMATIC SPEECH RECOGNITION PERFORMANCE ON LOW RESOURCE LANGUAGE

Pilar Nusa Mandiri
Implementing Automatic Speech Recognition Technology in daily life could give convenience to its users. However, speeches that can be recognized accurately by the ASR model right now are in languages considered high resources, like English.
Riefkyanov Surya Adia Pratama, Agit Amrullah   +1 more
doaj   +1 more source

Understanding and Optimizing Li Substitution in P2‐Type Sodium Layered Oxides for Sodium‐Ion Batteries

Advanced Functional Materials, EarlyView.
This work explores Li‐substituted P2 layered oxides for Na‐ion batteries by crystallographic and electrochemical studies. The effect of lithium on superstructure orderings, on phase transitions during synthesis and electrochemical cycling and on the interplay of O‐ versus TM‐redox is revealed via various advanced techniques, including semi‐simultaneous 
Mingfeng Xu, Giovanni Gammaitoni, Michael Häfner, Eduardo Villalobos‐Portillo, Carlo Marini, Matteo Bianchini   +5 more
wiley   +1 more source

Parameter-Efficient Fine-Tuning for Individual Tree Crown Detection and Species Classification Using UAV-Acquired Imagery

Remote Sensing
Pre-trained foundation models, trained on large-scale datasets, have demonstrated significant success in a variety of downstream vision tasks. Parameter-efficient fine-tuning (PEFT) methods aim to adapt these foundation models to new domains by updating ...
Jiuyu Zhang, Fan Lei, Xijian Fan
doaj   +1 more source

3D (Bio) Printing Combined Fiber Fabrication Methods for Tissue Engineering Applications: Possibilities and Limitations

Advanced Functional Materials, EarlyView.
Biofabrication aims at providing innovative technologies and tools for the fabrication of tissue‐like constructs for tissue engineering and regenerative medicine applications. By integrating multiple biofabrication technologies, such as 3D (bio) printing with fiber fabrication methods, it would be more realistic to reconstruct native tissue's ...
Waseem Kitana, Indra Apsite, Leonid Ionov   +2 more
wiley   +1 more source