Реклама

Training-Free Knowledge Transfer Across Model Scales through Activation-Guided Pruning

#Training-Free #Knowledge #Transfer #Across #Model

arXiv:2608.13596v1 Announce Type: new Abstract: Heterogeneous model fusion seeks to combine models that differ in tasks, initializations, architectures, or scales. We study an underexplored cross-scale setting: improving a small recipient language model with a stronger donor despite substantial…