Suyuchen Wang
  • Bio
  • Papers
  • Experience
  • Projects
  • Teaching
  • Projects
  • Experience
  • Blog
  • Publications
    • FACT: Examining the Effectiveness of Iterative Context Rewriting for Multi-fact Retrieval
    • LongRecipe: Recipe for Efficient Long Context Generalization in Large Language Models
    • MAP: Low-compute Model Merging with Amortized Pareto Fronts via Quadratic Approximation
    • Resonance RoPE: Improving Context Length Generalization of Large Language Models
    • VCR: Visual Caption Restoration
    • DiffTune: A Diffusion-Based Approach to Diverse Instruction-Tuning Data Generation
    • Efficient Classification of Long Documents via State-Space Models
    • Multimodal Multi-Hop Question Answering Through a Conversation Between Tools and Efficiently Finetuned Large Language Models
    • QEN: Applicable Taxonomy Completion via Evaluating Full Taxonomic Relations
    • Enquire One's Parent and Child Before Decision: Fully Exploit Hierarchical Structure for Self-Supervised Taxonomy Expansion
    • Anchored Model Transfer and Soft Instance Transfer for Cross-Task Cross-Domain Learning: A Study Through Aspect-Level Sentiment Classification
  • Recent & Upcoming Talks
    • Example Talk
  • Teaching
    • IFT 6289 - Winter 2024
    • IFT 6759 - Winter 2023
    • IFT 6289 - Winter 2022

MAP: Low-compute Model Merging with Amortized Pareto Fronts via Quadratic Approximation

Jan 1, 2024·
Lu Li
,
Tianyu Zhang
,
Zhiqi Bu
,
Suyuchen Wang
,
Huan He
,
Jie Fu
,
Yonghui Wu
,
Jiang Bian
,
Yong Chen
,
Yoshua Bengio
· 0 min read
Cite DOI URL
Type
Journal article
Publication
CoRR
Last updated on Nov 11, 2024
← LongRecipe: Recipe for Efficient Long Context Generalization in Large Language Models Jan 1, 2024
Resonance RoPE: Improving Context Length Generalization of Large Language Models Jan 1, 2024 →

© 2024 Suyuchen Wang. This webpage is licensed under CC BY NC ND 4.0

Published with Hugo Blox Builder — the free, open source website builder that empowers creators.