Progressive multi-task learning via constrained optimization
DOI:
CSTR:
Author:
Affiliation:

The 28th Research Institute of China Electronics Technology Group Corporation,Nanjing 210007, China

Clc Number:

TP391.4;TN911.73

Fund Project:

  • Article
  • |
  • Figures
  • |
  • Metrics
  • |
  • Reference
  • |
  • Related
  • |
  • Cited by
  • |
  • Materials
  • |
  • Comments
    Abstract:

    With the extensive application of multi-task learning in complex business scenarios such as intelligent recommendation and autonomous driving, the handling mechanism for heterogeneous task priorities has emerged as a critical bottleneck constraining model performance. Existing approaches predominantly rely on empirical strategies of linear loss function combination, which suffer from dual deficiencies: First, The manual parameter-tuning paradigm for task weighting leads to combinatorial explosion in hyperparameter search space as task quantity increases; second, gradient competition among tasks induces negative transfer effects that significantly erode the performance boundaries of high-priority tasks. To address these challenges, this study proposes an innovative constrained optimization-based progressive multi-task learning method. By encoding task priority structures into inequality constraints, we formulate an optimization paradigm with strict priority guarantees. A constrained optimization framework is established through Lagrangian duality theory to ensure that the performance lower-bound constraints of high-priority tasks remain unaffected by secondary task optimization processes. Meanwhile, a progressive gradient projection algorithm enables dynamic adjustment of constraint spaces. Theoretically, we provide convergence guarantees through non-convex optimization theory. Experimental results on public datasets demonstrate that our method enhances the performance of secondary tasks while ensuring the stability of high-priority tasks, establishing a novel theoretical framework and technical pathway for multitask learning.

    Reference
    Related
    Cited by
Get Citation
Related Videos

Article Metrics
  • Abstract:
  • PDF:
  • HTML:
  • Cited by:
History
  • Received:
  • Revised:
  • Adopted:
  • Online: August 25,2026
  • Published:
Article QR Code