Importance

Loading Importance Indicators...

Abstract

The disclosure provides an apparatus, method, device, and medium for loss balancing in MTL. The apparatus includes interface circuitry and processor circuitry. The processor circuitry is configured to initialize parameters of shared layers of a deep neural network for MTL using a pre-trained neural network; determine a custom interval consisting of a designated number of mini-batch training steps and a designated window of N custom intervals (N>2); for each task, calculate a loss change rate between each pair of N−1 pairs of neighboring custom intervals within a designated window prior to a present custom interval and a gradient magnitude with respect to selected shared weights within the designated window prior to the present custom interval, and adjust, a weight of the task, based on the calculated loss change rate and gradient magnitude with respect to selected shared weights.

Loading the Abstract Image...

First Claim