Balancing Speed and Accuracy in Federated Learning with Large Data Batches

MERIT Optimizer Enhances Large-Batch Training for Language Models

Fisher-Orthogonal Projection: A New Method for Efficient Large-Batch Deep Learning