Joint Scaling Laws for Optimal Batch Size and Learning Rate Schedules

Deriving joint scaling laws through convex optimization provides a closed-form optimal batch size schedule for any given learning rate. This approach outperforms static batch size baselines during large language model training by accounting for joint training dynamics.