Restarting Jobs for LBFGS optimizers
Posted: Mon Jul 17, 2017 1:42 pm
Hi vtst community,
Our group makes use of a queue which has a short queue time of 4 hours. Because of this sometimes our jobs don't do sufficient number of geometric steps to converge in just one run. We were wondering if this could somehow affect the efficiency of the LBFGS algorithm, which requires certain number of geometric steps to built the hessian. If yes, is there a way to read the steps from previous runs when we restart the run, such that the algorithm now considers the steps from the run before the restart to built the Hessian as well and not redo the process every time. Awaiting your reply.
Thank you
Siddharth
Our group makes use of a queue which has a short queue time of 4 hours. Because of this sometimes our jobs don't do sufficient number of geometric steps to converge in just one run. We were wondering if this could somehow affect the efficiency of the LBFGS algorithm, which requires certain number of geometric steps to built the hessian. If yes, is there a way to read the steps from previous runs when we restart the run, such that the algorithm now considers the steps from the run before the restart to built the Hessian as well and not redo the process every time. Awaiting your reply.
Thank you
Siddharth