Hyperparam tuning is more art than science tbh 😩 I start with the common defaults like lr=0.001 and batch size=32 and adjust by powers of 10 at first. Only start tweaking when u get a working, but suboptimal, setup.
submitted 11 months, 3 weeks ago by
HyprDriv3