A collection of fixes, model experiments, etc#880

Merged

rwightman merged 20 commits intomasterfrom

fixes_bce_regnet

Oct 4, 2021

Commits on Sep 26, 2021

Fix regnetz_d conv layer name, use inception mean/std
rwightman
committed

Commits on Sep 28, 2021

Add worker_seeding arg to allow selecting old vs updated data loader worker seed for (old) experiment repeatability
rwightman
committed
Fix bottleneck attn transpose typo, hopefully these train better now..
rwightman
committed

Commits on Oct 2, 2021

Some halo and bottleneck attn code cleanup, add halonet50ts weights, use optimal crop ratios
rwightman
committed