lessw2020 - Overview (original) (raw)

View lessw2020's full-sized avatar

Less Wright lessw2020

AI/PyTorch Partner Engineer - Meta AI (Facebook AI) Principal Software Engineer - Audere Software Architect - X10 Wireless Dev/PM - Microsoft

Block or report lessw2020

  1. Ranger - a synergistic optimizer using RAdam (Rectified Adam), Gradient Centralization and LookAhead in one codebase
    Python 1.2k 178
  2. Ranger deep learning optimizer rewrite to use newest components
    Python 329 46
  3. Collection of the latest, greatest, deep learning optimizers (for Pytorch) - CNN, NLP suitable
    Jupyter Notebook 214 41
  4. Mish Deep Learning Activation Function for PyTorch / FastAI
    Jupyter Notebook 161 33
  5. Res2Net architecture with improved stem and Mish activation function
    Python 136 33
  6. Repo to build on / reproduce the record breaking Ranger-Mish-SelfAttention setup on FastAI ImageWoof dataset 5 epochs
    Jupyter Notebook 116 25