GSoC Optimizers: Weekly Progress Reports

Projects GSoC-2023
1

GSoC 2023 Logging :bookmark_tabs:

Community Bonding Period :rocket:

Week 1 (11 May - 18 May)

  • Researched about optimizers and made a list of optimizers I plan to implement.
    • Momentum Optimizer
    • Root Mean Square Propagation (RMSprop)
    • Adaptive Moment Estimation (Adam)
    • Adagrad
    • Adadelta
  • Didn’t do much work due to ongoing final exams.
  • Next week’s goals:
    • Example of fitting a Quadratic function
    • Start with Basic optimizer implementation
8 Likes
2

Week 2 (18 May - 25 May)

  • Added example program to fit a quadratic function
  • Draft PR Created
4 Likes
3

Week 3 (25 May - 1 June)

  • Updated code for 1-D Array dataset defining x & y.
  • Implemented separate subroutine for each of the optimizer:
    • Batch gradient descent
    • Mini-batch gradient descent
    • Stochastic gradient descent
1 Like