Week ten (Jul 31, 2023 - Aug 7, 2023)
This is the tenth week of my GSoC journey.
GSoC project
Tasks
- Correct mask has been fixed for CellBox Pytorch, and 500 models are being retrained with the updated model.
- Check some blogs about other people’s complaining different behaviour and suboptimal training performance of Pytorch compared with Tensorflow (for example, this and [this]https://stackoverflow.com/questions/73600481/400-higher-error-with-pytorch-compared-with-identical-keras-model-with-adam-op). Overall, people tend to see a similar trend where Pytorch and Tensorflow models converge differently despite identical hyperparams and inputs. But the causes are very varied.
- Implement a unit test to compare the output of Pytorch and Tensorflow CellBox models after one feedforward loop (without backprop) with indentical input and weight initializations.
Relevant issues:
- Blogs about Pytorch having suboptimal convergence when compared with TensorFlow model (this and [this]https://stackoverflow.com/questions/73600481/400-higher-error-with-pytorch-compared-with-identical-keras-model-with-adam-op)
Notes
Check out my personal GSoC notebook, where I keep my observations and comments in one place.