Week seven (Jul 10, 2023 - Jul 17, 2023)
This is the seventh week of my GSoC journey.
GSoC project
Tasks
- Work on the GSoC midterm evaluation
- Fix several bugs in the Pytorch traning loop
train_torch.py
:- Change the model weight matrix from a
torch.tensor
to ann.Parameter
to enable gradient flow. - Add in the option of choosing
args.pert_form
that affects the loss function during backprop.
- Change the model weight matrix from a
- Replicate Figure 2A and 2B using the current Pytorch code
- Discuss a strange numerical discrepancy issue when writing tests for Pytorch ODE solver. In particular, given identical input and parameters, Tensorflow and Pytorch ODE solvers agreed to the error of
10e-8
for the first 100 time steps, but drastically diverged from 100 to 200 time steps. This phenomenon occurs for all inputs and parameters.
Relevant issues:
Notes
Check out my personal GSoC notebook, where I keep my observations and comments in one place.