Chain Rule Trainer

Practice backpropagation on small computation graphs.

Rulebook

add: d(x+y)/dx = 1
mul: d(xy)/dx = y
tanh: d(tanh x)/dx = 1-tanh²(x)
relu: d(relu x)/dx = x>0?1:0