Autograd is a popular method of computing gradients of mathematical computations.
A framework with autograd generally gives you numbers and tensors you can use for calculating things. When you use them, a computation graph is created in the background. Later, this graph is used to calculate the gradients automatically.
This is the backbone of Machine learning frameworks like PyTorch.