Semi-Markov graph dynamics