graph_adjacency.hh: improve removal or last vertex

2 jobs for master in 131 minutes and 3 seconds
Status Job ID Name Coverage
  Test
passed #4894
amd64
job_clang_amd64

02:11:03

passed #4893
amd64
job_gcc_amd64

01:21:10