ArangoDB is also a graph database. Many of the benchmarks (shortest path, neighbors, etc.) are specifically geared towards graph databases. Neo4j is totally appropriate in this comparison.
Which DB operations included into the test is not something you also might have to perform with neo4j?