The project have multiple subprojects, and one of these is the parser. Any developer can compile or extend it without more effort and create a library. Just know to code in Kotlin / Java.

The aim of this project is only check if a given web resource can be crawled by a user-agent, but using a API