I can see the novelty of it ("Look at my fancy <github> tag!"), but it would definitely be more helpful if it used a standard HTML element (preferably <div>). I've personally opted for this implementation on my own projects:
https://github.com/tholman/github-corners, which are just SVGs which makes it super portable.