I hope this helps you
https://gist.github.com/talatuyarer/02568a38a7630434556e7dc1...
39 karma · joined March 19, 2018
https://gist.github.com/talatuyarer/02568a38a7630434556e7dc1...
Yes We have plan to publish Dataset for Apache V3 spec features such as Variant, Deletion Vector. I can update this comment when we have release date.
https://lists.apache.org/thread/gd5smyln3v6k4b790t5d1vy4483m...
So far only Variant is supported in Spark and with 1.10 Spark will support nano timestamp and unknowntype I believe.