> BTW, if your data set can be disposed by an awk script, it should not be called “big data”.
I think this statement is wrong. The popular meaning of the hype term “big data” can not be easily changed.
Rather, awk, sed and other tools that can read from stdin and write to stdout are great tools for “big data” and often more efficient and suitable than larger and more hyped systems.