Embeddings have been the talk of the town, but their stock implementation can be made better very easily.