Why not just use a 1d conv over the sequence of embeddings?