I think the most common limitation will be ensure that your output is serializable. Typically returning python dictionaries or dataclasses is fine.
But if you had a specific limitation in mind let me know happy to dive into it!
I think the most common limitation will be ensure that your output is serializable. Typically returning python dictionaries or dataclasses is fine.
But if you had a specific limitation in mind let me know happy to dive into it!
This can help with things like setting up RPC clients. But it all boils down to the same runner whether you're using the class or decorator.
Exciting to see more libraries built on Ray in any case!
I think one area where we differ is our focus on streaming processing which I don't think is well supported with the workflow abstraction, and also having more resource management / use case driven IO.
Definitely like seeing more streaming-focused orchestration tools out there - it's a growing niche with not enough alternatives to Beam