At least in the USA it seems you need permission for derivative works regardless of your intent in making them:

https://www.law.cornell.edu/wex/derivative_work