In Helsinki there are multiple good fishing spots that are accessible with public transport. You can also visit two national parks using regional bus.