We could start with all the things the federal government wasn't involved in prior to the enactment of the income tax.
The world has changed somewhat since 1894.
FYI the last three items amount to about 2% or less of Federal spending. All discretionary spending was 16% in 2016:
https://upload.wikimedia.org/wikipedia/commons/thumb/c/ca/U....
Excluding entitlements (Social Security, Medicare, debt service) it's still minuscule:
http://memepoliceman.com/wp-content/uploads/2015/09/viper-re...