Those two words have an extremely fluid definition depending on who you talk to.
Having worked on Wall Street, it essentially boils down to public/private businesses and financial institutions/firms/banks/exchanges are considered "Wall Street"...
Everyone one else is considered "Main Street"...
They have their own language and culture that exhorts greed and profit above humanity and peace. ie. "Wolf of WallStreet"...