Having worked on Wall Street, it essentially boils down to public/private businesses and financial institutions/firms/banks/exchanges are considered "Wall Street"...

Everyone one else is considered "Main Street"...

They have their own language and culture that exhorts greed and profit above humanity and peace. ie. "Wolf of WallStreet"...