Your common oscilloscope is common ground referenced. You attach to your test circuits ground with the typically black alligator clips coming off the probe and then read voltage at a point with the test lead. A decent differential probe like you might be thinking of usually costs about as much as a decent hobbyist oscilloscope.