How the LIDAR tech GM just bought probably works
arstechnica.com
arstechnica.com
Being both eye-safe and sunlight-tolerant is hard. Eye-safe is easier if you can increase the diameter of the outgoing beam. Eye safety is measured based on beam energy through a 1/4" hole (an eye pupil), and if the outgoing beam is made wider (say an inch) the energy per unit area drops. But the optics become bigger. Flash LIDAR units emit a spreading beam, and if you can keep people from getting close to the emitter and staring into it, it's not a big problem. (It's a distance measuring device, so if it detects something at range < 1 foot, it must cut the power way down.)
Sunlight tolerant is done with a few tricks. Narrow-band interference filters cut out everything but the color of the beam being used. A pulse LIDAR can outshine the sun for a nanosecond. Continuous-wave systems could in theory operate below the noise threshold, but the detector has to not saturate.
Anyway, there are lots of technologies that can work. Continental bought Advanced Scientific Concepts' technology, which is known to work fine; it just cost too much when each unit was built by PhDs in Santa Barbara. Continental is a huge auto parts maker; making a million of something cheaply is what they do.
What about a beam collimator at the detector? It would reject a lot of noise but would cost some power.
Despite the name, they aren't related to old-school photomultipliers - they're basically large arrays of very tiny Geiger-mode avalanche photodiodes on a single chip. This solves the low dynamic range issues from traditional large-area avalanche photodiodes. Traditional APDs have a long recovery time, whereas an array of small APDs has both a shorter recovery time per cell as well as a greater overall dynamic range due to the ability of multiple cells to be struck at once by incident photons.
SensL actually has a bunch of videos of their products in use for a LIDAR application: http://sensl.com/applications/lidar1/
Continuous ToF calculation from a specially coded continuous signal is already used in Chinese military rangefinders (coded continuous signal is hard to spot unlike repetitive pulses)
In a ToF camera (at least some of them - see lock-in pixels), each pixel is sampled four times per cycle to detect the phase offset from the outgoing illumination. The SwissRanger was one of the first time of flight cameras. The reason it suffers short range is because of phase ambiguity - the lasers are modulated at around 30MHz which gives a wavelength of 10 m or so. The ambiguity distance is half this (5 m). LIDAR systems historically got round this by using multiple modulation frequencies for different distance scales.
This tech is now everywhere thanks to Microsoft buying Canesta.
source: I work at Leica Geosystems.
It's not that better and better solutions are bad but there are probably a lot more gains in mitigating failure cases. I think our brains may even have dedicated systems for potential failure detection leading to timidness. Failure is currently mostly defined as lack of ability to get the right answer, it is negatively defined. I wonder is there's any merit in positively defining failure.
Another way to think of it is if timidness/shyness, typically "negative" traits (especially in American culture) are actually features rather than bugs.
It's solid state, has a very fast response time, super cheap to manufacture, and can steer a beam with high precision. And they are very efficient, achieving a >90% first-order diffraction efficiency. The AOM material can be solid and thermally insulating (such as glass), so you can get very high power.
In the paper cited, they produced a device that had an effective power of 4 mW with active cooling. How are they going to scale this up, taking into consideration first order diffraction depends on the angle of incidence of the incoming beam? The steering mechanism is basically a tunable diffraction grating which means the active area is going to be tiny.
Most high power diffraction gratings work by expanding the surface area of the grating, it would still be very expensive to create a large tunable waveguide/grating (think how much it costs to make a CPU die), making the whole cost savings of solid state a moot point. You could make an array of the devices, but you're going to need a ton of them to get the necessary power and reasonable deflection angle range.
> Consequently, the deflection is typically limited to tens of milliradians.
This is the big drawback with AOMs. They're very precise, but the angle through which they steer beams is small. You would need hundreds of scanners to scan a full circle under the best conditions.
AOMs are interesting though in that they provide a way to modulate the frequency of the light they deflect. This is how I've seen them used before: as a very precise way to introduce small frequency shifts into a laser beam for physics research.
To give you an example, this[1] commercially available sensor head can give great resolution stereo depth at around 10m but the included LIDAR unit is good out to around 30m.
LIDAR also has the advantage of operating on a different portion of the EM spectrum. It can sometimes be more well behaved in situations where there might be interference on the visible light wavelengths but not on the LIDAR wavelengths which is typically IR (e.g. extremely bright sunny days).
I think that there's a place for both in vehicles as a sort of redundancy. While they both mostly do the same things, they do them in different ways, and if LIDAR can be made cost effective then having both is a huge gain.
I'm with the grandparent: I genuinely don't understand the obsession with LIDAR in this space. It's complicated and fiddly, and seems to be competing with an "obvious" solution involving $3 camera parts.
Again, I think they both have their uses. If LIDAR can be made not so complicated and fiddly, I think it brings a lot to the table.
I don't doubt that LIDAR can work with some development. I'm just shocked that it seems to be the default position in the industry and want someone to explain this to me in a way that makes sense.
Even if AI gets it (mostly) right, getting a second input that verifies your path is clear seems like a good idea.
would be _awesome_ today, depending on which person we're comparing it to anyways... :)
And if in 15 years it could do much better, great.
Nobody wants to buy a car which requires a new LIDAR to be installed after 100,000 miles for the sum of $7,000.
Hopefully once production starts and yield rates increase the unit costs can shrink small enough to being becoming feasible for integration into lower-end products like cell phones or laptops. I think there are a lot of cool applications for LIDAR which have been blocked by the current expense.
As I mentioned in another post: cars already have these sensors in the form of short range (ultrasound?) sensors for parking. These are regularly covered with ice if you live in a winter climate, and in that situation the parking sensors will continuously beep when you have the car in reverse. A human driver just ignores that and backs out anyway, because you look with your eyes and see nothing, so you assume the warning is false and due to ice. The device isn't even broken, it's just temporarily not able to work until the ice has melted, which is a few hours away when the sun comes up.
An autonomous car could just say "I don't trust the readings from the sensors so you are on your own kid" and I'd drive. And that would be sort of fine (although it can't be several dozen mornings then it's annoying).
But an autonomous taxi can't do that. This is why I think assistant drivers such as teslas autopilot, that can just defer driving to a human, will be around for a very long time (Decades) before we have fully autonomous cars that can drive without backup driver.
How much does a chauffeur cost for 100,000 miles?
How does these system avoid interference with other cars? Say if ten exact same car, with the exact same model of LIDAR are on the same street / crossing. Can I expect some noise being received by the sensor?
- Frequency Division: each detector uses a different frequency/wavelength. This approach is very simple to implement, but the usable range of wavelengths for LIDAR is fairly narrow. So we'd run out of choices pretty quickly.
- Time Division: each detector is allocated a different operating time slot, so that only one is active at a time. For cell phones, this is relatively easy to implement because they all connect to a central system that can coordinate the timing. But for cars, this would be more difficult since there's no central system that links the detectors on different cars together (although they could still communicate with each other through other means).
- Code Division: each detector's output is pulsed in a unique pattern so that the reflected signals will return that same pattern, then the processor can reject any patterns that it didn't send out. This approach is much more complex, but doesn't suffer from many of the drawbacks of the other solutions.
Code division is by far the most widely used approach here, but frequency and time division also play a small role as well since different manufacturers/detectors use different wavelengths and not all detectors are being operated at exactly the same time (the time needed to send and receive a single signal is extremely short).
Commies had them in such abundance that they put millimetre wave imagers (and that was in seventies) on thing as cheap as vision aids for tank drivers, field guns, single shot atgms, and even small arms.
Generally, to increase resolution you can do following - increase antenna size, increase number of antennas, increase amount of processing power thrown on it.
Right now, existing offerings can be improved in all 3 ways with ease.
I worry that these modern cars will be basically requiring fighter jet storage in order to work. I need something that works in a snowstorm when the car is covered in ice.
My "parking sensors" (the cheap little distance sensing thingys mounted around most new cars) are screaming every time there is a little surface ice over them. I work around this by simply ignoring it. But if a car would require these sensors to function, which would be the case if it was autonomous, I'd be starting my morning drive by somehow getting the ice off them.
State-of-the art 79 GHz automotive radar: 0.2 m range uncertainty, 5 degree azimuth angular uncertainty, dozens of points per second.
Spinning lidar: <0.05 m range uncertainty, <0.1 degree azimuth angular uncertainty, a million points per second.
Radar definitely has its uses as it can see through weather conditions and tell velocity, but lidar is the vastly superior sensor otherwise.
That is far from what is currently considered advanced for mm-wave radar in 93-95ghz range - 0.5 degrees
Google "GPU Acceleration of SAR/ISAR Imaging Algorithms" and see how much you can get with with regular high bandwidth 10ghz radar and computing power in tenths of gigaflops.
I studied optics a bunch in college but never managed to work it into my electrical engineering job. Might be lame, but I didn't have any clue this kind of integration was possible yet, it's certainly quite exciting. Probably the coolest thing I've read about in quite some time.
Wouldnt any of these smart cars be able to know they physical volumes of many number of cars, including themselves, as well as communicate with eachother - and share their velocity, direction, volume, intentions so as to have a hive mind of the moving bodies?
What if you also just had a beacon which reported this information to other cars in a short network where the driver is human - so the smart cars all know where the human driver operated cars are.
Then, in addition, you collect all the point data, from lidar, you subtract the known data points given "a prius with a shape and mass and volume of this moving at a speed of that - and over time you have built out a complete point cloud of the static, non-variable topology?
rather than spending $75,000 on one lidar periscope, spend 75,000 on developing a beacon such that all cars are telling eachother where they are, their mass/volume and speed?
I can imagine something similar to what you're proposing being a part of the overall system, I suspect there will always be the need for something vehicle-based that "sees" the environment.
And I was saying that these beacons should be just a part of the car and super cheap. The beacon just says "hey I'm a Prius and this is my speed direction and location"
But you'd have to make them completely anon - we already have too much activity tracking.
So the devices should cycle through random IDs that just spray out the specs of the vehicle, but they change frequently the ID so you can just say that a smart car would know that it just sees various cars - not that it knows that "Jim is just ahead on the left"
[0]: http://www.businessinsider.com/peter-thiel-backed-austin-rus...
I wonder how much their patents restrict others from going the same general route.
It does seem like the only obvious truly "no moving parts" solution. MEMS still has moving parts, they are just tiny.
If the benefits aren't at least 3x better, it might not be marketable enough to justify the added complexities and costs.