Comment by dansitu | Hacker News Reader

Comment by dansitu | Hacker News Reader

Parent Full thread

If you're interested in this stuff and wanna try it yourself, check out our product, Edge Impulse:

https://edgeimpulse.com/ai-practitioners

We work directly with vendors to perform low level optimization of deep learning, computer vision, and DSP workloads for dozens of architectures of microcontrollers and CPUs, plus exotic accelerators (neuromorphic compute!) and edge GPUs. This includes ESP32:

https://docs.edgeimpulse.com/docs/edge-ai-hardware/mcu/espre...

You can upload a TensorFlow, PyTorch, or JAX model and receive an optimized C++ library direct from your notebook in a couple lines of Python. It's honestly pretty amazing.

And we also have a full Studio for training models, including architectures we've designed specifically to run well on various embedded hardware, plus hardware-aware hyperparameter optimization that will find the best model to fit your target device (in terms of latency and memory use).

I don't think the output from this can be used in any open source project due to the community plan restrictions, FYI.

That's definitely not our intention: the output of all Community projects is by default Apache 2.0 licensed, unless the developer specifies a different one.

The community plan does have commercial use restrictions; it's designed for education, demos, and research. We have a pretty good presence in the academic community with tons of papers, code, and projects developed using our community version.

Here's a Google Scholar search showing a bunch of papers:

https://scholar.google.com/scholar?start=0&q=%22edge+impulse...

We also have our own public sharing platform:

https://edgeimpulse.com/projects/overview

Yo! This is awesome stuff!

Thank you! We're trying to bring embedded ML in reach of all engineering teams and domain experts.

Previously you needed a crazy mixture of ML knowledge and low-level embedded engineering skills even to get started, which is not a common occurrence!

Why C++? Does the C++ code use any difficult C++ features or is it more C with classes?

We use C++11 because we depend on some source that relies on it, but you can of course compile the library and then link to a C program:

https://docs.edgeimpulse.com/docs/run-inference/cpp-library/...

Reply on news.ycombinator.com