AI hardware// challenges & opportunities

sbagency
3 min readDec 9, 2023

--

There are many startups who are trying to develop more efficient hardware. For instance, Edge AI or on-device AI workloads.

DALL-E 3 — Neuromorphic chip
https://www.youtube.com/watch?v=Y1v3wi-djD0
https://www.youtube.com/watch?v=35vu8qFy3Ys
https://www.youtube.com/watch?v=35vu8qFy3Ys
https://www.cyber-swarm.net/technology/

Nature is a powerful computer

With abilities far beyond our current technology

For instance, ants display remarkable intelligence, operating in complex colonies and demonstrating problem-solving skills that are both efficient and adaptable. To reach nature’s level of computing prowess, we need to learn from these natural systems, facing and overcoming similar challenges.

One key lesson is learning how to create reliable technology from components that might not always be perfect or consistent.

https://twitter.com/Mihairaneti/status/1733171536062795911
https://arxiv.org/pdf/2312.00425.pdf
https://arxiv.org/pdf/2312.00037.pdf
https://arxiv.org/pdf/2311.16896.pdf
https://arxiv.org/pdf/2311.15474.pdf
https://arxiv.org/pdf/2311.09767.pdf
https://www.wired.com/story/openai-buy-ai-chips-startup-sam-altman/
https://www.youtube.com/watch?v=KcY1DRmmggs

But there is nothing about neuromorphic or NPU tech here.

https://rain.ai/products

In memory compute

https://rain.ai/approach

Shared exponent

https://proceedings.mlr.press/v162/yeh22a/yeh22a.pdf

RISC-V integration

https://riscv.org/blog/2023/05/risc-v-and-the-future-of-machine-learning-computing/

On device fine-tuning

https://arxiv.org/pdf/2307.15063.pdf

Neuromorphic chips // NPU

Most promising tech, especially for AI // no need for precision arithmetic. But Intel already includes NPU in a chip.

Meteor Lake Architecture Overview

Are NPUs old analog devices built on a new technological foundation? What are the challenges of neuromorphic technologies?

New low power high speed NPUs are on demand for AI apps(on device).

https://www.oejournal.org/article/doi/10.29026/oea.2023.230140
https://twitter.com/OptoElectronAdv/status/1731484384950382973
https://neuro4ml.github.io/

--

--

sbagency

Tech/biz consulting, analytics, research for founders, startups, corps and govs.