embedded machine learning research engineer - georgist - urbanist - environmentalist

  • 2 Posts
  • 26 Comments
Joined 1 year ago
cake
Cake day: June 22nd, 2023

help-circle
  • The raison d’être for RISC-V is domain-specific architecture. Currently, computational demands are growing exponentially (especially with AI), but Moore’s Law is ending, which means we can no longer meet our computational demands by scaling single-core speed on general-purpose CPUs. Instead, we are needing to create custom architectures for handling particular computational loads to eke out more performance. Things like NPUs, TPUs, etc.

    The trouble is designing and producing these domain-specific architectures is expensive af, especially given the closed-source nature of computer hardware at the moment. And all that time, effort, and money just to produce a niche chip used for a niche application? The economics don’t economic.

    But with an open ISA like RISC-V, it’s both possible and legal to do things like create an open-source chip design and put it on GitHub. In fact, several of those exist already. This significantly lowers the costs of designing domain-specific architectures, as you can now just fork an existing chip and make some domain-specific modifications/additions. A great example of this is PERCIVAL: Open-Source Posit RISC-V Core with Quire Capability. You could clone their repo and spin up their custom RISC-V posit chip on an FPGA today if you wanted to.



  • Exactly. When the accused has paid off half the jury, you shouldn’t put much stock in the verdict.

    The only thing I care about when determining whether something is a genocide is the facts of the case (which are overwhelmingly in favor of describing the Uyghur genocide as a genocide), not the outcome of a highly political vote by countries all with their own motives and interests.




  • Sounds similar to some of the research my sister has done in her PhD so far. As I understand, she had a bunch of snapshots of proteins from a cryo electron microscope, but these snapshots are 2D. She used ML to construct 3D shapes of different types of proteins. And finding the shape of a protein is important because the shape defines the function. It’s crazy stuff that would be ludicrously difficult and time-consuming to try to do manually.




  • Yeah, I’m working in embedded ML, and it’s an insanely exciting time. We’re getting more and more microcontrollers and single-board computers with special AI accelerators, many of them RISC-V, by the day it seems. One of the next steps (in my opinion) is finding a good way to program them that doesn’t involve C/C++ (very fast but also so painful to do AI with) or Python (slow unless it’s wrapping underlying C code, and unsuitable for microcontrollers). In fact, that’s exactly what I’m working on right now as a side project.

    What’s also cool is RISC-V promises to be the one instruction set architecture to rule them all. So instead of having PCs as x86, phones and microcontrollers as ARM, then all sorts of other custom architectures like DSPs (digital signal processors), NPUs, etc., we could just have RISC-V with a bunch of open standard extensions. Want vector instructions? Well, here’s a ratified open standard for vector instructions. Want SIMD instructions? Congrats, here’s another ratified open standard.

    And all these standards mean it will make it so much easier for the compiler people to provide support for new chips. A day not too long from now, I imagine it will become almost trivial to compile programs that can accelerate tons of scientific, numerical, and AI workloads onto RISC-V vector instructions. Currently, we’re stuck using GPUs for everything that needs parallelization, even though they’re far from the easiest or most optimal devices for many of our computational needs.

    As computing advances, we can just create and ratify new open standards. Tired of floating point numbers? You could create a proposal for a standard posit extension today if you wanted to, then fork LLVM or GCC or something to provide the software support as well. In fact, someone already has implemented an open-source RISC-V chip with posit arithmetic and made a fork of LLVM to support it. You could fire it up on an FPGA right now if you wanted.



  • It’s especially dumb because RISC-V is – dare I say it – inevitably the future. Trying to crack down on RISC-V is like trying to crack down on Linux or solar photovoltaics or wind turbines. That is, you can try to crack down, but the fundamental value proposition is simply too good. All you’ll achieve in cracking down is hurting yourself while everyone else gets ahead.




  • Last year, my sister had her driver’s license suspended because of a medical condition, but she’s still perfectly capable of riding a bike. But the problem is our societal assumption of cars-for-all-whether-you-like-it-or-not means her neighborhood street design is extremely hostile to her getting around by bike safely, and it’s way too sprawling and car-dependent to walk anywhere. There’s also no public transit within a reasonable walking distance.

    So I might ask you: Do you believe people like my sister deserve the same right to mobility as the rest of us? If so, why support a system that make life actively hostile to her and people like her? You act as if disabilities are a monolith, and that cars are only ever their saviors, as if cars are never the thing making life actively more difficult for many people.







  • Yeah, I’m working at a company that traditionally makes digital signal processors for telecommunications, and even we’re using AI for actual practical applications. The current project I’m working on is applying an object detection model to detect different signal types in 2D spectrograms. The old way takes like 15 minutes to scan and detect across a wide band. This technique is likely going to be an order of magnitude faster (at least based on preliminary results) and lower-power, as you only need to capture one set of samples, then let the computer vision do most of the rest. The old way to scan for signals required taking a bunch of RF samples, which was very wasteful of time and energy, but there wasn’t really an alternative until now.

    Anyhoo, all that to say I agree with you. It’s crazy to equate AI’s capabilities and potential to that of crypto.