Dispatchable Compute
how to balance microgrids with open-source TT-firmware
Troy Benjegerdes
github.com/tmagik
vimeo.com/7elements
slides.com/troybenjegerdes
<tractor@7el.us> <dahozer@gmail.com>
Agtech: What's old is new again
- 150 acres in Iowa
- generational repair & maintenance requirements
- sustainable biomass for HPC
Future farm robots
In-field repair & model retraining is a first-class design requirement
- RiscV inside (done)
- Industrial InfiniBand (pipeline stalled)
- HPC backend for AI model training (future work)
- Education and rural economic development
- deterministic floating point with posithub.org
- N300d is 60% of my full-sun power budget
RiscV in the network
PolarFire SOC - check
Tenstorrent - check
Nvidia CX7 - check
Title Text
- Bullet One
- Bullet Two
- Bullet Three
Now, change the clock rate...
What would Patterson do?
Can we do architecture research on:
- Intel x86 - NO
- Arm - sure, with an NDA and an architecture license
- RiscV - YES, if you build a whole new instruction set
Can we do dynamic power?
- SiFive U540: freedom-u540-c000-bootloader
- PolarFire SOC: hart-software-services
- Nvidia QM9790 -- ???
- TT-Fabric looks pretty interesting, how do I turn down the SERDES & FEC power.. what about 40G or 10G?
- TT-Firmware: Well, at least it's got a blob
- Biological Intelligence prompt: Open source firmware
[1] Christopher Fleetwood https://fleetwood.dev/posts/domain-specific-architectures
SRAM: more power per bit, less per access
Use the Source Luke!
- Source (or NDA) for TT-firmware
- power-aware compute APIs
- Utility computing for grid balancing[1]
Tenstorrent Microgrid Transformer
vimeo.com/7elements
https://github.com/tmagik
<tractor@7el.us> <dahozer@gmail.com>
More at: https://slides.com/troybenjegerdes