BYOC:Bring Your Own Codegen To TVM

 

  • Implement your own codegen and register it as a Relay backend compiler to support your hardware device/library
  • Usefull when hardware already has a well-optimized C/C++ library
  • By default only support TVM Relay IR representation,
  • Option to implement graph parsers, If using other graph representation

// Codegen example here

  • Once custom codegen registered with a tag toTVM Backend, any subgraph annotated with this tag will be offloaded to the hardware
  • Any optimization have to be incorporated in the Codegen, BYOC does not optimze code by default.
  • AutoTVM only helps in systematically exploring the search space, by specifying tunable knobs

End

deck

By Aghin Shah