The CDN billing system has a performance issue in log system. There are some instances with a load balencer here but they can't handle the peak value.
Because of that, some of the logs are missing and we can't have correctly bill for out customers.
Load balencer
Instance
Instance
Instance
SQL
I did some refactor with microservice & serverless, batch insert and BigQuery.
After that, the log system works fine and also reduce about 70% instance cost.
Cloud function handler
Cloud Function
Cloud Function
Cloud Function
Insert batch pool
BigQuery
I learning Rust & WASM because I need a fast and cross-platform programing language to help JavaScript.
In Tiat2, I replaced some heavy loading JS module (like computer vision or clustering) with Rust and WebAssembly to improve the performance to a different level.
After replace some computer vision JS module into Rust, the Image proccessing is 5x ~10x fast than old version.
In the front-end side, the WASM also improved about 50% performance in clustering.
The bundle size incressed a lot. In node-side, a basic Rust plugin can be many Mbs, and the WASM can be even larger. It's a hard issue when we are trying to build a light & fast web application.