I hosted Kimi K3 (2.8T parameters) using 8 B300s. 92 tok/s, $190 per million tokens

Key points

1. Cold boot takes around 27 minutes to load the 1.56 TB model at a cost of roughly $56.79 per hour.
2. The experiment shows frontier-scale inference is now accessible but remains expensive outside managed cloud services.