The Inference Engineering Masterclass — Philip Kiely & Ali Taha, Baseten
In this episode, Philip Kiely and Ali Taha from Baseten discuss the complexities and innovations in inference engineering for large AI models. They cover topics including model deployment, speculative decoding, quantization, hardware optimi…