Serving LLMs
Summary of notes, taken from Efficiently Serving LLMs from deeplearning.ai
Autoregressive Generation:
How does a Causal Language Model work?
1) Loading the LLM & Tokenizer
from transformers import AutoModelForCausalLM, AutoTokenizer
model_name