Deeply examining how large models (GPT-4, Llama-2, etc) are trained and deployed

List of following systems in the notes:

• Torchserve
• LLaVA
• 1 bit LLMs
• Gemini

List of topics:

1. Transformers
2. Quantization
3. MatMul-Free Language Modeling
4. LlaMa from scratch

• Liger Kernels