Opening Remarks

The Current State of Building Cutting Edge LLMs

Building the Best Opensource LLM

Going the Distance With Just Prompting ?

The Power of Prompting: https://www.microsoft.com/en-us/research/blog/the-power-of-prompting/ Principled Instructions Are All You Need https://arxiv.org/pdf/2312.16171.pdf

Optimizing For Ground Truth & Expertise: Finetuning & RAG

When to RAG? When to finetune? -Best strategies for both

DPO vs RHLF .. Pros & Cons?

LLM Brain Surgery: Merging, Blending, Trimming...

Pros and cons of model mashups & lobotomy. Performance & Capabilities and Cavaets.

Quaility Data Is A Commodity or the New Oil .. And the Rise of Synthetic Data & Distillation

Ain't So Bad Being GPU Poor? Supercharging Inference (QLORA, Apple, PowerInfer)

Beyond Transformers: SSM & RWKV

The Road to AGI: Planning, Reasoning, Concepts & Q*?