Motivation

https://www.langchain.com/stateofaiagents

Report Generation

Build a multi-agent system for high quality report generation:

Llama3.3 x NVIDIA NIM

New model from Meta

• Comparable performance to 405B with 6x LESSER parameters
• https://www.reddit.com/r/LocalLLaMA/comments/1h85tt4/meta_releases_llama33_70b/

Inference provided by NVIDIA NIM

• https://developer.nvidia.com/nim?ncid=no-ncid

https://huggingface.co/meta-llama/Llama-3.3-70B-Instruct

Cookbook

• Notebook

https://github.com/langchain-ai/langchain-nvidia/blob/main/cookbook/structured_report_generation.ipynb

• Notebook has link to NVIDIA Launchable w/ GPU

NVIDIA Launchables are links to deploy this notebook on a GPU with 1-click. 
- GPU is provided
- Enviornment is pre-configured