Is this the easiest way to use VLMs for RAG? #llm #rag #retrievalaugmentedgeneration

This week I learned how hard it is coding in VS Code in 1080×1920 format.

But…I also learned how to use Docling for getting your docs ready for LLMs.

In this I show how to do it in a single command…RUNNING ON A MACBOOK

YES! No hardcore GPUs and its insanely fast.

I did a bunch more tests including extracting Lilian Weng’s Reward Hacking article and it was actually pretty good. Setup is literally
“””
# create a uv environment
uv init
# install deps
uv add docling mlx-vlm transformers
# convert away
uv run docling –to md –pipeline vlm –vlm-model granite_docling “yourfilehere.whatever”
“””

source