[docs] [template] [data] Refactor current LLM Batch inference template#59897

Open

Aydin-ab wants to merge 70 commits intoray-project:masterfrom

Aydin-ab:docs/data/examples/llm_batch_inference_small

Commits on Nov 12, 2025

move content into content/
Aydin Abiar
committed
make release test ci/ folder
Aydin Abiar
committed
make template workspace configs/ (compute config)
Aydin Abiar
committed
adding release tests
Aydin Abiar
committed
remove README from sphinx discovery
Aydin Abiar
committed
move order in examples.yml
Aydin Abiar
committed
add vocabulary for vale compliance
Aydin Abiar
committed

Commits on Nov 13, 2025

(ci test only) limit size of large dataset to 10k samples instead of full 2M
Aydin Abiar
committed
fix link to notebook in examples.yml
Aydin Abiar
committed
fix prompt
Aydin Abiar
committed
adding to examples.yml
Aydin Abiar
committed
adding release test config
Aydin Abiar
committed
update content with new dataset
Aydin Abiar
committed
add byod for release test
Aydin Abiar
committed
nitpick template vision text
Aydin Abiar
committed
adding llm batch inference vision workspace
Aydin Abiar
committed
refactor content for consistency
Aydin Abiar
committed

Commits on Nov 14, 2025

fix worker node gce
Aydin Abiar
committed
reformat
Aydin Abiar
committed
vale
Aydin Abiar
committed
sphinx orphan for notebook
Aydin Abiar
committed
update image
Aydin Abiar
committed
adding batch inference llm visio nhelper modules
Aydin Abiar
committed
reformat nitpicks
Aydin Abiar
committed
fix issues cursor
Aydin Abiar
committed
fix job config
Aydin Abiar
committed
fix job config for vision tempalte
Aydin Abiar
committed
add datasets to byod
Aydin Abiar
committed
ignore % command cell in ci testing
Aydin Abiar
committed
change compute ocnfigs to L4 instead of L40S
Aydin Abiar
committed

Commits on Nov 17, 2025

min_node 0 now
Aydin Abiar
committed
refactor nitpicks
Aydin Abiar
committed
no engine parameters anymore + add stats() tips
Aydin Abiar
committed
rename variables for scaling section
Aydin Abiar
committed
refactor +rebuild helper modules
Aydin Abiar
committed
Merge branch 'master' into docs/data/examples/llm_batch_inference_small
Aydin-ab
authored
remove saving dataset section (buggy)
Aydin Abiar
committed
fix typoi
Aydin Abiar
committed
fix typoi
Aydin Abiar
committed
sync with notebook
Aydin Abiar
committed

Commits on Nov 19, 2025

suggestions applied
Aydin Abiar
committed

Commits on Nov 24, 2025

increase header leavel of performance tips
Aydin Abiar
committed
ref to anyscale docs
Aydin Abiar
committed
add model parallelism sectioon
Aydin Abiar
committed
add markdwon note about repartition()
Aydin Abiar
committed
ci test on small datset instead of 1M rows
Aydin Abiar
committed

Commits on Nov 26, 2025

add helper conversion script + small nitpicks
Aydin Abiar
committed
apply kunling suggestions
Aydin Abiar
committed

Commits on Dec 8, 2025

Apply suggestions from code review
Aydin-ab
authored

Commits on Jan 6, 2026

Merge branch 'master' into docs/data/examples/llm_batch_inference_small
Aydin-ab
authored
refactor/rename for easier maintainability
Aydin Abiar
committed
follow git bots suggestions
Aydin Abiar
committed
minor gramatical fix
Aydin Abiar
committed

Commits on Jan 8, 2026

apply suggestions: fix detokenize issue, typos, thorough explanation of batch size, concurrency, more refs to docs links, refactor quantization and model parallelism section for more readability, a…
Aydin Abiar
committed
change prompt task to something more relevant to LLM capabilities
Aydin Abiar
committed
fix typos, fix error in nb2py and update byod
Aydin Abiar
committed
add parameter to change dataset size
Aydin Abiar
committed
fix vale errors
Aydin Abiar
committed
fix typo bug + add structured output to text task
Aydin Abiar
committed
fix typo
Aydin Abiar
committed

Commits on Jan 9, 2026

fix structured output bug
Aydin Abiar
committed
remove mention of notebook
Aydin Abiar
committed
reorder examples with more consistent naming/titles
Aydin Abiar
committed
consistent .py script + add informative comments about structured output
Aydin Abiar
committed
fix header typo
Aydin Abiar
committed
remove detokenize=
Aydin Abiar
committed

Commits on Jan 12, 2026

Merge branch 'master' into docs/data/examples/llm_batch_inference_small
Aydin-ab
authored

Commits on Jan 14, 2026

make files more consistent from their notebooks
Aydin Abiar
committed
fix imports in line + doc style nitpicks
Aydin Abiar
committed

Commits on Jan 15, 2026

Merge branch 'master' into docs/data/examples/llm_batch_inference_small
Aydin-ab
authored