model: Add PaddleOCR-VL model support (#18825)

* support PaddleOCR-VL

* clip: update PaddleOCR model loader parameters to prevent OOM during warmup

* [update] add paddleocr vl text model instead of ernie4.5

* [update] restore change of minicpmv

* [update] format

* [update] format

* [update] positions and patch merge permute

* [update] mtmd_decode_use_mrope for paddleocr

* [update] image min/max pixels

* [update] remove set_limit_image_tokens

* upate: preprocess without padding

* clean up

* Update convert_hf_to_gguf.py

Co-authored-by: Sigbjørn Skjæret <sigbjorn.skjaeret@scala.com>

* Update convert_hf_to_gguf.py

Co-authored-by: Sigbjørn Skjæret <sigbjorn.skjaeret@scala.com>

---------

Co-authored-by: Xuan Son Nguyen <son@huggingface.co>
Co-authored-by: Sigbjørn Skjæret <sigbjorn.skjaeret@scala.com>

This commit is contained in:

megemini

2026-02-19 17:05:25 +01:00

committed by

GitHub

co-authored by

Sigbjørn Skjæret

Xuan Son Nguyen

parent abb9f3c42b

commit 237958db33

16 changed files with 327 additions and 0 deletions

									
										tools/mtmd/CMakeLists.txt
									
		+1
		
												View File
												
				@@ -24,6 +24,7 @@ add_library(mtmd

				            models/llama4.cpp

				            models/llava.cpp

				            models/minicpmv.cpp

				            models/paddleocr.cpp

				            models/pixtral.cpp

				            models/qwen2vl.cpp

				            models/qwen3vl.cpp