Skip to content

Pass img_min_params and img_max_params to ctx_clip_params#2133

Merged
LostRuins merged 14 commits intoLostRuins:concedo_experimentalfrom
pi6am:feat/clip-tokens
Apr 16, 2026
Merged

Pass img_min_params and img_max_params to ctx_clip_params#2133
LostRuins merged 14 commits intoLostRuins:concedo_experimentalfrom
pi6am:feat/clip-tokens

Conversation

@pi6am
Copy link
Copy Markdown

@pi6am pi6am commented Apr 14, 2026

These values determine the minimum and maximum size (in tokens) of vision embeddings. The default value of -1 uses a model-dependent default size, for example for Gemma 4 the default is a 280 token embedding. For higher quality results (at the cost of using more memory and slower speed) you can increase the size of the embedding to 1120 tokens.

pi6am added 12 commits July 9, 2024 00:10
These values determine the minimum and maximum size (in
tokens) of vision embeddings. The default value of -1
uses a model-dependent default size, for example for
Gemma 4 the default is a 280 token embedding. For higher
quality results (at the cost of using more memory and
slower speed) you can increase the size of the embedding
to 1120 tokens.
@henk717
Copy link
Copy Markdown
Collaborator

henk717 commented Apr 14, 2026

Personally in favor of this, I know lostruins was planning a more universal option down the line which this shouldn't rule out. But I think these particular vars will be helpful since they will be mentioned in llamacpp guides and are generally highly desired by the community.

@LostRuins LostRuins added the enhancement New feature or request label Apr 15, 2026
@LostRuins
Copy link
Copy Markdown
Owner

looks good

@LostRuins
Copy link
Copy Markdown
Owner

I noticed you added the GUI variable but didn't actually add the GUI element.

I'm thinking we can probably put in on the same row as Visionmaxres

image

I will add it after merging, probably

@pi6am
Copy link
Copy Markdown
Author

pi6am commented Apr 15, 2026

I noticed you added the GUI variable but didn't actually add the GUI element.

I'm thinking we can probably put in on the same row as Visionmaxres

I will add it after merging, probably

Ah, my bad, I always load models from the command line so I forgot this UI existed.

@LostRuins LostRuins merged commit c592bd0 into LostRuins:concedo_experimental Apr 16, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

enhancement New feature or request

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants