Skip to content

Embeddings: tests, new apis and return type fix - #108

Merged
donhardman merged 7 commits into
masterfrom
fix/embedding-lib
Aug 25, 2025
Merged

donhardman merged 7 commits into
masterfrom
fix/embedding-lib

Conversation

@donhardman

Copy link
Copy Markdown
Member

No description provided.

@CLAassistant

CLAassistant commented Aug 17, 2025 •

Copy link
Copy Markdown

CLA assistant check
All committers have signed the CLA.

@github-actions

github-actions Bot commented Aug 17, 2025 •

Copy link
Copy Markdown

Linux debug test results

  8 files    8 suites   11m 25s ⏱️
488 tests 469 ✅ 19 💤 0 ❌
502 runs  483 ✅ 19 💤 0 ❌

Results for commit 7b3e281.

♻️ This comment has been updated with latest results.

@github-actions

github-actions Bot commented Aug 17, 2025 •

Copy link
Copy Markdown

Windows test results

  5 files    5 suites   16m 14s ⏱️
471 tests 452 ✅ 19 💤 0 ❌
479 runs  460 ✅ 19 💤 0 ❌

Results for commit 7b3e281.

♻️ This comment has been updated with latest results.

@github-actions

github-actions Bot commented Aug 17, 2025 •

Copy link
Copy Markdown

Linux release test results

  8 files    8 suites   6m 23s ⏱️
488 tests 469 ✅ 19 💤 0 ❌
502 runs  483 ✅ 19 💤 0 ❌

Results for commit 7b3e281.

♻️ This comment has been updated with latest results.

- Add comprehensive unit and integration tests for models, errors,
  FFI, memory management, and concurrency
- Fix error type display and propagation for clarity and robustness
- Improve code formatting, imports, and test module organization
- Add INSTRUCTIONS.md with usage, error handling, and testing guidance
- Update .gitignore to exclude cache and relative directories
- Add GitHub Actions job to run clippy with warnings as errors
- Enforce code formatting check with cargo fmt
- Run unit tests and conditional OpenAI integration tests
- Cache cargo dependencies for faster workflow runs
- Make build job depend on successful quality checks
- Support multiple Jina and Voyage model variants
- Implement API key and model validation
- Define hidden size and max input length per model
- Add prediction support and error handling
- Add comprehensive unit and integration tests
- Update CI to conditionally run Jina and Voyage tests

@glookka glookka left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I updated knn code to load library v2. However, the issue is still there - when trying to generate embeddings, the library returns an empty vector (an error is expected).

@glookka

glookka commented Aug 19, 2025

Copy link
Copy Markdown
Contributor

quality checks fail

- Add detailed error code mapping for Jina and Voyage API responses
- Handle alternative error formats with specific LibError variants
- Validate non-empty embeddings and individual embedding dimensions for Jina and Voyage
- Add result presence checks and error returns in local model embedding aggregation
- Fix unwrap calls to safely handle missing or invalid numeric values in embeddings
@sanikolaev

Copy link
Copy Markdown
Collaborator

Blocked by #102

@donhardman
donhardman merged commit 4fd4f52 into master Aug 25, 2025
sanikolaev pushed a commit to manticoresoftware/manticoresearch that referenced this pull request Aug 27, 2025
Bumps MCL version in deps.txt to 8.0.3 which includes a couple fixes related with auto-embeddigs. Related PRs:
8.0.2 - manticoresoftware/columnar#109
8.0.3 - manticoresoftware/columnar#108
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants