feat: add YouTube knowledge source ingestion and retrieval - #59
feat: add YouTube knowledge source ingestion and retrieval#59chaudharyvinay4 wants to merge 56 commits into
Conversation
Signed-off-by: Madhuravas <madhuravasreddy1998@gmail.com>
Signed-off-by: Madhuravas reddy <madhu@mosip.io>
Signed-off-by: Madhuravas reddy <madhu@mosip.io>
Signed-off-by: Madhuravas reddy <madhu@mosip.io>
issue-15 created apis to sync github apis
Signed-off-by: Madhuravas reddy <madhu@mosip.io>
Signed-off-by: Madhuravas reddy <madhu@mosip.io>
Signed-off-by: Madhuravas reddy <madhu@mosip.io>
Signed-off-by: Madhuravas reddy <madhu@mosip.io>
Signed-off-by: Madhuravas reddy <madhu@mosip.io>
implemented apis for UI data and developed UI pages
Signed-off-by: Mohanraj209 <mohan1715@gmail.com>
Signed-off-by: Mohanraj209 <mohan1715@gmail.com>
Signed-off-by: Mohanraj209 <mohan1715@gmail.com>
Signed-off-by: Mohanraj209 <mohan1715@gmail.com>
Signed-off-by: Mohanraj209 <mohan1715@gmail.com>
Signed-off-by: Mohanraj209 <mohan1715@gmail.com>
Signed-off-by: Mohanraj209 <mohan1715@gmail.com>
Signed-off-by: Mohanraj209 <mohan1715@gmail.com>
Signed-off-by: Mohanraj209 <mohan1715@gmail.com>
Signed-off-by: Mohanraj209 <mohan1715@gmail.com>
…t.lock Signed-off-by: Mohan E <mohanraj1715@gmail.com>
Signed-off-by: Mohanachandran S <mohanachandran.s@technoforte.co.in>
Add MOSIP Nexus AI — production RAG chatbot for MOSIP knowledge base
[MOSIP-44779] Created helm charts for github tracker activity.
Signed-off-by: Mohanachandran S <mohanachandran.s@technoforte.co.in>
Migrated to pgvector and introduced docker compose
Signed-off-by: Jayesh Kharode <jayesh.kharode@technoforte.co.in>
Signed-off-by: Jayesh Kharode <jayesh.kharode@technoforte.co.in>
MOSIP-45242
Signed-off-by: Jayesh Kharode <jayesh.kharode@technoforte.co.in>
Signed-off-by: Jayesh Kharode <jayesh.kharode@technoforte.co.in>
Signed-off-by: Jayesh Kharode <jayesh.kharode@technoforte.co.in>
MOSIP-45244- added origination dropdown
…ation (Fine-Tuning & MCP Integration Changes) Signed-off-by: Mohanachandran S <mohanachandran.s@technoforte.co.in>
Signed-off-by: Jayesh Kharode <jayesh.kharode@technoforte.co.in>
Signed-off-by: Jayesh Kharode <jayesh.kharode@technoforte.co.in>
Signed-off-by: Jayesh Kharode <jayesh.kharode@technoforte.co.in>
Signed-off-by: Jayesh Kharode <jayesh.kharode@technoforte.co.in>
Co-authored-by: Cursor <cursoragent@cursor.com> Signed-off-by: Jayesh Kharode <jayesh.kharode@technoforte.co.in>
Signed-off-by: Jayesh Kharode <jayesh.kharode@technoforte.co.in>
Co-authored-by: Cursor <cursoragent@cursor.com> Signed-off-by: Jayesh Kharode <jayesh.kharode@technoforte.co.in>
Signed-off-by: Jayesh Kharode <jayesh.kharode@technoforte.co.in>
Signed-off-by: Jayesh Kharode <jayesh.kharode@technoforte.co.in>
Signed-off-by: Jayesh Kharode <jayesh.kharode@technoforte.co.in>
MOSIP-45245-Github Trakker add Apis to fetch user details in backend along with roles
Restore pre-PR helm templates and deploy values so chart packaging matches the known-good layout, while keeping RDS/GitHub env wiring and GITHUB_ORG/USER_ROLES in values.yaml so the backend still starts correctly. Signed-off-by: Jayesh Kharode <jayesh.kharode@technoforte.co.in> Co-authored-by: Cursor <cursoragent@cursor.com>
Revert Helm chart template and deploy values changes from PR mosip#52.
Use mosip-helm instead of helm so chart-lint-publish clones the existing mosip/mosip-helm repository. Signed-off-by: Jayesh Kharode <jayesh.kharode@technoforte.co.in> Co-authored-by: Cursor <cursoragent@cursor.com>
Fix chart publish target repo name in CI workflow.
Signed-off-by: Jayesh Kharode <jayesh.kharode@technoforte.co.in>
Signed-off-by: Jayesh Kharode <jayesh.kharode@technoforte.co.in>
MOSIP-45293-Github trakker maintain new apis arc param
MOSIP-45284 - RAG Answer Quality Improvements + Claude Desktop Integration (Fine-Tuning & MCP Integration Changes)
|
Important Review skippedToo many files! This PR contains 190 files, which is 40 over the limit of 150. To get a review, narrow the scope: Upgrade to a paid plan to raise the limit. ⚙️ Run configurationConfiguration used: Organization UI Review profile: ASSERTIVE Plan: Pro Run ID: ⛔ Files ignored due to path filters (20)
📒 Files selected for processing (190)
You can disable this status message by setting the Use the checkbox below for a quick retry:
✨ Finishing Touches🧪 Generate unit tests (beta)
Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out. Comment |
|
Closing this PR because it was created from an incorrect base and included unrelated repository history. The clean replacement PR containing only the YouTube knowledge source integration is: Thank you! |
Summary
This PR adds YouTube as a new knowledge source to MOSIP Nexus, allowing relevant YouTube video transcripts to be indexed, retrieved, and used during response generation.
Changes
YouTube Ingestion
Retrieval
UI
Configuration
Testing
Verified the following:
Example Query
Query
Result
Notes
This change extends the existing multi-source RAG pipeline without affecting existing retrieval functionality.