[Epic] Preference Tuning Support

[ktam3]

Tasks Needed:

First Phase:

• Preference Tuning: Add support for pairwise data and contrastive loss #337
• Preference Tuning: vllm throughput analysis for tenser parallelism vs. data parallelism #338
  - Pre req to SDG implementation

Second Phase:

• Add support for preference tuning pipelines sdg#376

Third Phase:
CLI:

• Add command support for preference tuning instructlab#2643
• Add support for additional training arg to specify preference tuning task instructlab#2644

Mustafa is currently taking point on this with Akash's team

[github-actions]

This issue has been automatically marked as stale because it has not had activity within 90 days. It will be automatically closed if no further activity occurs within 30 days.