Scan Secret Leaks

Workflow runs for Scan Secret Leaks

• Add option assistant_prefix in the prompt (used for RULER with Instru…

  completed successfully:
  Scan Secret Leaks#100:Commit1d6f2f9pushedbyJeronymous
  main

  Oct 26, 202615s
  More actions for workflow run 100

• Read luciole_rag subsets from the OpenLLM-France datasets

  completed successfully:
  Scan Secret Leaks#99:Commit1388250pushedbyMatteovanypersele
  luciole-rag-refusal-metrics

  Oct 23, 202624s
  More actions for workflow run 99

• fix detection of chat template in the case where the model has revision

  completed successfully:
  Scan Secret Leaks#98:Commit9fc2463pushedbyJeronymous
  merge_hf_main

  Oct 15, 202619s
  More actions for workflow run 98

• fix detection of chat template in the case where the model has revision

  completed successfully:
  Scan Secret Leaks#97:Commite5296c4pushedbyJeronymous
  main

  Oct 15, 202618s
  More actions for workflow run 97

• Remove module-level debug prints in eiffel.py that ran at import

  completed successfully:
  Scan Secret Leaks#96:Commitffcdc66pushedbyJeronymous
  merge_hf_main

  Oct 13, 202616s
  More actions for workflow run 96

• Add RedTeachingBench that will replace SCoolKID (which was the draft)

  completed successfully:
  Scan Secret Leaks#95:Commit64ff47apushedbyJeronymous
  main

  Oct 13, 202619s
  More actions for workflow run 95

• List modifications of the fork

  completed successfully:
  Scan Secret Leaks#94:Commitff50987pushedbyJeronymous
  main

  Oct 8, 202618s
  More actions for workflow run 94

• List modifications of the fork

  completed successfully:
  Scan Secret Leaks#93:Commitccfed63pushedbyJeronymous
  main

  Oct 8, 202619s
  More actions for workflow run 93

• Store community_tasks JSON as regular files instead of Git LFS

  completed successfully:
  Scan Secret Leaks#92:Commit909b9b7pushedbyJeronymous
  main

  Oct 5, 202615s
  More actions for workflow run 92

• Fix thinking budget for Ministral Reasoning (again)

  completed successfully:
  Scan Secret Leaks#91:Commit64494e9pushedbyJeronymous
  main

  Oct 1, 202620s
  More actions for workflow run 91

• Try another version of flores

  completed successfully:
  Scan Secret Leaks#90:Commit53f870cpushedbyJeronymous
  main

  Sep 30, 202627s
  More actions for workflow run 90

• handle [THINK]...[/THINK] tags by default as well

  completed successfully:
  Scan Secret Leaks#89:Commit131b462pushedbyJeronymous
  main

  Sep 28, 202613s
  More actions for workflow run 89

• Make doc.id unique across splits to fix cache collisions on multi-spl…

  completed successfully:
  Scan Secret Leaks#88:Commitb873a4cpushedbyJeronymous
  main

  Sep 25, 202619s
  More actions for workflow run 88

• Fix few-shot CoT for MGSM-rev2

  completed successfully:
  Scan Secret Leaks#87:Commit2b24a5fpushedbyJeronymous
  main

  Sep 24, 202619s
  More actions for workflow run 87

• Keep mgsm-rev2 for all languages: new dataset (CoT few-shot) where av…

  completed successfully:
  Scan Secret Leaks#86:Commit76862dbpushedbyJeronymous
  merge_hf_main

  Sep 24, 202618s
  More actions for workflow run 86

• Merge pull request #10 from OpenLLM-France/mgsm-rev2

  completed successfully:
  Scan Secret Leaks#85:Commit82abc8fpushedbyJeronymous
  main

  Sep 24, 202622s
  More actions for workflow run 85

• Use auto-detected tokenizer_mode (drop duplicate LIGHTEVAL_TOKENIZER_…

  completed successfully:
  Scan Secret Leaks#84:Commit869145fpushedbyJeronymous
  merge_hf_main

  Sep 24, 202616s
  More actions for workflow run 84

• Auto-detect Mistral tokenizer instead of requiring to set environment…

  completed successfully:
  Scan Secret Leaks#83:Commit443aad8pushedbyJeronymous
  main

  Sep 24, 202615s
  More actions for workflow run 83

• Add French BIG-Bench-Hard (bbh_fr) community tasks

  completed successfully:
  Scan Secret Leaks#82:Commit9984a09pushedbyJeronymous
  merge_hf_main

  Sep 24, 202613s
  More actions for workflow run 82

• misc improvements

  completed successfully:
  Scan Secret Leaks#81:Commitda845c8pushedbyJeronymous
  main

  Sep 23, 202615s
  More actions for workflow run 81

• Remove duplicates and renamed task

  completed successfully:
  Scan Secret Leaks#80:Commitcd13a15pushedbycharlotte1399
  main

  Sep 23, 202617s
  More actions for workflow run 80

• Add BLEnD benchmark

  completed successfully:
  Scan Secret Leaks#79:Commitd0320dapushedbyJeronymous
  main

  Sep 23, 202617s
  More actions for workflow run 79

• renamed task

  completed successfully:
  Scan Secret Leaks#78:Commit84c0a8bpushedbycharlotte1399
  main

  Sep 23, 202612s
  More actions for workflow run 78

• Add Include benchmark

  completed successfully:
  Scan Secret Leaks#77:Commit79e7dd7pushedbyJeronymous
  main

  Sep 23, 202622s
  More actions for workflow run 77

• Add Include benchmark

  completed successfully:
  Scan Secret Leaks#76:Commit0c3824cpushedbyJeronymous
  main

  Sep 23, 202617s
  More actions for workflow run 76