Skip to content

Commit

Permalink
rename results to evals
Browse files Browse the repository at this point in the history
  • Loading branch information
mlabonne committed Apr 4, 2024
1 parent 7e583d5 commit ba55b76
Showing 1 changed file with 2 additions and 2 deletions.
4 changes: 2 additions & 2 deletions runpod.sh
Original file line number Diff line number Diff line change
Expand Up @@ -201,11 +201,11 @@ elif [ "$BENCHMARK" == "eq-bench" ]; then
--tasks eq_bench \
--num_fewshot 0 \
--batch_size auto \
--output_path ./results/${benchmark}.json
--output_path ./evals/${benchmark}.json

end=$(date +%s)

python ../llm-autoeval/main.py ./results $(($end-$start))
python ../llm-autoeval/main.py ./evals $(($end-$start))

else
echo "Error: Invalid BENCHMARK value. Please set BENCHMARK to 'nous', 'openllm', or 'lighteval'."
Expand Down

0 comments on commit ba55b76

Please sign in to comment.