Spaces:

CoreyMorris
/

MMLU-by-task-Leaderboard

Running

App Files Files Community

MMLU-by-task-Leaderboard

Commit History

Sep 3, 2023

15:26
updated gitignore

Corey Morris

76c8220
15:21
updated dev requirements

Corey Morris

5ca617c

Sep 2, 2023

19:13
Extracted plotting functions from moral_app to plotting_utils to improve organization and testability

Corey Morris

2b55a03
17:16
copied main streamlit application to one that will specifically investigate moral reasoning

Corey Morris

298ba1f

Sep 1, 2023

12:11
updated date and model count

Corey Morris

0c07f8b
12:07
updated results

Corey Morris

f1eba6e

Aug 26, 2023

18:32
Added new hugging face results

Corey Morris

3f507e0

Aug 24, 2023

22:22
added a test and removed the code to only test a specific file because that code did not work

Corey Morris

6ed8672
22:10
updated to run submodule update

Corey Morris

25d217c
22:03
Update pytest run to only run specific test files. Other test files are not ready to be run on a different system yet

Corey Morris

9345a86
21:59
Merge branch 'main' of https://github.com/c1505/LLM-Dashboard into main

Corey Morris

0e575e0
20:22
Added additional results

Corey Morris

7863417
20:22
Updated to reflect number of models. Previously, I think there were duplicates

Corey Morris

d396c1e
19:57
Create python-app.yml

Corey

Unverified signature
063ba51
19:37
Updated dependencies

Corey Morris

73da8d6
19:33
Show a random question from the moral scenarios evaluation

Corey Morris

19c7c67
18:51
Returning just a single file per model directory. Manually removing gpt-j-6b for now because there is something that is causing problems with processing the data

Corey Morris

794b32b

Aug 23, 2023

16:26
added new results

Corey Morris

324764c
15:54
TEMPORARY. deleted gpt-j-6b from subdirectory until problems are fixed

Corey Morris

1fef386
15:20
updated results

Corey Morris

aba4fe2
15:18
updated dev requirements

Corey Morris

7681250

Aug 22, 2023

19:44
added dev requirmenents

Corey Morris

885ecf8
18:55
Updated model count

Corey Morris

4f20e65
18:26
Updated contaminated models

Corey Morris

e3863f2
17:43
Added statement of removal of models

Corey Morris

96ffe12
17:40
removed commented code

Corey Morris

7fc9618
17:37
updated update data

Corey Morris

280db99
16:24
removing models that are known to have training data contaminated with evaluations

Corey Morris

a5840fb
16:05
updated with new hugging face results

Corey Morris

916604b

Aug 21, 2023

02:47
updated pipeline and init

Corey Morris

7f2d984
02:01
removed commented code

Corey Morris

2f457d8
02:01
added a test

Corey Morris

a13887a
01:59
shortened file name

Corey Morris

7622af3
01:45
shortened file name

Corey Morris

38d88f9
01:43
using URL as file name

Corey Morris

25b87bf

Aug 20, 2023

23:06
WIP. Updated download file. Can now download all files. Need to integrate that code to loop through all files to download or combine files first into a single dataframe and then save that

Corey Morris

0a77c60
19:41
added new test for a file that currently can be downloaded

Corey Morris

6251f5a
18:56
Replicating 404 error with a test so I can troubleshoot

Corey Morris

9adae3c
18:41
Updated download_file method

Corey Morris

b58e1f0
16:07
Build URL from file path is working

Corey Morris

cc32c4f
15:45
moved methods to better match flow

Corey Morris

f228d38
00:52
removed most commented out code from details processor

Corey Morris

74822dd
00:51
Find files is working as expected

Corey Morris

30fa96a
00:39
WIP commit. Finding files can be identical as the method in results_data_processor.

Corey Morris

c32735e
00:13
added mostly hardcoded generate url method and test

Corey Morris

83a34f0

Aug 19, 2023

22:50
Added download file method and test

Corey Morris

513e813
22:36
Added basic structure of details data processing and testing. For downloading huggingface details dataset files

Corey Morris

ee9e25e
20:40
added todo for test

Corey Morris

9f7d306
20:29
added a TODO

Corey Morris

201a72d
20:23
changed to save and load in a directory

Corey Morris

dd61816

Commit History

Sep 3, 2023

updated gitignore

updated dev requirements

Sep 2, 2023

Extracted plotting functions from moral_app to plotting_utils to improve organization and testability

copied main streamlit application to one that will specifically investigate moral reasoning

Sep 1, 2023

updated date and model count

updated results

Aug 26, 2023

Added new hugging face results

Aug 24, 2023

added a test and removed the code to only test a specific file because that code did not work

updated to run submodule update

Update pytest run to only run specific test files. Other test files are not ready to be run on a different system yet

Merge branch 'main' of https://github.com/c1505/LLM-Dashboard into main

Added additional results

Updated to reflect number of models. Previously, I think there were duplicates

Create python-app.yml

Updated dependencies

Show a random question from the moral scenarios evaluation

Returning just a single file per model directory. Manually removing gpt-j-6b for now because there is something that is causing problems with processing the data

Aug 23, 2023

added new results

TEMPORARY. deleted gpt-j-6b from subdirectory until problems are fixed

updated results

updated dev requirements

Aug 22, 2023

added dev requirmenents

Updated model count

Updated contaminated models

Added statement of removal of models

removed commented code

updated update data

removing models that are known to have training data contaminated with evaluations

updated with new hugging face results

Aug 21, 2023

updated pipeline and init

removed commented code

added a test

shortened file name

shortened file name

using URL as file name

Aug 20, 2023

WIP. Updated download file. Can now download all files. Need to integrate that code to loop through all files to download or combine files first into a single dataframe and then save that

added new test for a file that currently can be downloaded

Replicating 404 error with a test so I can troubleshoot

Updated download_file method

Build URL from file path is working

moved methods to better match flow

removed most commented out code from details processor

Find files is working as expected

WIP commit. Finding files can be identical as the method in results_data_processor.

added mostly hardcoded generate url method and test

Aug 19, 2023

Added download file method and test

Added basic structure of details data processing and testing. For downloading huggingface details dataset files

added todo for test

added a TODO

changed to save and load in a directory