Spaces:

CoreyMorris
/

MMLU-by-task-Leaderboard

Running

App Files Files Community

MMLU-by-task-Leaderboard / app.py

Commit History

Aug 19, 2023

17:26
Fixed type error

Corey Morris

e79bcf3
15:03
WIP commit. Currently have nlargest error

Corey Morris

d506f10

Aug 18, 2023

20:12
Updated the last updated date to 18Aug

Corey Morris

42ff7b9

Aug 16, 2023

17:02
Updated description with more models

Corey Morris

7f24726
16:58
fixed error

Corey Morris

d7b89ce
16:57
Added google analytics snippet

Corey Morris

9444cd2

Aug 15, 2023

20:32
Increased size of scatter plot

Corey Morris

2b16774
20:24
Made the radar plot larger

Corey Morris

f52387e
20:19
Moved radar plots to higher in the page

Corey Morris

12a9766
19:58
Modified title and explanation to better reflect what the site is

Corey Morris

18ec1ba

Aug 14, 2023

19:42
Moved radar chart to after analysis

Corey Morris

fb25b1e
19:40
Added a default model to compare

Corey Morris

7b77065
19:32
Improved clarity of explanation for Radar charts

Corey Morris

a450af5
19:29
Fixed some of the diplicate model issue

Corey Morris

618dcce
19:09
Table now displays the columns that have the top differences

Corey Morris

dc21a69
18:53
removed charts with hardcoded tasks. removed hardcoding of model for other charts

Corey Morris

a125eb8
18:11
Finding top differences between tasks from the target model

Corey Morris

627e0f9
17:56
Added explanation for the plot and a dataframe of the models

Corey Morris

2db58a0
17:40
Added radar chart. Compares a model to the 5 models that have the closest performance on MMLU_average

Corey Morris

9695a47

Aug 10, 2023

17:54
Added header back for the table

Corey Morris

2a7f691
17:52
Added citation for the site

Corey Morris

ea8703d
17:33
Changed streamlit to wide layout to see more of the table

Corey Morris

1e6b767
17:26
Updated updated date

Corey Morris

28d4d6a
17:19
Added filter for parameter count. Fixed model filter so that it only filters on the Model name (index of the table)

Corey Morris

8474e43
17:02
Modified the selection of models and evaluations so that most do not show up by default. for a better user experience with 700+ models

Corey Morris

0a33874
16:52
Added search for Model name and Task name

Corey Morris

3abc48f
16:41
Added reasoning for having scatter plots

Corey Morris

cb21769
16:06
Updated title now that there are over 700 open source models in the dataset

Corey Morris

a9f9804

Aug 8, 2023

16:58
Added statement and hypothesis about moral scenarios

Corey Morris

d97426f
16:44
Plots have a default title

Corey Morris

f9a0f38
16:38
Refactor of create_plot

Corey Morris

bdad6e6
16:29
Added finding from moral scenarios about threshold

Corey Morris

1f8cc2a
16:05
Added bar chart for abstract algebra data.

Corey Morris

a79afe8
05:01
Added introduction, links, and reduced the number of plots displayed

Corey Morris

a5fb364

Aug 3, 2023

07:49
Modified download CSV feature so that the index column now has a title of model name

Corey Morris

6a7ad7c
07:45
Added citation

Corey Morris

4fbdb10

Jul 30, 2023

04:29
Add dashed line at the appropriate scale of the largest and smallest values on the plot so that plotly still zooms in to show that

Corey Morris

7ed3839

Jul 27, 2023

00:54
for the custom charts, remove columns with NaN values

Corey Morris

b94ee8f

Jul 24, 2023

16:32
Refactoring. Moved ResultDataProcessor class to a separate file to make it easier to use with experimentation in a jupyter notebook

Corey Morris

843a5ef
16:13
Renamed class. Removed columns that were not useful.

Corey Morris

03ade34
15:47
Moved CSV download to just below the table

Corey Morris

a34a60b
15:20
Added download CSV button

Corey Morris

c90b29a

Jul 23, 2023

22:42
Rename

Corey Morris

e854cb9
22:39
Added custom scatterplot creation

Corey Morris

ca8d4b9
22:29
Improving clarity. Moved MMLU average column to a more appropriate spot

Corey Morris

5129f48
22:24
Hiding filters unless box is selected. Removed model name column because it is the index of the table

Corey Morris

8488477
22:02
Added a scatter plot with just the top 50 performing models on MMLU average

Corey Morris

ca8e784
21:55
added MMLU overall average column. added a few charts comparing more moral reasoning and comparing MMLU overall to other data

Corey Morris

c671de9
21:21
Updated data cleanup so that column names are cleaned up appropriatly with regex=True

Corey Morris

c1a84da
18:37
added a few charts

Corey Morris

ac931c6

Commit History

Aug 19, 2023

Fixed type error

WIP commit. Currently have nlargest error

Aug 18, 2023

Updated the last updated date to 18Aug

Aug 16, 2023

Updated description with more models

fixed error

Added google analytics snippet

Aug 15, 2023

Increased size of scatter plot

Made the radar plot larger

Moved radar plots to higher in the page

Modified title and explanation to better reflect what the site is

Aug 14, 2023

Moved radar chart to after analysis

Added a default model to compare

Improved clarity of explanation for Radar charts

Fixed some of the diplicate model issue

Table now displays the columns that have the top differences

removed charts with hardcoded tasks. removed hardcoding of model for other charts

Finding top differences between tasks from the target model

Added explanation for the plot and a dataframe of the models

Added radar chart. Compares a model to the 5 models that have the closest performance on MMLU_average

Aug 10, 2023

Added header back for the table

Added citation for the site

Changed streamlit to wide layout to see more of the table

Updated updated date

Added filter for parameter count. Fixed model filter so that it only filters on the Model name (index of the table)

Modified the selection of models and evaluations so that most do not show up by default. for a better user experience with 700+ models

Added search for Model name and Task name

Added reasoning for having scatter plots

Updated title now that there are over 700 open source models in the dataset

Aug 8, 2023

Added statement and hypothesis about moral scenarios

Plots have a default title

Refactor of create_plot

Added finding from moral scenarios about threshold

Added bar chart for abstract algebra data.

Added introduction, links, and reduced the number of plots displayed

Aug 3, 2023

Modified download CSV feature so that the index column now has a title of model name

Added citation

Jul 30, 2023

Add dashed line at the appropriate scale of the largest and smallest values on the plot so that plotly still zooms in to show that

Jul 27, 2023

for the custom charts, remove columns with NaN values

Jul 24, 2023

Refactoring. Moved ResultDataProcessor class to a separate file to make it easier to use with experimentation in a jupyter notebook

Renamed class. Removed columns that were not useful.

Moved CSV download to just below the table

Added download CSV button

Jul 23, 2023

Rename

Added custom scatterplot creation

Improving clarity. Moved MMLU average column to a more appropriate spot

Hiding filters unless box is selected. Removed model name column because it is the index of the table

Added a scatter plot with just the top 50 performing models on MMLU average

added MMLU overall average column. added a few charts comparing more moral reasoning and comparing MMLU overall to other data

Updated data cleanup so that column names are cleaned up appropriatly with regex=True

added a few charts