You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
use your model to generate all the results. For other tasks, run the coir package to directly obtain the results. For CodeSearchNet and CodeSearchNet-CCR, you will get results for six programming languages, namely Codesearchnet-go,Codesearchnet-java,xxx and CodeSearchNet-ccr-go, CodeSearchNet-ccr-java,xxx respectively. This will result in a total of 12 files. You need to calculate the average for all sub-tasks within these two tasks separately.
2.Create a new issue in the repository with the following format:
title: upload new model performance
content:
{"Model": "Contriever", "Model Size (Million Parameters)": 110, "URL": "https://huggingface.co/facebook/contriever-msmarco",
"Apps": 5.14, "CosQA": 14.21, "Synthetic Text2sql":45.46, "CodeSearchNet": 34.72,
"CodeSearchNet-CCR": 35.74, "CodeTrans-Contest": 44.16, "CodeTrans-DL": 24.21,
"StackOverFlow QA": 66.05, "CodeFeedBack-ST": 55.11, "CodeFeedBack-MT": 39.23, "Avg": 36.40}
3.The repository administrator will update the results on the website.
The text was updated successfully, but these errors were encountered:
2.Create a new issue in the repository with the following format:
title: upload new model performance
content:
{"Model": "Contriever", "Model Size (Million Parameters)": 110, "URL": "https://huggingface.co/facebook/contriever-msmarco",
"Apps": 5.14, "CosQA": 14.21, "Synthetic Text2sql":45.46, "CodeSearchNet": 34.72,
"CodeSearchNet-CCR": 35.74, "CodeTrans-Contest": 44.16, "CodeTrans-DL": 24.21,
"StackOverFlow QA": 66.05, "CodeFeedBack-ST": 55.11, "CodeFeedBack-MT": 39.23, "Avg": 36.40}
3.The repository administrator will update the results on the website.
The text was updated successfully, but these errors were encountered: