Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Recreate numbers in table 2 #9

Open
crazysal opened this issue Aug 16, 2021 · 3 comments
Open

Recreate numbers in table 2 #9

crazysal opened this issue Aug 16, 2021 · 3 comments

Comments

@crazysal
Copy link

Hi,
is there an evaluation script to re-create numbers of table 2 from paper.

The test_pipe_type_cloud.py only gives json as output. Where are the eval metrics ?

@crazysal
Copy link
Author

This would be really helpful.
Used pre-trained models to benchmark on https://chartinfo.github.io/
the performance score is 0.34 (task 6b) for line charts specifically where their and your metrics described in the paper match exactly.

@xuewenyuan
Copy link

@crazysal how about the score of task 6a

@crazysal
Copy link
Author

crazysal commented Jul 4, 2023

out of box is 0.73

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants