-
-
Notifications
You must be signed in to change notification settings - Fork 200
Description
The best way to export basic benchmarking suite information to LaTeX is current using pandas' to_latex function. Something like:
import openml
suite = openml.study.get_suite(271)
tasks = [openml.tasks.get_task(tid, download_data=False, download_qualities=False) for tid in suite.tasks]
metadata = openml.datasets.list_datasets(data_id=[t.dataset_id for t in tasks], output_format="DataFrame")
metadata.style.to_latex("my-table.tex")It would be nice if we can make this easily available. However, I don't think exporting latex exports natively is the right call. It will produce a lot of overhead (e.g., selecting columns, forwarding arguments to to_latex which may be deprecate in the future, etc.).
I think our primary mode of support for this feature should be to include an example in the documentation on how to achieve this (including some simple styling examples). However, I do think we could add the function (or lazy property) of suite.metadata which returns the dataframe that is generated above (with some added task information). This allows for quick generation of LaTeX tables on the one hand while minimizing the support we would need to give for output customization on the other.
@mfeurer we discussed the functionality before, thoughts?