Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

files2rouge tests fail due to not finding installed XML::Parser module #53

Open
samfux84 opened this issue Mar 28, 2022 · 0 comments
Open

files2rouge tests fail due to not finding installed XML::Parser module #53

samfux84 opened this issue Mar 28, 2022 · 0 comments

Comments

@samfux84
Copy link

Hi,

I am trying to install files2rouge and encounter some problems with running the tests.

I am using a Perl 5.24.1 installation which is not installed in /usr/. Therefore I have replaced

#!/usr/bin/perl -w

in all of your perl scripts with

#!/usr/bin/env perl

as on our HPC cluster we don't use software installed through the package manager of the operating system

As you can see below, I can use the XML::Parser and @inc contains the paths required for using the XML::Parser package:

[sfux@eu-login-41 ~]$ module list

Currently Loaded Modules:
  1) StdEnv   2) gcc/6.3.0   3) openblas/0.2.20   4) python/3.8.5   5) perl/5.24.1   6) perl-xml-parser/2.44



[sfux@eu-login-41 ~]$ perl -e "use XML::Parser"
[sfux@eu-login-41 ~]$ perl -e "print \"@INC\""
/cluster/apps/gcc-6.3.0/perl-xml-parser-2.44-vex26qd6ng56dplf2gurx522mr45bkmr/lib/perl5/x86_64-linux /cluster/apps/gcc-6.3.0/perl-xml-parser-2.44-vex26qd6ng56dplf2gurx522mr45bkmr/lib/perl5 /cluster/spack/apps/linux-centos7-x86_64/gcc-6.3.0/perl-5.24.1-ldxzqmuecffm6spae6bclbzzplttud3a/lib/perl5 /cluster/spack/apps/linux-centos7-x86_64/gcc-6.3.0/perl-5.24.1-ldxzqmuecffm6spae6bclbzzplttud3a/lib/site_perl/5.24.1/x86_64-linux /cluster/spack/apps/linux-centos7-x86_64/gcc-6.3.0/perl-5.24.1-ldxzqmuecffm6spae6bclbzzplttud3a/lib/site_perl/5.24.1 /cluster/spack/apps/linux-centos7-x86_64/gcc-6.3.0/perl-5.24.1-ldxzqmuecffm6spae6bclbzzplttud3a/lib/5.24.1/x86_64-linux /cluster/spack/apps/linux-centos7-x86_64/gcc-6.3.0/perl-5.24.1-ldxzqmuecffm6spae6bclbzzplttud3a/lib/5.24.1 .
[sfux@eu-login-41 ~]$

But when I run the files2rouge tests, then the XML::Parser package is not found:

[sfux@eu-login-41 ~]$ python -m pyrouge.test
2022-03-28 15:14:53,674 [MainThread  ] [INFO ]  Written ROUGE configuration to /tmp/tmpib1iv3gn/rouge_conf.xml
.2022-03-28 15:14:53,763 [MainThread  ] [INFO ]  Processing files in data/SL2003_models_plain_text.
2022-03-28 15:14:53,764 [MainThread  ] [INFO ]  Processing SL.P.10.R.A.SL062003-01.html.
2022-03-28 15:14:53,764 [MainThread  ] [INFO ]  Processing SL.P.10.R.A.SL062003-02.html.
2022-03-28 15:14:53,765 [MainThread  ] [INFO ]  Processing SL.P.10.R.A.SL062003-03.html.
2022-03-28 15:14:53,765 [MainThread  ] [INFO ]  Processing SL.P.10.R.A.SL062003-04.html.
2022-03-28 15:14:53,766 [MainThread  ] [INFO ]  Processing SL.P.10.R.A.SL062003-05.html.
2022-03-28 15:14:53,766 [MainThread  ] [INFO ]  Processing SL.P.10.R.A.SL062003-06.html.
2022-03-28 15:14:53,766 [MainThread  ] [INFO ]  Processing SL.P.10.R.A.SL062003-07.html.
2022-03-28 15:14:53,767 [MainThread  ] [INFO ]  Processing SL.P.10.R.A.SL062003-08.html.
2022-03-28 15:14:53,767 [MainThread  ] [INFO ]  Processing SL.P.10.R.A.SL062003-09.html.
2022-03-28 15:14:53,768 [MainThread  ] [INFO ]  Processing SL.P.10.R.A.SL062003-10.html.
2022-03-28 15:14:53,768 [MainThread  ] [INFO ]  Processing SL.P.10.R.A.SL062003-11.html.
2022-03-28 15:14:53,768 [MainThread  ] [INFO ]  Processing SL.P.10.R.A.SL062003-12.html.
2022-03-28 15:14:53,769 [MainThread  ] [INFO ]  Processing SL.P.10.R.A.SL062003-13.html.
2022-03-28 15:14:53,769 [MainThread  ] [INFO ]  Processing SL.P.10.R.A.SL062003-14.html.
2022-03-28 15:14:53,770 [MainThread  ] [INFO ]  Processing SL.P.10.R.A.SL062003-15.html.
2022-03-28 15:14:53,770 [MainThread  ] [INFO ]  Processing SL.P.10.R.A.SL062003-16.html.
2022-03-28 15:14:53,770 [MainThread  ] [INFO ]  Processing SL.P.10.R.A.SL062003-17.html.
2022-03-28 15:14:53,771 [MainThread  ] [INFO ]  Processing SL.P.10.R.A.SL062003-18.html.
2022-03-28 15:14:53,771 [MainThread  ] [INFO ]  Processing SL.P.10.R.A.SL062003-19.html.
2022-03-28 15:14:53,772 [MainThread  ] [INFO ]  Processing SL.P.10.R.A.SL062003-20.html.
2022-03-28 15:14:53,772 [MainThread  ] [INFO ]  Processing SL.P.10.R.A.SL062003-21.html.
2022-03-28 15:14:53,773 [MainThread  ] [INFO ]  Processing SL.P.10.R.A.SL062003-22.html.
2022-03-28 15:14:53,773 [MainThread  ] [INFO ]  Processing SL.P.10.R.A.SL062003-23.html.
2022-03-28 15:14:53,773 [MainThread  ] [INFO ]  Processing SL.P.10.R.A.SL062003-24.html.
2022-03-28 15:14:53,774 [MainThread  ] [INFO ]  Processing SL.P.10.R.A.SL062003-25.html.
2022-03-28 15:14:53,774 [MainThread  ] [INFO ]  Saved processed files to /tmp/tmp1ulsphvz.
.2022-03-28 15:14:53,795 [MainThread  ] [INFO ]  Written ROUGE configuration to /tmp/tmp8hsq6f62/rouge_conf.xml
2022-03-28 15:14:53,795 [MainThread  ] [INFO ]  Running ROUGE with command /cluster/apps/nss/gcc-6.3.0/python/3.8.5/x86_64/lib64/python3.8/site-packages/files2rouge-2.1.0-py3.8.egg/additional_files/ROUGE-1.5.5.pl -e /cluster/apps/nss/gcc-6.3.0/python/3.8.5/x86_64/lib64/python3.8/site-packages/files2rouge-2.1.0-py3.8.egg/additional_files/data -c 95 -2 -1 -U -r 1000 -n 4 -w 1.2 -a /tmp/tmp8hsq6f62/rouge_conf.xml
Can't locate XML/Parser.pm in @INC (@INC contains: /cluster/apps/nss/gcc-6.3.0/python/3.8.5/x86_64/lib64/python3.8/site-packages/files2rouge-2.1.0-py3.8.egg/additional_files /usr/local/lib64/perl5 /usr/local/share/perl5 /usr/lib64/perl5/vendor_perl /usr/share/perl5/vendor_perl /usr/lib64/perl5 /usr/share/perl5 .) at /cluster/apps/nss/gcc-6.3.0/python/3.8.5/x86_64/lib64/python3.8/site-packages/files2rouge-2.1.0-py3.8.egg/additional_files/XML/DOM.pm line 41.
BEGIN failed--compilation aborted at /cluster/apps/nss/gcc-6.3.0/python/3.8.5/x86_64/lib64/python3.8/site-packages/files2rouge-2.1.0-py3.8.egg/additional_files/XML/DOM.pm line 70.
Compilation failed in require at /cluster/apps/nss/gcc-6.3.0/python/3.8.5/x86_64/lib64/python3.8/site-packages/files2rouge-2.1.0-py3.8.egg/additional_files/ROUGE-1.5.5.pl line 177.
BEGIN failed--compilation aborted at /cluster/apps/nss/gcc-6.3.0/python/3.8.5/x86_64/lib64/python3.8/site-packages/files2rouge-2.1.0-py3.8.egg/additional_files/ROUGE-1.5.5.pl line 177.
E2022-03-28 15:14:54,020 [MainThread  ] [INFO ]  Processing files in data/SL2003_models_rouge_format.
2022-03-28 15:14:54,021 [MainThread  ] [INFO ]  Processing SL.P.10.R.A.SL062003-01.html.
/cluster/apps/nss/gcc-6.3.0/python/3.8.5/x86_64/bin/pyrouge_convert_rouge_format_to_plain_text:14: GuessedAtParserWarning: No parser was explicitly specified, so I'm using the best available HTML parser for this system ("lxml"). This usually isn't a problem, but if you run this code on another system, or in a different virtual environment, it may use a different parser and behave differently.

The code that caused this warning is on line 14 of the file /cluster/apps/nss/gcc-6.3.0/python/3.8.5/x86_64/bin/pyrouge_convert_rouge_format_to_plain_text. To get rid of this warning, pass the additional argument 'features="lxml"' to the BeautifulSoup constructor.

  soup = BeautifulSoup(html)
2022-03-28 15:14:54,022 [MainThread  ] [INFO ]  Processing SL.P.10.R.A.SL062003-02.html.
2022-03-28 15:14:54,023 [MainThread  ] [INFO ]  Processing SL.P.10.R.A.SL062003-03.html.
2022-03-28 15:14:54,023 [MainThread  ] [INFO ]  Processing SL.P.10.R.A.SL062003-04.html.
2022-03-28 15:14:54,024 [MainThread  ] [INFO ]  Processing SL.P.10.R.A.SL062003-05.html.
2022-03-28 15:14:54,025 [MainThread  ] [INFO ]  Processing SL.P.10.R.A.SL062003-06.html.
2022-03-28 15:14:54,026 [MainThread  ] [INFO ]  Processing SL.P.10.R.A.SL062003-07.html.
2022-03-28 15:14:54,026 [MainThread  ] [INFO ]  Processing SL.P.10.R.A.SL062003-08.html.
2022-03-28 15:14:54,027 [MainThread  ] [INFO ]  Processing SL.P.10.R.A.SL062003-09.html.
2022-03-28 15:14:54,028 [MainThread  ] [INFO ]  Processing SL.P.10.R.A.SL062003-10.html.
2022-03-28 15:14:54,029 [MainThread  ] [INFO ]  Processing SL.P.10.R.A.SL062003-11.html.
2022-03-28 15:14:54,029 [MainThread  ] [INFO ]  Processing SL.P.10.R.A.SL062003-12.html.
2022-03-28 15:14:54,030 [MainThread  ] [INFO ]  Processing SL.P.10.R.A.SL062003-13.html.
2022-03-28 15:14:54,031 [MainThread  ] [INFO ]  Processing SL.P.10.R.A.SL062003-14.html.
2022-03-28 15:14:54,032 [MainThread  ] [INFO ]  Processing SL.P.10.R.A.SL062003-15.html.
2022-03-28 15:14:54,032 [MainThread  ] [INFO ]  Processing SL.P.10.R.A.SL062003-16.html.
2022-03-28 15:14:54,033 [MainThread  ] [INFO ]  Processing SL.P.10.R.A.SL062003-17.html.
2022-03-28 15:14:54,034 [MainThread  ] [INFO ]  Processing SL.P.10.R.A.SL062003-18.html.
2022-03-28 15:14:54,035 [MainThread  ] [INFO ]  Processing SL.P.10.R.A.SL062003-19.html.
2022-03-28 15:14:54,035 [MainThread  ] [INFO ]  Processing SL.P.10.R.A.SL062003-20.html.
2022-03-28 15:14:54,036 [MainThread  ] [INFO ]  Processing SL.P.10.R.A.SL062003-21.html.
2022-03-28 15:14:54,037 [MainThread  ] [INFO ]  Processing SL.P.10.R.A.SL062003-22.html.
2022-03-28 15:14:54,038 [MainThread  ] [INFO ]  Processing SL.P.10.R.A.SL062003-23.html.
2022-03-28 15:14:54,038 [MainThread  ] [INFO ]  Processing SL.P.10.R.A.SL062003-24.html.
2022-03-28 15:14:54,039 [MainThread  ] [INFO ]  Processing SL.P.10.R.A.SL062003-25.html.
2022-03-28 15:14:54,040 [MainThread  ] [INFO ]  Saved processed files to /tmp/tmpxg0p7eek.
.2022-03-28 15:14:54,147 [MainThread  ] [INFO ]  Writing summaries.
2022-03-28 15:14:54,148 [MainThread  ] [INFO ]  Processing summaries. Saving system files to /tmp/tmpjpsm5yin/system and model files to /tmp/tmpjpsm5yin/model.
2022-03-28 15:14:54,148 [MainThread  ] [INFO ]  Processing files in data/systems_plain.
2022-03-28 15:14:54,148 [MainThread  ] [INFO ]  Processing D30001.M.100.T.A.
2022-03-28 15:14:54,149 [MainThread  ] [INFO ]  Processing D30002.M.100.T.A.
2022-03-28 15:14:54,149 [MainThread  ] [INFO ]  Processing D30003.M.100.T.A.
2022-03-28 15:14:54,150 [MainThread  ] [INFO ]  Processing D30005.M.100.T.A.
2022-03-28 15:14:54,150 [MainThread  ] [INFO ]  Saved processed files to /tmp/tmpjpsm5yin/system.
2022-03-28 15:14:54,150 [MainThread  ] [INFO ]  Processing files in data/models_plain.
2022-03-28 15:14:54,151 [MainThread  ] [INFO ]  Processing D30001.M.100.T.B.
2022-03-28 15:14:54,151 [MainThread  ] [INFO ]  Processing D30001.M.100.T.C.
2022-03-28 15:14:54,152 [MainThread  ] [INFO ]  Processing D30001.M.100.T.D.
2022-03-28 15:14:54,152 [MainThread  ] [INFO ]  Processing D30002.M.100.T.B.
2022-03-28 15:14:54,153 [MainThread  ] [INFO ]  Processing D30002.M.100.T.C.
2022-03-28 15:14:54,153 [MainThread  ] [INFO ]  Processing D30002.M.100.T.E.
2022-03-28 15:14:54,153 [MainThread  ] [INFO ]  Processing D30003.M.100.T.B.
2022-03-28 15:14:54,154 [MainThread  ] [INFO ]  Processing D30003.M.100.T.C.
2022-03-28 15:14:54,154 [MainThread  ] [INFO ]  Processing D30003.M.100.T.F.
2022-03-28 15:14:54,155 [MainThread  ] [INFO ]  Processing D30005.M.100.T.B.
2022-03-28 15:14:54,155 [MainThread  ] [INFO ]  Processing D30005.M.100.T.C.
2022-03-28 15:14:54,155 [MainThread  ] [INFO ]  Processing D30005.M.100.T.G.
2022-03-28 15:14:54,156 [MainThread  ] [INFO ]  Saved processed files to /tmp/tmpjpsm5yin/model.
2022-03-28 15:14:54,157 [MainThread  ] [INFO ]  Written ROUGE configuration to /tmp/tmprks3vxw9/rouge_conf.xml
2022-03-28 15:14:54,157 [MainThread  ] [INFO ]  Running ROUGE with command /cluster/apps/nss/gcc-6.3.0/python/3.8.5/x86_64/lib64/python3.8/site-packages/files2rouge-2.1.0-py3.8.egg/additional_files/ROUGE-1.5.5.pl -e /cluster/apps/nss/gcc-6.3.0/python/3.8.5/x86_64/lib64/python3.8/site-packages/files2rouge-2.1.0-py3.8.egg/additional_files/data -c 90 -2 -1 -U -r 1000 -n 2 -w 1.2 -a -m data/config_test2.xml /tmp/tmprks3vxw9/rouge_conf.xml
Can't locate XML/Parser.pm in @INC (@INC contains: /cluster/apps/nss/gcc-6.3.0/python/3.8.5/x86_64/lib64/python3.8/site-packages/files2rouge-2.1.0-py3.8.egg/additional_files /usr/local/lib64/perl5 /usr/local/share/perl5 /usr/lib64/perl5/vendor_perl /usr/share/perl5/vendor_perl /usr/lib64/perl5 /usr/share/perl5 .) at /cluster/apps/nss/gcc-6.3.0/python/3.8.5/x86_64/lib64/python3.8/site-packages/files2rouge-2.1.0-py3.8.egg/additional_files/XML/DOM.pm line 41.
BEGIN failed--compilation aborted at /cluster/apps/nss/gcc-6.3.0/python/3.8.5/x86_64/lib64/python3.8/site-packages/files2rouge-2.1.0-py3.8.egg/additional_files/XML/DOM.pm line 70.
Compilation failed in require at /cluster/apps/nss/gcc-6.3.0/python/3.8.5/x86_64/lib64/python3.8/site-packages/files2rouge-2.1.0-py3.8.egg/additional_files/ROUGE-1.5.5.pl line 177.
BEGIN failed--compilation aborted at /cluster/apps/nss/gcc-6.3.0/python/3.8.5/x86_64/lib64/python3.8/site-packages/files2rouge-2.1.0-py3.8.egg/additional_files/ROUGE-1.5.5.pl line 177.
Traceback (most recent call last):
  File "/cluster/apps/nss/gcc-6.3.0/python/3.8.5/x86_64/bin/pyrouge_evaluate_plain_text_files", line 25, in <module>
    main()
  File "/cluster/apps/nss/gcc-6.3.0/python/3.8.5/x86_64/bin/pyrouge_evaluate_plain_text_files", line 21, in main
    output = rouge.convert_and_evaluate(args.system_id, args.split_sents)
  File "/cluster/apps/nss/gcc-6.3.0/python/3.8.5/x86_64/lib64/python3.8/site-packages/pyrouge/Rouge155.py", line 368, in convert_and_evaluate
    rouge_output = self.evaluate(system_id, rouge_args)
  File "/cluster/apps/nss/gcc-6.3.0/python/3.8.5/x86_64/lib64/python3.8/site-packages/pyrouge/Rouge155.py", line 343, in evaluate
    rouge_output = check_output(command, env=env).decode("UTF-8")
  File "/cluster/apps/nss/gcc-6.3.0/python/3.8.5/x86_64/lib64/python3.8/subprocess.py", line 411, in check_output
    return run(*popenargs, stdout=PIPE, timeout=timeout, check=True,
  File "/cluster/apps/nss/gcc-6.3.0/python/3.8.5/x86_64/lib64/python3.8/subprocess.py", line 512, in run
    raise CalledProcessError(retcode, process.args,
subprocess.CalledProcessError: Command '['/cluster/apps/nss/gcc-6.3.0/python/3.8.5/x86_64/lib64/python3.8/site-packages/files2rouge-2.1.0-py3.8.egg/additional_files/ROUGE-1.5.5.pl', '-e', '/cluster/apps/nss/gcc-6.3.0/python/3.8.5/x86_64/lib64/python3.8/site-packages/files2rouge-2.1.0-py3.8.egg/additional_files/data', '-c', '90', '-2', '-1', '-U', '-r', '1000', '-n', '2', '-w', '1.2', '-a', '-m', 'data/config_test2.xml', '/tmp/tmprks3vxw9/rouge_conf.xml']' returned non-zero exit status 2.
E.2022-03-28 15:14:54,264 [MainThread  ] [INFO ]  Writing summaries.
2022-03-28 15:14:54,264 [MainThread  ] [INFO ]  Processing summaries. Saving system files to /tmp/tmpwd3ysnud/system and model files to /tmp/tmpwd3ysnud/model.
2022-03-28 15:14:54,264 [MainThread  ] [INFO ]  Processing files in data/systems_plain.
2022-03-28 15:14:54,265 [MainThread  ] [INFO ]  Processing D30001.M.100.T.A.
2022-03-28 15:14:54,265 [MainThread  ] [INFO ]  Processing D30002.M.100.T.A.
2022-03-28 15:14:54,270 [MainThread  ] [INFO ]  Processing D30003.M.100.T.A.
2022-03-28 15:14:54,270 [MainThread  ] [INFO ]  Processing D30005.M.100.T.A.
2022-03-28 15:14:54,271 [MainThread  ] [INFO ]  Saved processed files to /tmp/tmpwd3ysnud/system.
2022-03-28 15:14:54,271 [MainThread  ] [INFO ]  Processing files in data/models_plain.
2022-03-28 15:14:54,271 [MainThread  ] [INFO ]  Processing D30001.M.100.T.B.
2022-03-28 15:14:54,271 [MainThread  ] [INFO ]  Processing D30001.M.100.T.C.
2022-03-28 15:14:54,272 [MainThread  ] [INFO ]  Processing D30001.M.100.T.D.
2022-03-28 15:14:54,272 [MainThread  ] [INFO ]  Processing D30002.M.100.T.B.
2022-03-28 15:14:54,272 [MainThread  ] [INFO ]  Processing D30002.M.100.T.C.
2022-03-28 15:14:54,272 [MainThread  ] [INFO ]  Processing D30002.M.100.T.E.
2022-03-28 15:14:54,273 [MainThread  ] [INFO ]  Processing D30003.M.100.T.B.
2022-03-28 15:14:54,273 [MainThread  ] [INFO ]  Processing D30003.M.100.T.C.
2022-03-28 15:14:54,273 [MainThread  ] [INFO ]  Processing D30003.M.100.T.F.
2022-03-28 15:14:54,274 [MainThread  ] [INFO ]  Processing D30005.M.100.T.B.
2022-03-28 15:14:54,274 [MainThread  ] [INFO ]  Processing D30005.M.100.T.C.
2022-03-28 15:14:54,274 [MainThread  ] [INFO ]  Processing D30005.M.100.T.G.
2022-03-28 15:14:54,274 [MainThread  ] [INFO ]  Saved processed files to /tmp/tmpwd3ysnud/model.
2022-03-28 15:14:54,275 [MainThread  ] [INFO ]  Written ROUGE configuration to /tmp/tmpz7r11ed3/rouge_conf.xml
2022-03-28 15:14:54,275 [MainThread  ] [INFO ]  Running ROUGE with command /cluster/apps/nss/gcc-6.3.0/python/3.8.5/x86_64/lib64/python3.8/site-packages/files2rouge-2.1.0-py3.8.egg/additional_files/ROUGE-1.5.5.pl -e /cluster/apps/nss/gcc-6.3.0/python/3.8.5/x86_64/lib64/python3.8/site-packages/files2rouge-2.1.0-py3.8.egg/additional_files/data -c 95 -2 -1 -U -r 1000 -n 4 -w 1.2 -a /tmp/tmpz7r11ed3/rouge_conf.xml
Can't locate XML/Parser.pm in @INC (@INC contains: /cluster/apps/nss/gcc-6.3.0/python/3.8.5/x86_64/lib64/python3.8/site-packages/files2rouge-2.1.0-py3.8.egg/additional_files /usr/local/lib64/perl5 /usr/local/share/perl5 /usr/lib64/perl5/vendor_perl /usr/share/perl5/vendor_perl /usr/lib64/perl5 /usr/share/perl5 .) at /cluster/apps/nss/gcc-6.3.0/python/3.8.5/x86_64/lib64/python3.8/site-packages/files2rouge-2.1.0-py3.8.egg/additional_files/XML/DOM.pm line 41.
BEGIN failed--compilation aborted at /cluster/apps/nss/gcc-6.3.0/python/3.8.5/x86_64/lib64/python3.8/site-packages/files2rouge-2.1.0-py3.8.egg/additional_files/XML/DOM.pm line 70.
Compilation failed in require at /cluster/apps/nss/gcc-6.3.0/python/3.8.5/x86_64/lib64/python3.8/site-packages/files2rouge-2.1.0-py3.8.egg/additional_files/ROUGE-1.5.5.pl line 177.
BEGIN failed--compilation aborted at /cluster/apps/nss/gcc-6.3.0/python/3.8.5/x86_64/lib64/python3.8/site-packages/files2rouge-2.1.0-py3.8.egg/additional_files/ROUGE-1.5.5.pl line 177.
Traceback (most recent call last):
  File "/cluster/apps/nss/gcc-6.3.0/python/3.8.5/x86_64/bin/pyrouge_evaluate_plain_text_files", line 25, in <module>
    main()
  File "/cluster/apps/nss/gcc-6.3.0/python/3.8.5/x86_64/bin/pyrouge_evaluate_plain_text_files", line 21, in main
    output = rouge.convert_and_evaluate(args.system_id, args.split_sents)
  File "/cluster/apps/nss/gcc-6.3.0/python/3.8.5/x86_64/lib64/python3.8/site-packages/pyrouge/Rouge155.py", line 368, in convert_and_evaluate
    rouge_output = self.evaluate(system_id, rouge_args)
  File "/cluster/apps/nss/gcc-6.3.0/python/3.8.5/x86_64/lib64/python3.8/site-packages/pyrouge/Rouge155.py", line 343, in evaluate
    rouge_output = check_output(command, env=env).decode("UTF-8")
  File "/cluster/apps/nss/gcc-6.3.0/python/3.8.5/x86_64/lib64/python3.8/subprocess.py", line 411, in check_output
    return run(*popenargs, stdout=PIPE, timeout=timeout, check=True,
  File "/cluster/apps/nss/gcc-6.3.0/python/3.8.5/x86_64/lib64/python3.8/subprocess.py", line 512, in run
    raise CalledProcessError(retcode, process.args,
subprocess.CalledProcessError: Command '['/cluster/apps/nss/gcc-6.3.0/python/3.8.5/x86_64/lib64/python3.8/site-packages/files2rouge-2.1.0-py3.8.egg/additional_files/ROUGE-1.5.5.pl', '-e', '/cluster/apps/nss/gcc-6.3.0/python/3.8.5/x86_64/lib64/python3.8/site-packages/files2rouge-2.1.0-py3.8.egg/additional_files/data', '-c', '95', '-2', '-1', '-U', '-r', '1000', '-n', '4', '-w', '1.2', '-a', '/tmp/tmpz7r11ed3/rouge_conf.xml']' returned non-zero exit status 2.
E./tmp/tmpmhimm30m/config_test.xml data/config_test.xml
...
======================================================================
ERROR: test_evaluation (pyrouge.tests.Rouge155_test.PyrougeTest)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/cluster/apps/nss/gcc-6.3.0/python/3.8.5/x86_64/lib64/python3.8/site-packages/pyrouge/tests/Rouge155_test.py", line 156, in test_evaluation
    pyrouge_output = rouge.evaluate(system_id=11).strip()
  File "/cluster/apps/nss/gcc-6.3.0/python/3.8.5/x86_64/lib64/python3.8/site-packages/pyrouge/Rouge155.py", line 343, in evaluate
    rouge_output = check_output(command, env=env).decode("UTF-8")
  File "/cluster/apps/nss/gcc-6.3.0/python/3.8.5/x86_64/lib64/python3.8/subprocess.py", line 411, in check_output
    return run(*popenargs, stdout=PIPE, timeout=timeout, check=True,
  File "/cluster/apps/nss/gcc-6.3.0/python/3.8.5/x86_64/lib64/python3.8/subprocess.py", line 512, in run
    raise CalledProcessError(retcode, process.args,
subprocess.CalledProcessError: Command '['/cluster/apps/nss/gcc-6.3.0/python/3.8.5/x86_64/lib64/python3.8/site-packages/files2rouge-2.1.0-py3.8.egg/additional_files/ROUGE-1.5.5.pl', '-e', '/cluster/apps/nss/gcc-6.3.0/python/3.8.5/x86_64/lib64/python3.8/site-packages/files2rouge-2.1.0-py3.8.egg/additional_files/data', '-c', '95', '-2', '-1', '-U', '-r', '1000', '-n', '4', '-w', '1.2', '-a', '/tmp/tmp8hsq6f62/rouge_conf.xml']' returned non-zero exit status 2.

======================================================================
ERROR: test_options (pyrouge.tests.Rouge155_test.PyrougeTest)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/cluster/apps/nss/gcc-6.3.0/python/3.8.5/x86_64/lib64/python3.8/site-packages/pyrouge/tests/Rouge155_test.py", line 218, in test_options
    pyrouge_output = check_output_clean(pyrouge_command)
  File "/cluster/apps/nss/gcc-6.3.0/python/3.8.5/x86_64/lib64/python3.8/site-packages/pyrouge/tests/Rouge155_test.py", line 17, in <lambda>
    check_output_clean = lambda c: check_output(c).decode("UTF-8").strip()
  File "/cluster/apps/nss/gcc-6.3.0/python/3.8.5/x86_64/lib64/python3.8/subprocess.py", line 411, in check_output
    return run(*popenargs, stdout=PIPE, timeout=timeout, check=True,
  File "/cluster/apps/nss/gcc-6.3.0/python/3.8.5/x86_64/lib64/python3.8/subprocess.py", line 512, in run
    raise CalledProcessError(retcode, process.args,
subprocess.CalledProcessError: Command '['pyrouge_evaluate_plain_text_files', '-m', 'data/models_plain', '-s', 'data/systems_plain', '-sfp', 'D(\\d+).M.100.T.A', '-mfp', 'D#ID#.M.100.T.[A-Z]', '-id', '1', '-rargs', '"-e /cluster/apps/nss/gcc-6.3.0/python/3.8.5/x86_64/lib64/python3.8/site-packages/files2rouge-2.1.0-py3.8.egg/additional_files/data -c 90 -2 -1 -U -r 1000 -n 2 -w 1.2 -a -m data/config_test2.xml"']' returned non-zero exit status 1.

======================================================================
ERROR: test_rouge_for_plain_text (pyrouge.tests.Rouge155_test.PyrougeTest)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/cluster/apps/nss/gcc-6.3.0/python/3.8.5/x86_64/lib64/python3.8/site-packages/pyrouge/tests/Rouge155_test.py", line 173, in test_rouge_for_plain_text
    pyrouge_output = check_output_clean(pyrouge_command.split())
  File "/cluster/apps/nss/gcc-6.3.0/python/3.8.5/x86_64/lib64/python3.8/site-packages/pyrouge/tests/Rouge155_test.py", line 17, in <lambda>
    check_output_clean = lambda c: check_output(c).decode("UTF-8").strip()
  File "/cluster/apps/nss/gcc-6.3.0/python/3.8.5/x86_64/lib64/python3.8/subprocess.py", line 411, in check_output
    return run(*popenargs, stdout=PIPE, timeout=timeout, check=True,
  File "/cluster/apps/nss/gcc-6.3.0/python/3.8.5/x86_64/lib64/python3.8/subprocess.py", line 512, in run
    raise CalledProcessError(retcode, process.args,
subprocess.CalledProcessError: Command '['pyrouge_evaluate_plain_text_files', '-m', 'data/models_plain', '-s', 'data/systems_plain', '-sfp', 'D(\\d+).M.100.T.A', '-mfp', 'D#ID#.M.100.T.[A-Z]', '-id', '1']' returned non-zero exit status 1.

----------------------------------------------------------------------
Ran 11 tests in 0.761s

FAILED (errors=3)
[sfux@eu-login-41 ~]$

Do you have any idea, why the perl scripts of files2rouge (even after updating the shebang line) don't find the XML::Parser package?

Best regards

Sam
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@samfux84