Fail in writing database from imported local database (previously exported as Excel from AB)

[Christhel-Andrade]

When trying to import the following file AB_LCI_HPO.xlsx which has been exported from Activity Browser, I get an error. This error happens with various files but not with all my files; while they all have been exported the same way, on the same computer, and on the same version of AB and ecoinvent.

Versions:

Application version: 2.10.3
bw2data version: 3.6.6
bw2io version: 1.8.2
bw2calc version: 0.8.12

Python code

I run the code using ExcelImporter

imp = bw.ExcelImporter(r'my_path\AB_LCI_HPO.xlsx') #give the path to your inventory excel file
imp.apply_strategies()
imp.match_database("consequential391", fields=('name','unit','location', 'reference product'))
#imp.match_database(fields=('name', 'unit', 'location'))
imp.statistics()
#imp.write_excel(only_unlinked=True)
imp.write_excel()
list(imp.unlinked)

imp.write_database()

ERROR in the console:

Error logs

---------------------------------------------------------------------------
TypeError                                 Traceback (most recent call last)
Cell In[7], line 10
      7 imp.write_excel()
      8 list(imp.unlinked)
---> 10 imp.write_database()

File [~\AppData\Local\anaconda3\envs\premise\Lib\site-packages\bw2io\importers\excel.py:284](http://localhost:8888/lab/tree/Users/andraded/Documents/autumn-school-2024/autumn-school-dds-psi-2024/tutorials/activity_browser/~/AppData/Local/anaconda3/envs/premise/Lib/site-packages/bw2io/importers/excel.py#line=283), in ExcelImporter.write_database(self, **kwargs)
    282 """Same as base ``write_database`` method, but ``activate_parameters`` is True by default."""
    283 kwargs["activate_parameters"] = kwargs.get("activate_parameters", True)
--> 284 super(ExcelImporter, self).write_database(**kwargs)

File [~\AppData\Local\anaconda3\envs\premise\Lib\site-packages\bw2io\importers\base_lci.py:273](http://localhost:8888/lab/tree/Users/andraded/Documents/autumn-school-2024/autumn-school-dds-psi-2024/tutorials/activity_browser/~/AppData/Local/anaconda3/envs/premise/Lib/site-packages/bw2io/importers/base_lci.py#line=272), in LCIImporter.write_database(self, data, delete_existing, backend, activate_parameters, **kwargs)
    270 self.write_database_parameters(activate_parameters, delete_existing)
    272 existing.update(data)
--> 273 db.write(existing)
    275 if activate_parameters:
    276     self._write_activity_parameters(activity_parameters)

File [~\AppData\Local\anaconda3\envs\premise\Lib\site-packages\bw2data\project.py:358](http://localhost:8888/lab/tree/Users/andraded/Documents/autumn-school-2024/autumn-school-dds-psi-2024/tutorials/activity_browser/~/AppData/Local/anaconda3/envs/premise/Lib/site-packages/bw2data/project.py#line=357), in writable_project(wrapped, instance, args, kwargs)
    356 if projects.read_only:
    357     raise ReadOnlyProject(READ_ONLY_PROJECT)
--> 358 return wrapped(*args, **kwargs)

File [~\AppData\Local\anaconda3\envs\premise\Lib\site-packages\bw2data\backends\peewee\database.py:266](http://localhost:8888/lab/tree/Users/andraded/Documents/autumn-school-2024/autumn-school-dds-psi-2024/tutorials/activity_browser/~/AppData/Local/anaconda3/envs/premise/Lib/site-packages/bw2data/backends/peewee/database.py#line=265), in SQLiteBackend.write(self, data, process)
    263         self.delete(warn=False)
    264         raise
--> 266 self.make_searchable(reset=True)
    268 if process:
    269     self.process()

File [~\AppData\Local\anaconda3\envs\premise\Lib\site-packages\bw2data\project.py:358](http://localhost:8888/lab/tree/Users/andraded/Documents/autumn-school-2024/autumn-school-dds-psi-2024/tutorials/activity_browser/~/AppData/Local/anaconda3/envs/premise/Lib/site-packages/bw2data/project.py#line=357), in writable_project(wrapped, instance, args, kwargs)
    356 if projects.read_only:
    357     raise ReadOnlyProject(READ_ONLY_PROJECT)
--> 358 return wrapped(*args, **kwargs)

File [~\AppData\Local\anaconda3\envs\premise\Lib\site-packages\bw2data\backends\peewee\database.py:311](http://localhost:8888/lab/tree/Users/andraded/Documents/autumn-school-2024/autumn-school-dds-psi-2024/tutorials/activity_browser/~/AppData/Local/anaconda3/envs/premise/Lib/site-packages/bw2data/backends/peewee/database.py#line=310), in SQLiteBackend.make_searchable(self, reset)
    309 databases.flush()
    310 IndexManager(self.filename).delete_database()
--> 311 IndexManager(self.filename).add_datasets(self)

File [~\AppData\Local\anaconda3\envs\premise\Lib\site-packages\bw2data\search\indices.py:47](http://localhost:8888/lab/tree/Users/andraded/Documents/autumn-school-2024/autumn-school-dds-psi-2024/tutorials/activity_browser/~/AppData/Local/anaconda3/envs/premise/Lib/site-packages/bw2data/search/indices.py#line=46), in IndexManager.add_datasets(self, datasets)
     45 writer = self.get().writer()
     46 for ds in datasets:
---> 47     writer.add_document(**self._format_dataset(ds))
     48 writer.commit()

File [~\AppData\Local\anaconda3\envs\premise\Lib\site-packages\bw2data\search\indices.py:35](http://localhost:8888/lab/tree/Users/andraded/Documents/autumn-school-2024/autumn-school-dds-psi-2024/tutorials/activity_browser/~/AppData/Local/anaconda3/envs/premise/Lib/site-packages/bw2data/search/indices.py#line=34), in IndexManager._format_dataset(self, ds)
     29 def _format_dataset(self, ds):
     30     fl = lambda o: o[1].lower() if isinstance(o, tuple) else o.lower()
     31     return dict(
     32         name=ds.get(u"name", u"").lower(),
     33         comment=ds.get(u"comment", u"").lower(),
     34         product=ds.get(u"reference product", u"").lower(),
---> 35         categories=u", ".join(ds.get(u"categories", [])).lower(),
     36         location=fl(ds.get(u"location", u"")),
     37         database=ds[u"database"],
     38         code=ds['code']
     39     )

File [~\AppData\Local\anaconda3\envs\premise\Lib\_collections_abc.py:774](http://localhost:8888/lab/tree/Users/andraded/Documents/autumn-school-2024/autumn-school-dds-psi-2024/tutorials/activity_browser/~/AppData/Local/anaconda3/envs/premise/Lib/_collections_abc.py#line=773), in Mapping.get(self, key, default)
    772 'D.get(k[,d]) -> D[k] if k in D, else d.  d defaults to None.'
    773 try:
--> 774     return self[key]
    775 except KeyError:
    776     return default

File [~\AppData\Local\anaconda3\envs\premise\Lib\site-packages\bw2data\backends\peewee\proxies.py:125](http://localhost:8888/lab/tree/Users/andraded/Documents/autumn-school-2024/autumn-school-dds-psi-2024/tutorials/activity_browser/~/AppData/Local/anaconda3/envs/premise/Lib/site-packages/bw2data/backends/peewee/proxies.py#line=124), in Activity.__getitem__(self, key)
    122 except ValueError:
    123     raise KeyError
--> 125 if key in rp.get('classifications', []):
    126     return rp['classifications'][key]
    127 if key in rp.get('properties', []):

TypeError: argument of type 'float' is not iterable

[nicolnt]

I have the same issue with AB 2.9.1

conda list output

# packages in environment at C:\Users\lienart\AppData\Local\miniconda3\envs\ab:
#
# Name                    Version                   Build  Channel
activity-browser          2.9.7              pyhd8ed1ab_0    conda-forge
appdirs                   1.4.4              pyh9f0ad1d_0    conda-forge
arrow                     1.3.0              pyhd8ed1ab_0    conda-forge
asteval                   0.9.32             pyhd8ed1ab_0    conda-forge
astunparse                1.6.3              pyhd8ed1ab_0    conda-forge
blinker                   1.8.2              pyhd8ed1ab_0    conda-forge
brightway2                2.4.4              pyhd8ed1ab_0    conda-forge
brotli                    1.1.0                hcfcfb64_1    conda-forge
brotli-bin                1.1.0                hcfcfb64_1    conda-forge
brotli-python             1.1.0           py311h12c1d0e_1    conda-forge
brotlicffi                1.1.0.0         py311h12c1d0e_1    conda-forge
bw2analyzer               0.10               pyhd8ed1ab_0    conda-forge
bw2calc                   1.8.2           py311h1ea47a8_0    conda-forge
bw2data                   3.6.6              pyhd8ed1ab_0    conda-forge
bw2io                     0.8.10             pyhd8ed1ab_0    conda-forge
bw2parameters             1.1.0              pyhd8ed1ab_0    conda-forge
bw_migrations             0.2                pyhd8ed1ab_0    conda-forge
bzip2                     1.0.8                hcfcfb64_5    conda-forge
ca-certificates           2024.2.2             h56e8100_0    conda-forge
certifi                   2024.2.2           pyhd8ed1ab_0    conda-forge
cffi                      1.16.0          py311ha68e1ae_0    conda-forge
charset-normalizer        3.3.2              pyhd8ed1ab_0    conda-forge
click                     8.1.7           win_pyh7428d3b_0    conda-forge
colorama                  0.4.6              pyhd8ed1ab_0    conda-forge
contourpy                 1.2.1           py311h005e61a_0    conda-forge
cycler                    0.12.1             pyhd8ed1ab_0    conda-forge
dill                      0.3.8              pyhd8ed1ab_0    conda-forge
docopt                    0.6.2                      py_1    conda-forge
eidl                      2.0.1              pyhd8ed1ab_0    conda-forge
eight                     1.0.1              pyhd8ed1ab_4    conda-forge
et_xmlfile                1.1.0              pyhd8ed1ab_0    conda-forge
fasteners                 0.17.3             pyhd8ed1ab_0    conda-forge
flask                     3.0.3              pyhd8ed1ab_0    conda-forge
fonttools                 4.51.0          py311ha68e1ae_0    conda-forge
freetype                  2.12.1               hdaf720e_2    conda-forge
future                    1.0.0              pyhd8ed1ab_0    conda-forge
gettext                   0.22.5               h5728263_2    conda-forge
gettext-tools             0.22.5               h7d00a51_2    conda-forge
glib                      2.80.2               h0df6a38_0    conda-forge
glib-tools                2.80.2               h2f9d560_0    conda-forge
gst-plugins-base          1.22.9               h001b923_1    conda-forge
gstreamer                 1.22.9               hb4038d2_1    conda-forge
icu                       73.2                 h63175ca_0    conda-forge
idna                      3.7                pyhd8ed1ab_0    conda-forge
importlib-metadata        7.1.0              pyha770c72_0    conda-forge
importlib_metadata        7.1.0                hd8ed1ab_0    conda-forge
inflate64                 1.0.0           py311ha68e1ae_1    conda-forge
intel-openmp              2024.1.0           h57928b3_965    conda-forge
itsdangerous              2.2.0              pyhd8ed1ab_0    conda-forge
jinja2                    3.1.4              pyhd8ed1ab_0    conda-forge
kiwisolver                1.4.5           py311h005e61a_1    conda-forge
krb5                      1.21.2               heb0366b_0    conda-forge
lcms2                     2.16                 h67d730c_0    conda-forge
lerc                      4.0.0                h63175ca_0    conda-forge
libasprintf               0.22.5               h5728263_2    conda-forge
libasprintf-devel         0.22.5               h5728263_2    conda-forge
libblas                   3.9.0              22_win64_mkl    conda-forge
libbrotlicommon           1.1.0                hcfcfb64_1    conda-forge
libbrotlidec              1.1.0                hcfcfb64_1    conda-forge
libbrotlienc              1.1.0                hcfcfb64_1    conda-forge
libcblas                  3.9.0              22_win64_mkl    conda-forge
libclang13                18.1.5          default_hf64faad_0    conda-forge
libdeflate                1.20                 hcfcfb64_0    conda-forge
libexpat                  2.6.2                h63175ca_0    conda-forge
libffi                    3.4.2                h8ffe710_5    conda-forge
libgettextpo              0.22.5               h5728263_2    conda-forge
libgettextpo-devel        0.22.5               h5728263_2    conda-forge
libglib                   2.80.2               h0df6a38_0    conda-forge
libhwloc                  2.9.1                h51c2c0f_0    conda-forge
libiconv                  1.17                 hcfcfb64_2    conda-forge
libintl                   0.22.5               h5728263_2    conda-forge
libintl-devel             0.22.5               h5728263_2    conda-forge
libjpeg-turbo             3.0.0                hcfcfb64_1    conda-forge
liblapack                 3.9.0              22_win64_mkl    conda-forge
libogg                    1.3.4                h8ffe710_1    conda-forge
libpng                    1.6.43               h19919ed_0    conda-forge
libsqlite                 3.45.3               hcfcfb64_0    conda-forge
libtiff                   4.6.0                hddb2be6_3    conda-forge
libvorbis                 1.3.7                h0e60522_0    conda-forge
libwebp                   1.4.0                h2466b09_0    conda-forge
libwebp-base              1.4.0                hcfcfb64_0    conda-forge
libxcb                    1.15                 hcd874cb_0    conda-forge
libxml2                   2.10.4               hc3477c8_0    conda-forge
libxslt                   1.1.37               h0192164_0    conda-forge
libzlib                   1.2.13               hcfcfb64_5    conda-forge
lxml                      4.9.2           py311h5942461_0    conda-forge
m2w64-gcc-libgfortran     5.3.0                         6    conda-forge
m2w64-gcc-libs            5.3.0                         7    conda-forge
m2w64-gcc-libs-core       5.3.0                         7    conda-forge
m2w64-gmp                 6.1.0                         2    conda-forge
m2w64-libwinpthread-git   5.0.0.4634.697f757               2    conda-forge
markupsafe                2.1.5           py311ha68e1ae_0    conda-forge
matplotlib-base           3.8.4           py311h9b31f6e_2    conda-forge
mkl                       2024.1.0           h66d3029_692    conda-forge
mrio_common_metadata      0.2.1              pyhd8ed1ab_0    conda-forge
msys2-conda-epoch         20160418                      1    conda-forge
multiprocess              0.70.16         py311ha68e1ae_0    conda-forge
multivolumefile           0.2.3              pyhd8ed1ab_0    conda-forge
munkres                   1.1.4              pyh9f0ad1d_0    conda-forge
networkx                  3.3                pyhd8ed1ab_1    conda-forge
numpy                     1.23.5          py311h95d790f_0    conda-forge
openjpeg                  2.5.2                h3d672ee_0    conda-forge
openpyxl                  3.1.2           py311ha68e1ae_1    conda-forge
openssl                   3.3.0                h2466b09_2    conda-forge
packaging                 24.0               pyhd8ed1ab_0    conda-forge
pandas                    2.1.4           py311hf63dbb6_0    conda-forge
pathos                    0.3.2              pyhd8ed1ab_1    conda-forge
patsy                     0.5.6              pyhd8ed1ab_0    conda-forge
pcre2                     10.43                h17e33f8_0    conda-forge
peewee                    3.17.3          py311had142b2_0    conda-forge
pillow                    10.3.0          py311h6819b35_0    conda-forge
pint                      0.21               pyhd8ed1ab_0    conda-forge
pip                       24.0               pyhd8ed1ab_0    conda-forge
pox                       0.3.4              pyhd8ed1ab_0    conda-forge
ppft                      1.7.6.8            pyhd8ed1ab_0    conda-forge
psutil                    5.9.8           py311ha68e1ae_0    conda-forge
pthread-stubs             0.4               hcd874cb_1001    conda-forge
pthreads-win32            2.9.1                hfa6e2cd_3    conda-forge
py7zr                     0.21.0             pyhd8ed1ab_0    conda-forge
pybcj                     1.0.2           py311ha68e1ae_0    conda-forge
pycparser                 2.22               pyhd8ed1ab_0    conda-forge
pycryptodomex             3.19.0          py311ha68e1ae_1    conda-forge
pypardiso                 0.4.6              pyhd8ed1ab_0    conda-forge
pyparsing                 3.1.2              pyhd8ed1ab_0    conda-forge
pyperclip                 1.8.2              pyhd8ed1ab_2    conda-forge
pyppmd                    1.1.0           py311h12c1d0e_0    conda-forge
pyprind                   2.11.2          py311h1ea47a8_1005    conda-forge
pyside2                   5.15.8          py311h2411a93_2    conda-forge
pysocks                   1.7.1              pyh0701188_6    conda-forge
python                    3.11.9          h631f459_0_cpython    conda-forge
python-dateutil           2.9.0              pyhd8ed1ab_0    conda-forge
python-tzdata             2024.1             pyhd8ed1ab_0    conda-forge
python_abi                3.11                    4_cp311    conda-forge
pytz                      2024.1             pyhd8ed1ab_0    conda-forge
pyxlsb                    1.0.10             pyhd8ed1ab_0    conda-forge
pyzstd                    0.16.0          py311h53056dc_0    conda-forge
qt-main                   5.15.8              h9e85ed6_20    conda-forge
qt-webengine              5.15.8               h4bf5c4e_4    conda-forge
requests                  2.32.2             pyhd8ed1ab_0    conda-forge
salib                     1.5.0              pyhd8ed1ab_0    conda-forge
scipy                     1.13.0          py311hd4686c6_1    conda-forge
seaborn                   0.13.2               hd8ed1ab_2    conda-forge
seaborn-base              0.13.2             pyhd8ed1ab_2    conda-forge
setuptools                70.0.0             pyhd8ed1ab_0    conda-forge
setuptools-scm            8.1.0              pyhd8ed1ab_0    conda-forge
six                       1.16.0             pyh6c4a22f_0    conda-forge
stats_arrays              0.6.6              pyhd8ed1ab_0    conda-forge
statsmodels               0.14.2          py311h0a17f05_0    conda-forge
tabulate                  0.9.0              pyhd8ed1ab_1    conda-forge
tbb                       2021.9.0             h91493d7_0    conda-forge
texttable                 1.7.0              pyhd8ed1ab_0    conda-forge
tk                        8.6.13               h5226925_1    conda-forge
tomli                     2.0.1              pyhd8ed1ab_0    conda-forge
tqdm                      4.66.4             pyhd8ed1ab_0    conda-forge
types-python-dateutil     2.9.0.20240316     pyhd8ed1ab_0    conda-forge
typing-extensions         4.11.0               hd8ed1ab_0    conda-forge
typing_extensions         4.11.0             pyha770c72_0    conda-forge
tzdata                    2024a                h0c530f3_0    conda-forge
ucrt                      10.0.22621.0         h57928b3_0    conda-forge
unicodecsv                0.14.1             pyhd8ed1ab_2    conda-forge
unidecode                 1.3.8              pyhd8ed1ab_0    conda-forge
urllib3                   2.2.1              pyhd8ed1ab_0    conda-forge
vc                        14.3                ha32ba9b_20    conda-forge
vc14_runtime              14.38.33135         h835141b_20    conda-forge
voluptuous                0.14.2             pyhd8ed1ab_0    conda-forge
vs2015_runtime            14.38.33135         h22015db_20    conda-forge
werkzeug                  3.0.3              pyhd8ed1ab_0    conda-forge
wheel                     0.43.0             pyhd8ed1ab_1    conda-forge
whoosh                    2.7.4           py311h1ea47a8_8    conda-forge
win_inet_pton             1.1.0              pyhd8ed1ab_6    conda-forge
wrapt                     1.16.0          py311ha68e1ae_0    conda-forge
xlrd                      2.0.1              pyhd8ed1ab_3    conda-forge
xlsxwriter                3.1.9              pyhd8ed1ab_0    conda-forge
xorg-libxau               1.0.11               hcd874cb_0    conda-forge
xorg-libxdmcp             1.1.3                hcd874cb_0    conda-forge
xz                        5.2.6                h8d14728_0    conda-forge
zipfile-deflate64         0.2.0           py311ha68e1ae_4    conda-forge
zipp                      3.17.0             pyhd8ed1ab_0    conda-forge
zstd                      1.5.6                h0ea2cb4_0    conda-forge

[nicolnt]

Another file exported from AB 2.9.1 this time that doesn't want to import in bw using Christhel's code
lci-Case_Study_ACV_LCI - ab.xlsx