Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

COVID Pipeline fails with latest dataset #37

Open
lresende opened this issue Feb 21, 2022 · 0 comments
Open

COVID Pipeline fails with latest dataset #37

lresende opened this issue Feb 21, 2022 · 0 comments
Assignees

Comments

@lresende
Copy link
Collaborator

Processing notebook: /Users/lresende/opensource/elyra/covid-notebooks/notebooks/fit_us_data.ipynb
Input Notebook: /Users/lresende/opensource/elyra/covid-notebooks/notebooks/fit_us_data.ipynb
Output Notebook: /Users/lresende/opensource/elyra/covid-notebooks/notebooks/fit_us_data.ipynb
Working directory: /Users/lresende/opensource/elyra/covid-notebooks/notebooks

[E 2022-02-21 09:41:13.737 ServerApp] Error executing fit_us_data.ipynb in cell 4: KeyError "None of [Index([False, False, False, False, False, False, False, False, False, False,\n       ...\n       False, False, False, False, False, False, False, False, False, False],\n      dtype='object', length=3144)] are in the [columns]"
[E 2022-02-21 09:41:13.738 ServerApp] Uncaught exception POST /elyra/pipeline/schedule?1645465117799 (::1)
    HTTPServerRequest(protocol='http', host='localhost:8888', method='POST', uri='/elyra/pipeline/schedule?1645465117799', version='HTTP/1.1', remote_ip='::1')
    Traceback (most recent call last):
      File "/Users/lresende/opensource/elyra/covid-notebooks/env/lib/python3.7/site-packages/elyra/pipeline/local/processor_local.py", line 236, in process
        **additional_kwargs
      File "/Users/lresende/opensource/elyra/covid-notebooks/env/lib/python3.7/site-packages/papermill/execute.py", line 122, in execute_notebook
        raise_for_execution_errors(nb, output_path)
      File "/Users/lresende/opensource/elyra/covid-notebooks/env/lib/python3.7/site-packages/papermill/execute.py", line 234, in raise_for_execution_errors
        raise error
    papermill.exceptions.PapermillExecutionError: 
    ---------------------------------------------------------------------------
    Exception encountered at "In [4]":
    ---------------------------------------------------------------------------
    KeyError                                  Traceback (most recent call last)
    /var/folders/q9/56k2sq6x5dxclhkhsvr8wbcc0000gn/T/ipykernel_95737/785420378.py in <module>
          1 util.graph_examples(cases, ts_col_name, {}, 
    ----> 2                     mask=(np.max(cases[ts_col_name].array, axis=1) < 10))
    
    ~/opensource/elyra/covid-notebooks/notebooks/util.py in graph_examples(data_df, col_name, curves, mask, num_to_pick, semilog)
        134     :param semilog: If `True`, draw a semilog plot with a logarithmic Y axis
        135     """
    --> 136     df_subset = data_df[mask]
        137     num_to_pick = min(num_to_pick, len(df_subset.index))
        138     if num_to_pick == 0:
    
    ~/opensource/elyra/covid-notebooks/env/lib/python3.7/site-packages/pandas/core/frame.py in __getitem__(self, key)
       2910             if is_iterator(key):
       2911                 key = list(key)
    -> 2912             indexer = self.loc._get_listlike_indexer(key, axis=1, raise_missing=True)[1]
       2913 
       2914         # take() does not accept boolean indexers
    
    ~/opensource/elyra/covid-notebooks/env/lib/python3.7/site-packages/pandas/core/indexing.py in _get_listlike_indexer(self, key, axis, raise_missing)
       1252             keyarr, indexer, new_indexer = ax._reindex_non_unique(keyarr)
       1253 
    -> 1254         self._validate_read_indexer(keyarr, indexer, axis, raise_missing=raise_missing)
       1255         return keyarr, indexer
       1256 
    
    ~/opensource/elyra/covid-notebooks/env/lib/python3.7/site-packages/pandas/core/indexing.py in _validate_read_indexer(self, key, indexer, axis, raise_missing)
       1296             if missing == len(indexer):
       1297                 axis_name = self.obj._get_axis_name(axis)
    -> 1298                 raise KeyError(f"None of [{key}] are in the [{axis_name}]")
       1299 
       1300             # We (temporarily) allow for some missing keys with .loc, except in
    
    KeyError: "None of [Index([False, False, False, False, False, False, False, False, False, False,\n       ...\n       False, False, False, False, False, False, False, False, False, False],\n      dtype='object', length=3144)] are in the [columns]"
    
    
    The above exception was the direct cause of the following exception:
    
    Traceback (most recent call last):
      File "/Users/lresende/opensource/elyra/covid-notebooks/env/lib/python3.7/site-packages/elyra/pipeline/local/processor_local.py", line 99, in process
        operation_processor.process(operation, elyra_run_name)
      File "/Users/lresende/opensource/elyra/covid-notebooks/env/lib/python3.7/site-packages/elyra/pipeline/local/processor_local.py", line 242, in process
        f'{str(pmee.ename)} {str(pmee.evalue)}') from pmee
    RuntimeError: (fit_us_data.ipynb) in cell 4: KeyError "None of [Index([False, False, False, False, False, False, False, False, False, False,\n       ...\n       False, False, False, False, False, False, False, False, False, False],\n      dtype='object', length=3144)] are in the [columns]"
    
    The above exception was the direct cause of the following exception:
    
    Traceback (most recent call last):
      File "/Users/lresende/opensource/elyra/covid-notebooks/env/lib/python3.7/site-packages/tornado/web.py", line 1704, in _execute
        result = await result
      File "/Users/lresende/opensource/elyra/covid-notebooks/env/lib/python3.7/site-packages/elyra/pipeline/handlers.py", line 120, in post
        response = await PipelineProcessorManager.instance().process(pipeline)
      File "/Users/lresende/opensource/elyra/covid-notebooks/env/lib/python3.7/site-packages/elyra/pipeline/processor.py", line 134, in process
        res = await asyncio.get_event_loop().run_in_executor(None, processor.process, pipeline)
      File "/Users/lresende/opensource/elyra/covid-notebooks/env/lib/python3.7/asyncio/futures.py", line 263, in __await__
        yield self  # This tells Task to wait for completion.
      File "/Users/lresende/opensource/elyra/covid-notebooks/env/lib/python3.7/asyncio/tasks.py", line 318, in __wakeup
        future.result()
      File "/Users/lresende/opensource/elyra/covid-notebooks/env/lib/python3.7/asyncio/futures.py", line 181, in result
        raise self._exception
      File "/Users/lresende/opensource/elyra/covid-notebooks/env/lib/python3.7/concurrent/futures/thread.py", line 57, in run
        result = self.fn(*self.args, **self.kwargs)
      File "/Users/lresende/opensource/elyra/covid-notebooks/env/lib/python3.7/site-packages/elyra/pipeline/local/processor_local.py", line 104, in process
        raise RuntimeError(f'Error processing operation {operation.name} {str(ex)}') from ex
    RuntimeError: Error processing operation fit_us_data (fit_us_data.ipynb) in cell 4: KeyError "None of [Index([False, False, False, False, False, False, False, False, False, False,\n       ...\n       False, False, False, False, False, False, False, False, False, False],\n      dtype='object', length=3144)] are in the [columns]"
[E 2022-02-21 09:41:13.748 ServerApp] {
      "Host": "localhost:8888",
      "Connection": "keep-alive",
      "Content-Length": "12880",
      "Sec-Ch-Ua": "\" Not A;Brand\";v=\"99\", \"Chromium\";v=\"98\", \"Google Chrome\";v=\"98\"",
      "Authorization": "token 254feb7c1bd01e9eeefca12f8669bbd46137d623f51475ca",
      "X-Xsrftoken": "2|faae01c9|167f56a415b0c07788793ba2064622db|1645330609",
      "Sec-Ch-Ua-Mobile": "?0",
      "Content-Type": "text/plain;charset=UTF-8",
      "User-Agent": "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/98.0.4758.102 Safari/537.36",
      "Sec-Ch-Ua-Platform": "\"macOS\"",
      "Accept": "*/*",
      "Origin": "http://localhost:8888",
      "Sec-Fetch-Site": "same-origin",
      "Sec-Fetch-Mode": "cors",
      "Sec-Fetch-Dest": "empty",
      "Referer": "http://localhost:8888/lab/workspaces/auto-9/tree/pipelines/us_data.pipeline",
      "Accept-Encoding": "gzip, deflate, br",
      "Accept-Language": "en-US,en;q=0.9,pt-BR;q=0.8,pt;q=0.7",
      "Cookie": "_xsrf=2|faae01c9|167f56a415b0c07788793ba2064622db|1645330609; username-localhost-8888=\"2|1:0|10:1645465116|23:username-localhost-8888|44:NGQ5MjgxNTI0ODRlNGI2NzkwMDI2NWY1NjcxNzcyMDc=|8196ad279effd7a7174024dbac43ef92d88a0a9fcb71119e7d45c72111870b11\""

NOT A CONTRIBUTION

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants