KeyError: 'Data Read Method'

[david-guyon]

Hello,

I would like to generate the waterfall figure but I get the following error :

$ python2 parse_logs.py application_1562001346151_0031 --waterfall-only
Parsing file application_1562001346151_0031 as JSON
Stage ids: [0]
Traceback (most recent call last):
  File "parse_logs.py", line 200, in <module>
    main(sys.argv[1:])
  File "parse_logs.py", line 192, in main
    analyzer = Analyzer(filename, opts.parse_as_single_job)
  File "parse_logs.py", line 54, in __init__
    self.jobs[job_id].add_event(json_data, True)
  File "trace-analysis/job.py", line 32, in add_event
    self.stages[stage_id].add_event(data, True)
  File "trace-analysis/stage.py", line 292, in add_event
    task = Task(data, is_json)
  File "trace-analysis/task.py", line 8, in __init__
    self.initialize_from_json(data)
  File "trace-analysis/task.py", line 70, in initialize_from_json
    self.input_read_method = input_metrics["Data Read Method"]
KeyError: 'Data Read Method'

I'm using Spark version 2.4.1 alongside with Yarn and HDFS.

Do you have any idea what could be the problem?