Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Job 3: Failed #5

Open
mflipe opened this issue May 8, 2021 · 0 comments
Open

Job 3: Failed #5

mflipe opened this issue May 8, 2021 · 0 comments

Comments

@mflipe
Copy link

mflipe commented May 8, 2021

Job 3 Failed

  • Compiled with SBT 1.4 on windows
  • No changes to the source code
  • Executed on Ubuntu WSL 2

LOG

$ hadoop jar hw2_dblp_mapred.jar 3 input
2021-05-07 19:30:59,751 INFO hw2.RunJobs$: Starting up MapReduce job..
2021-05-07 19:30:59,806 INFO client.DefaultNoHARMFailoverProxyProvider: Connecting to ResourceManager at /0.0.0.0:8032
2021-05-07 19:31:00,034 WARN mapreduce.JobResourceUploader: Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this.
2021-05-07 19:31:00,135 INFO mapreduce.JobResourceUploader: Disabling Erasure Coding for path: /tmp/hadoop-yarn/staging/hduser/.staging/job_1620420770486_0003
2021-05-07 19:31:02,476 INFO input.FileInputFormat: Total input files to process : 1
2021-05-07 19:31:03,467 INFO mapreduce.JobSubmitter: number of splits:24
2021-05-07 19:31:03,717 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1620420770486_0003
2021-05-07 19:31:03,717 INFO mapreduce.JobSubmitter: Executing with tokens: []
2021-05-07 19:31:03,837 INFO conf.Configuration: resource-types.xml not found
2021-05-07 19:31:03,838 INFO resource.ResourceUtils: Unable to find 'resource-types.xml'.
2021-05-07 19:31:03,880 INFO impl.YarnClientImpl: Submitted application application_1620420770486_0003
2021-05-07 19:31:03,905 INFO mapreduce.Job: The url to track the job: http://DESKTOP-Marcos.localdomain:8088/proxy/application_1620420770486_0003/
2021-05-07 19:31:03,905 INFO mapreduce.Job: Running job: job_1620420770486_0003
2021-05-07 19:31:09,963 INFO mapreduce.Job: Job job_1620420770486_0003 running in uber mode : false
2021-05-07 19:31:09,964 INFO mapreduce.Job:  map 0% reduce 0%
2021-05-07 19:31:23,130 INFO mapreduce.Job: Task Id : attempt_1620420770486_0003_m_000000_0, Status : FAILED
Error: java.util.NoSuchElementException: head of empty list
        at scala.collection.immutable.Nil$.head(List.scala:629)
        at scala.collection.immutable.Nil$.head(List.scala:628)
        at com.samujjwaal.hw2.mappers.VenueTopPubMapper.map(VenueTopPubMapper.scala:28)
        at com.samujjwaal.hw2.mappers.VenueTopPubMapper.map(VenueTopPubMapper.scala:8)
        at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:146)
        at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:799)
        at org.apache.hadoop.mapred.MapTask.run(MapTask.java:347)
        at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:178)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:422)
        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1845)
        at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:172)

2021-05-07 19:31:33,230 INFO mapreduce.Job:  map 1% reduce 0%
2021-05-07 19:31:36,262 INFO mapreduce.Job: Task Id : attempt_1620420770486_0003_m_000000_1, Status : FAILED
Error: java.util.NoSuchElementException: head of empty list
        at scala.collection.immutable.Nil$.head(List.scala:629)
        at scala.collection.immutable.Nil$.head(List.scala:628)
        at com.samujjwaal.hw2.mappers.VenueTopPubMapper.map(VenueTopPubMapper.scala:28)
        at com.samujjwaal.hw2.mappers.VenueTopPubMapper.map(VenueTopPubMapper.scala:8)
        at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:146)
        at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:799)
        at org.apache.hadoop.mapred.MapTask.run(MapTask.java:347)
        at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:178)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:422)
        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1845)
        at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:172)

2021-05-07 19:31:52,422 INFO mapreduce.Job:  map 2% reduce 0%
2021-05-07 19:32:10,556 INFO mapreduce.Job:  map 3% reduce 0%
2021-05-07 19:32:22,884 INFO mapreduce.Job:  map 4% reduce 0%
2021-05-07 19:32:39,991 INFO mapreduce.Job:  map 5% reduce 0%
2021-05-07 19:32:52,045 INFO mapreduce.Job:  map 6% reduce 0%
2021-05-07 19:33:07,146 INFO mapreduce.Job:  map 7% reduce 0%
2021-05-07 19:33:22,240 INFO mapreduce.Job:  map 8% reduce 0%
2021-05-07 19:33:34,302 INFO mapreduce.Job:  map 9% reduce 0%
2021-05-07 19:33:52,393 INFO mapreduce.Job:  map 10% reduce 0%
2021-05-07 19:34:00,436 INFO mapreduce.Job: Task Id : attempt_1620420770486_0003_m_000006_0, Status : FAILED
Error: java.util.NoSuchElementException: head of empty list
        at scala.collection.immutable.Nil$.head(List.scala:629)
        at scala.collection.immutable.Nil$.head(List.scala:628)
        at com.samujjwaal.hw2.mappers.VenueTopPubMapper.map(VenueTopPubMapper.scala:28)
        at com.samujjwaal.hw2.mappers.VenueTopPubMapper.map(VenueTopPubMapper.scala:8)
        at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:146)
        at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:799)
        at org.apache.hadoop.mapred.MapTask.run(MapTask.java:347)
        at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:178)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:422)
        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1845)
        at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:172)

2021-05-07 19:34:01,445 INFO mapreduce.Job:  map 9% reduce 0%
2021-05-07 19:34:10,480 INFO mapreduce.Job:  map 10% reduce 0%
2021-05-07 19:34:10,481 INFO mapreduce.Job: Task Id : attempt_1620420770486_0003_m_000000_2, Status : FAILED
Error: java.util.NoSuchElementException: head of empty list
        at scala.collection.immutable.Nil$.head(List.scala:629)
        at scala.collection.immutable.Nil$.head(List.scala:628)
        at com.samujjwaal.hw2.mappers.VenueTopPubMapper.map(VenueTopPubMapper.scala:28)
        at com.samujjwaal.hw2.mappers.VenueTopPubMapper.map(VenueTopPubMapper.scala:8)
        at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:146)
        at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:799)
        at org.apache.hadoop.mapred.MapTask.run(MapTask.java:347)
        at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:178)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:422)
        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1845)
        at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:172)

2021-05-07 19:34:11,492 INFO mapreduce.Job: Task Id : attempt_1620420770486_0003_m_000005_0, Status : FAILED
Error: java.util.NoSuchElementException: head of empty list
        at scala.collection.immutable.Nil$.head(List.scala:629)
        at scala.collection.immutable.Nil$.head(List.scala:628)
        at com.samujjwaal.hw2.mappers.VenueTopPubMapper.map(VenueTopPubMapper.scala:28)
        at com.samujjwaal.hw2.mappers.VenueTopPubMapper.map(VenueTopPubMapper.scala:8)
        at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:146)
        at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:799)
        at org.apache.hadoop.mapred.MapTask.run(MapTask.java:347)
        at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:178)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:422)
        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1845)
        at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:172)

2021-05-07 19:34:12,497 INFO mapreduce.Job:  map 8% reduce 0%
2021-05-07 19:34:22,571 INFO mapreduce.Job:  map 100% reduce 100%
2021-05-07 19:34:24,579 INFO mapreduce.Job: Job job_1620420770486_0003 failed with state FAILED due to: Task failed task_1620420770486_0003_m_000000
Job failed as tasks failed. failedMaps:1 failedReduces:0 killedMaps:0 killedReduces: 0

2021-05-07 19:34:24,627 INFO mapreduce.Job: Counters: 14
        Job Counters
                Failed map tasks=6
                Killed map tasks=23
                Killed reduce tasks=1
                Launched map tasks=11
                Other local map tasks=4
                Data-local map tasks=7
                Total time spent by all maps in occupied slots (ms)=1135720
                Total time spent by all reduces in occupied slots (ms)=0
                Total time spent by all map tasks (ms)=1135720
                Total vcore-milliseconds taken by all map tasks=1135720
                Total megabyte-milliseconds taken by all map tasks=1162977280
        Map-Reduce Framework
                CPU time spent (ms)=0
                Physical memory (bytes) snapshot=0
                Virtual memory (bytes) snapshot=0
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
DBLP MapReduce
Status: To do
Milestone
No milestone
Development

No branches or pull requests
1 participant
@mflipe