-
Notifications
You must be signed in to change notification settings - Fork 0
/
airflow-scheduler.log
1356 lines (1356 loc) · 219 KB
/
airflow-scheduler.log
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408
409
410
411
412
413
414
415
416
417
418
419
420
421
422
423
424
425
426
427
428
429
430
431
432
433
434
435
436
437
438
439
440
441
442
443
444
445
446
447
448
449
450
451
452
453
454
455
456
457
458
459
460
461
462
463
464
465
466
467
468
469
470
471
472
473
474
475
476
477
478
479
480
481
482
483
484
485
486
487
488
489
490
491
492
493
494
495
496
497
498
499
500
501
502
503
504
505
506
507
508
509
510
511
512
513
514
515
516
517
518
519
520
521
522
523
524
525
526
527
528
529
530
531
532
533
534
535
536
537
538
539
540
541
542
543
544
545
546
547
548
549
550
551
552
553
554
555
556
557
558
559
560
561
562
563
564
565
566
567
568
569
570
571
572
573
574
575
576
577
578
579
580
581
582
583
584
585
586
587
588
589
590
591
592
593
594
595
596
597
598
599
600
601
602
603
604
605
606
607
608
609
610
611
612
613
614
615
616
617
618
619
620
621
622
623
624
625
626
627
628
629
630
631
632
633
634
635
636
637
638
639
640
641
642
643
644
645
646
647
648
649
650
651
652
653
654
655
656
657
658
659
660
661
662
663
664
665
666
667
668
669
670
671
672
673
674
675
676
677
678
679
680
681
682
683
684
685
686
687
688
689
690
691
692
693
694
695
696
697
698
699
700
701
702
703
704
705
706
707
708
709
710
711
712
713
714
715
716
717
718
719
720
721
722
723
724
725
726
727
728
729
730
731
732
733
734
735
736
737
738
739
740
741
742
743
744
745
746
747
748
749
750
751
752
753
754
755
756
757
758
759
760
761
762
763
764
765
766
767
768
769
770
771
772
773
774
775
776
777
778
779
780
781
782
783
784
785
786
787
788
789
790
791
792
793
794
795
796
797
798
799
800
801
802
803
804
805
806
807
808
809
810
811
812
813
814
815
816
817
818
819
820
821
822
823
824
825
826
827
828
829
830
831
832
833
834
835
836
837
838
839
840
841
842
843
844
845
846
847
848
849
850
851
852
853
854
855
856
857
858
859
860
861
862
863
864
865
866
867
868
869
870
871
872
873
874
875
876
877
878
879
880
881
882
883
884
885
886
887
888
889
890
891
892
893
894
895
896
897
898
899
900
901
902
903
904
905
906
907
908
909
910
911
912
913
914
915
916
917
918
919
920
921
922
923
924
925
926
927
928
929
930
931
932
933
934
935
936
937
938
939
940
941
942
943
944
945
946
947
948
949
950
951
952
953
954
955
956
957
958
959
960
961
962
963
964
965
966
967
968
969
970
971
972
973
974
975
976
977
978
979
980
981
982
983
984
985
986
987
988
989
990
991
992
993
994
995
996
997
998
999
1000
2023-10-23 18:25:00,437 INFO - Starting the scheduler
2023-10-23 18:25:00,438 INFO - Processing each file at most -1 times
2023-10-23 18:25:00,444 INFO - Loaded executor: SequentialExecutor
2023-10-23 18:25:00,450 INFO - Launched DagFileProcessorManager with pid: 63861
2023-10-23 18:25:00,453 INFO - Resetting orphaned tasks for active dag runs
2023-10-23 18:29:32,882 INFO - Exiting gracefully upon receiving signal 15
2023-10-23 18:29:33,896 INFO - Sending Signals.SIGTERM to group 63861. PIDs of all processes in the group: [63861]
2023-10-23 18:29:33,898 INFO - Sending the signal Signals.SIGTERM to group 63861
2023-10-23 18:29:34,282 INFO - Process psutil.Process(pid=63861, status='terminated', exitcode=0, started='18:25:00') (63861) terminated with exit code 0
2023-10-23 18:29:34,289 INFO - Sending Signals.SIGTERM to group 63861. PIDs of all processes in the group: []
2023-10-23 18:29:34,289 INFO - Sending the signal Signals.SIGTERM to group 63861
2023-10-23 18:29:34,289 INFO - Sending the signal Signals.SIGTERM to process 63861 as process group is missing.
2023-10-23 18:29:34,290 INFO - Exited execute loop
2023-10-23 18:58:22,929 INFO - Starting the scheduler
2023-10-23 18:58:22,930 INFO - Processing each file at most -1 times
2023-10-23 18:58:22,932 INFO - Loaded executor: SequentialExecutor
2023-10-23 18:58:22,935 INFO - Launched DagFileProcessorManager with pid: 66562
2023-10-23 18:58:22,936 INFO - Resetting orphaned tasks for active dag runs
2023-10-23 19:03:22,963 INFO - Resetting orphaned tasks for active dag runs
2023-10-23 19:08:23,000 INFO - Resetting orphaned tasks for active dag runs
2023-10-23 19:13:23,064 INFO - Resetting orphaned tasks for active dag runs
2023-10-23 19:18:23,115 INFO - Resetting orphaned tasks for active dag runs
2023-10-23 19:23:23,147 INFO - Resetting orphaned tasks for active dag runs
2023-10-23 19:27:31,605 INFO - 1 tasks up for execution:
<TaskInstance: one_task_dag.one_task manual__2023-10-24T02:27:30.639583+00:00 [scheduled]>
2023-10-23 19:27:31,606 INFO - DAG one_task_dag has 0/16 running and queued tasks
2023-10-23 19:27:31,606 INFO - Setting the following tasks to queued state:
<TaskInstance: one_task_dag.one_task manual__2023-10-24T02:27:30.639583+00:00 [scheduled]>
2023-10-23 19:27:31,608 INFO - Sending TaskInstanceKey(dag_id='one_task_dag', task_id='one_task', run_id='manual__2023-10-24T02:27:30.639583+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default
2023-10-23 19:27:31,609 INFO - Adding to queue: ['airflow', 'tasks', 'run', 'one_task_dag', 'one_task', 'manual__2023-10-24T02:27:30.639583+00:00', '--local', '--subdir', 'DAGS_FOLDER/one_task_dag.py']
2023-10-23 19:27:31,610 INFO - Executing command: ['airflow', 'tasks', 'run', 'one_task_dag', 'one_task', 'manual__2023-10-24T02:27:30.639583+00:00', '--local', '--subdir', 'DAGS_FOLDER/one_task_dag.py']
2023-10-23 19:27:33,094 INFO - Executor reports execution of one_task_dag.one_task run_id=manual__2023-10-24T02:27:30.639583+00:00 exited with status success for try_number 1
2023-10-23 19:27:33,100 INFO - TaskInstance Finished: dag_id=one_task_dag, task_id=one_task, run_id=manual__2023-10-24T02:27:30.639583+00:00, map_index=-1, run_start_date=2023-10-24 02:27:32.835546+00:00, run_end_date=2023-10-24 02:27:32.913552+00:00, run_duration=0.078006, state=success, executor_state=success, try_number=1, max_tries=0, job_id=3, pool=default_pool, queue=default, priority_weight=1, operator=BashOperator, queued_dttm=2023-10-24 02:27:31.607213+00:00, queued_by_job_id=2, pid=70666
2023-10-23 19:27:33,121 INFO - Marking run <DagRun one_task_dag @ 2023-10-24 02:27:30.639583+00:00: manual__2023-10-24T02:27:30.639583+00:00, state:running, queued_at: 2023-10-24 02:27:30.683519+00:00. externally triggered: True> successful
2023-10-23 19:27:33,122 INFO - DagRun Finished: dag_id=one_task_dag, execution_date=2023-10-24 02:27:30.639583+00:00, run_id=manual__2023-10-24T02:27:30.639583+00:00, run_start_date=2023-10-24 02:27:31.561425+00:00, run_end_date=2023-10-24 02:27:33.122917+00:00, run_duration=1.561492, state=success, external_trigger=True, run_type=manual, data_interval_start=2023-10-24 02:27:30.639583+00:00, data_interval_end=2023-10-24 02:27:30.639583+00:00, dag_hash=02922e8c970c3875a3986a665faffe01
2023-10-23 19:27:33,124 INFO - Setting next_dagrun for one_task_dag to None, run_after=None
2023-10-23 19:28:23,202 INFO - Resetting orphaned tasks for active dag runs
2023-10-23 19:33:23,237 INFO - Resetting orphaned tasks for active dag runs
2023-10-23 19:38:23,273 INFO - Resetting orphaned tasks for active dag runs
2023-10-23 19:43:03,902 INFO - Exiting gracefully upon receiving signal 15
2023-10-23 19:43:04,921 INFO - Sending Signals.SIGTERM to group 66562. PIDs of all processes in the group: [66562]
2023-10-23 19:43:04,922 INFO - Sending the signal Signals.SIGTERM to group 66562
2023-10-23 19:43:05,348 INFO - Process psutil.Process(pid=66562, status='terminated', exitcode=0, started='18:58:22') (66562) terminated with exit code 0
2023-10-23 19:43:05,355 INFO - Sending Signals.SIGTERM to group 66562. PIDs of all processes in the group: []
2023-10-23 19:43:05,355 INFO - Sending the signal Signals.SIGTERM to group 66562
2023-10-23 19:43:05,356 INFO - Sending the signal Signals.SIGTERM to process 66562 as process group is missing.
2023-10-23 19:43:05,356 INFO - Exited execute loop
2023-10-23 19:43:29,044 INFO - Starting the scheduler
2023-10-23 19:43:29,044 INFO - Processing each file at most -1 times
2023-10-23 19:43:29,047 INFO - Loaded executor: SequentialExecutor
2023-10-23 19:43:29,049 INFO - Launched DagFileProcessorManager with pid: 71776
2023-10-23 19:43:29,053 INFO - Resetting orphaned tasks for active dag runs
2023-10-23 19:44:13,997 INFO - 1 tasks up for execution:
<TaskInstance: second_task_dag.one_task_0 manual__2023-10-24T02:44:12.599449+00:00 [scheduled]>
2023-10-23 19:44:13,998 INFO - DAG second_task_dag has 0/16 running and queued tasks
2023-10-23 19:44:13,998 INFO - Setting the following tasks to queued state:
<TaskInstance: second_task_dag.one_task_0 manual__2023-10-24T02:44:12.599449+00:00 [scheduled]>
2023-10-23 19:44:13,999 INFO - Sending TaskInstanceKey(dag_id='second_task_dag', task_id='one_task_0', run_id='manual__2023-10-24T02:44:12.599449+00:00', try_number=1, map_index=-1) to executor with priority 2 and queue default
2023-10-23 19:44:14,000 INFO - Adding to queue: ['airflow', 'tasks', 'run', 'second_task_dag', 'one_task_0', 'manual__2023-10-24T02:44:12.599449+00:00', '--local', '--subdir', 'DAGS_FOLDER/second_task_two_dag.py']
2023-10-23 19:44:14,001 INFO - Executing command: ['airflow', 'tasks', 'run', 'second_task_dag', 'one_task_0', 'manual__2023-10-24T02:44:12.599449+00:00', '--local', '--subdir', 'DAGS_FOLDER/second_task_two_dag.py']
2023-10-23 19:44:15,298 INFO - Executor reports execution of second_task_dag.one_task_0 run_id=manual__2023-10-24T02:44:12.599449+00:00 exited with status success for try_number 1
2023-10-23 19:44:15,303 INFO - TaskInstance Finished: dag_id=second_task_dag, task_id=one_task_0, run_id=manual__2023-10-24T02:44:12.599449+00:00, map_index=-1, run_start_date=2023-10-24 02:44:14.995598+00:00, run_end_date=2023-10-24 02:44:15.062589+00:00, run_duration=0.066991, state=success, executor_state=success, try_number=1, max_tries=0, job_id=5, pool=default_pool, queue=default, priority_weight=2, operator=BashOperator, queued_dttm=2023-10-24 02:44:13.999135+00:00, queued_by_job_id=4, pid=71841
2023-10-23 19:44:15,333 INFO - 1 tasks up for execution:
<TaskInstance: second_task_dag.one_task_1 manual__2023-10-24T02:44:12.599449+00:00 [scheduled]>
2023-10-23 19:44:15,334 INFO - DAG second_task_dag has 0/16 running and queued tasks
2023-10-23 19:44:15,334 INFO - Setting the following tasks to queued state:
<TaskInstance: second_task_dag.one_task_1 manual__2023-10-24T02:44:12.599449+00:00 [scheduled]>
2023-10-23 19:44:15,335 INFO - Sending TaskInstanceKey(dag_id='second_task_dag', task_id='one_task_1', run_id='manual__2023-10-24T02:44:12.599449+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default
2023-10-23 19:44:15,335 INFO - Adding to queue: ['airflow', 'tasks', 'run', 'second_task_dag', 'one_task_1', 'manual__2023-10-24T02:44:12.599449+00:00', '--local', '--subdir', 'DAGS_FOLDER/second_task_two_dag.py']
2023-10-23 19:44:15,336 INFO - Executing command: ['airflow', 'tasks', 'run', 'second_task_dag', 'one_task_1', 'manual__2023-10-24T02:44:12.599449+00:00', '--local', '--subdir', 'DAGS_FOLDER/second_task_two_dag.py']
2023-10-23 19:44:16,386 INFO - Executor reports execution of second_task_dag.one_task_1 run_id=manual__2023-10-24T02:44:12.599449+00:00 exited with status success for try_number 1
2023-10-23 19:44:16,393 INFO - TaskInstance Finished: dag_id=second_task_dag, task_id=one_task_1, run_id=manual__2023-10-24T02:44:12.599449+00:00, map_index=-1, run_start_date=2023-10-24 02:44:16.122365+00:00, run_end_date=2023-10-24 02:44:16.199224+00:00, run_duration=0.076859, state=success, executor_state=success, try_number=1, max_tries=0, job_id=6, pool=default_pool, queue=default, priority_weight=1, operator=BashOperator, queued_dttm=2023-10-24 02:44:15.334808+00:00, queued_by_job_id=4, pid=71845
2023-10-23 19:44:16,415 INFO - Marking run <DagRun second_task_dag @ 2023-10-24 02:44:12.599449+00:00: manual__2023-10-24T02:44:12.599449+00:00, state:running, queued_at: 2023-10-24 02:44:12.635093+00:00. externally triggered: True> successful
2023-10-23 19:44:16,416 INFO - DagRun Finished: dag_id=second_task_dag, execution_date=2023-10-24 02:44:12.599449+00:00, run_id=manual__2023-10-24T02:44:12.599449+00:00, run_start_date=2023-10-24 02:44:13.917138+00:00, run_end_date=2023-10-24 02:44:16.416509+00:00, run_duration=2.499371, state=success, external_trigger=True, run_type=manual, data_interval_start=2023-10-24 02:44:12.599449+00:00, data_interval_end=2023-10-24 02:44:12.599449+00:00, dag_hash=216f4ce1004cdd009479eb62cd5b0ae9
2023-10-23 19:44:16,418 INFO - Setting next_dagrun for second_task_dag to None, run_after=None
2023-10-23 19:45:55,631 INFO - 1 tasks up for execution:
<TaskInstance: second_task_dag.one_task_0 manual__2023-10-24T02:45:54.017326+00:00 [scheduled]>
2023-10-23 19:45:55,632 INFO - DAG second_task_dag has 0/16 running and queued tasks
2023-10-23 19:45:55,633 INFO - Setting the following tasks to queued state:
<TaskInstance: second_task_dag.one_task_0 manual__2023-10-24T02:45:54.017326+00:00 [scheduled]>
2023-10-23 19:45:55,639 INFO - Sending TaskInstanceKey(dag_id='second_task_dag', task_id='one_task_0', run_id='manual__2023-10-24T02:45:54.017326+00:00', try_number=1, map_index=-1) to executor with priority 2 and queue default
2023-10-23 19:45:55,640 INFO - Adding to queue: ['airflow', 'tasks', 'run', 'second_task_dag', 'one_task_0', 'manual__2023-10-24T02:45:54.017326+00:00', '--local', '--subdir', 'DAGS_FOLDER/second_task_two_dag.py']
2023-10-23 19:45:55,641 INFO - Executing command: ['airflow', 'tasks', 'run', 'second_task_dag', 'one_task_0', 'manual__2023-10-24T02:45:54.017326+00:00', '--local', '--subdir', 'DAGS_FOLDER/second_task_two_dag.py']
2023-10-23 19:45:56,922 INFO - Executor reports execution of second_task_dag.one_task_0 run_id=manual__2023-10-24T02:45:54.017326+00:00 exited with status success for try_number 1
2023-10-23 19:45:56,931 INFO - TaskInstance Finished: dag_id=second_task_dag, task_id=one_task_0, run_id=manual__2023-10-24T02:45:54.017326+00:00, map_index=-1, run_start_date=2023-10-24 02:45:56.642481+00:00, run_end_date=2023-10-24 02:45:56.715219+00:00, run_duration=0.072738, state=success, executor_state=success, try_number=1, max_tries=0, job_id=7, pool=default_pool, queue=default, priority_weight=2, operator=BashOperator, queued_dttm=2023-10-24 02:45:55.634171+00:00, queued_by_job_id=4, pid=71993
2023-10-23 19:45:56,958 INFO - 1 tasks up for execution:
<TaskInstance: second_task_dag.one_task_1 manual__2023-10-24T02:45:54.017326+00:00 [scheduled]>
2023-10-23 19:45:56,959 INFO - DAG second_task_dag has 0/16 running and queued tasks
2023-10-23 19:45:56,959 INFO - Setting the following tasks to queued state:
<TaskInstance: second_task_dag.one_task_1 manual__2023-10-24T02:45:54.017326+00:00 [scheduled]>
2023-10-23 19:45:56,960 INFO - Sending TaskInstanceKey(dag_id='second_task_dag', task_id='one_task_1', run_id='manual__2023-10-24T02:45:54.017326+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default
2023-10-23 19:45:56,960 INFO - Adding to queue: ['airflow', 'tasks', 'run', 'second_task_dag', 'one_task_1', 'manual__2023-10-24T02:45:54.017326+00:00', '--local', '--subdir', 'DAGS_FOLDER/second_task_two_dag.py']
2023-10-23 19:45:56,961 INFO - Executing command: ['airflow', 'tasks', 'run', 'second_task_dag', 'one_task_1', 'manual__2023-10-24T02:45:54.017326+00:00', '--local', '--subdir', 'DAGS_FOLDER/second_task_two_dag.py']
2023-10-23 19:45:57,985 INFO - Executor reports execution of second_task_dag.one_task_1 run_id=manual__2023-10-24T02:45:54.017326+00:00 exited with status success for try_number 1
2023-10-23 19:45:57,989 INFO - TaskInstance Finished: dag_id=second_task_dag, task_id=one_task_1, run_id=manual__2023-10-24T02:45:54.017326+00:00, map_index=-1, run_start_date=2023-10-24 02:45:57.768353+00:00, run_end_date=2023-10-24 02:45:57.829918+00:00, run_duration=0.061565, state=success, executor_state=success, try_number=1, max_tries=0, job_id=8, pool=default_pool, queue=default, priority_weight=1, operator=BashOperator, queued_dttm=2023-10-24 02:45:56.959772+00:00, queued_by_job_id=4, pid=71997
2023-10-23 19:45:58,011 INFO - Marking run <DagRun second_task_dag @ 2023-10-24 02:45:54.017326+00:00: manual__2023-10-24T02:45:54.017326+00:00, state:running, queued_at: 2023-10-24 02:45:54.023958+00:00. externally triggered: True> successful
2023-10-23 19:45:58,011 INFO - DagRun Finished: dag_id=second_task_dag, execution_date=2023-10-24 02:45:54.017326+00:00, run_id=manual__2023-10-24T02:45:54.017326+00:00, run_start_date=2023-10-24 02:45:55.603194+00:00, run_end_date=2023-10-24 02:45:58.011888+00:00, run_duration=2.408694, state=success, external_trigger=True, run_type=manual, data_interval_start=2023-10-24 02:45:54.017326+00:00, data_interval_end=2023-10-24 02:45:54.017326+00:00, dag_hash=216f4ce1004cdd009479eb62cd5b0ae9
2023-10-23 19:45:58,013 INFO - Setting next_dagrun for second_task_dag to None, run_after=None
2023-10-23 19:48:29,107 INFO - Resetting orphaned tasks for active dag runs
2023-10-23 19:53:29,149 INFO - Resetting orphaned tasks for active dag runs
2023-10-23 19:58:29,192 INFO - Resetting orphaned tasks for active dag runs
2023-10-23 20:11:30,537 INFO - Resetting orphaned tasks for active dag runs
2023-10-23 20:11:30,542 INFO - Marked 1 SchedulerJob instances as failed
2023-10-23 20:53:32,757 INFO - Resetting orphaned tasks for active dag runs
2023-10-23 21:18:42,744 INFO - Resetting orphaned tasks for active dag runs
2023-10-23 21:59:40,307 INFO - Resetting orphaned tasks for active dag runs
2023-10-23 22:48:02,549 INFO - Resetting orphaned tasks for active dag runs
2023-10-23 23:23:56,409 INFO - Resetting orphaned tasks for active dag runs
2023-10-24 00:55:47,516 INFO - Resetting orphaned tasks for active dag runs
2023-10-24 01:00:47,559 INFO - Resetting orphaned tasks for active dag runs
2023-10-24 01:05:47,757 INFO - Resetting orphaned tasks for active dag runs
2023-10-24 01:10:47,792 INFO - Resetting orphaned tasks for active dag runs
2023-10-24 01:15:47,827 INFO - Resetting orphaned tasks for active dag runs
2023-10-24 01:20:47,868 INFO - Resetting orphaned tasks for active dag runs
2023-10-24 01:25:47,911 INFO - Resetting orphaned tasks for active dag runs
2023-10-24 01:30:47,959 INFO - Resetting orphaned tasks for active dag runs
2023-10-24 01:35:47,990 INFO - Resetting orphaned tasks for active dag runs
2023-10-24 01:40:48,037 INFO - Resetting orphaned tasks for active dag runs
2023-10-24 01:45:48,254 INFO - Resetting orphaned tasks for active dag runs
2023-10-24 02:06:43,289 INFO - Resetting orphaned tasks for active dag runs
2023-10-24 02:26:43,977 INFO - Resetting orphaned tasks for active dag runs
2023-10-24 02:31:44,019 INFO - Resetting orphaned tasks for active dag runs
2023-10-24 02:36:44,028 INFO - Resetting orphaned tasks for active dag runs
2023-10-24 03:38:32,043 INFO - Resetting orphaned tasks for active dag runs
2023-10-24 03:43:32,496 INFO - Resetting orphaned tasks for active dag runs
2023-10-24 03:48:32,533 INFO - Resetting orphaned tasks for active dag runs
2023-10-24 04:27:19,240 INFO - Resetting orphaned tasks for active dag runs
2023-10-24 04:47:54,708 INFO - Resetting orphaned tasks for active dag runs
2023-10-24 04:52:54,743 INFO - Resetting orphaned tasks for active dag runs
2023-10-24 04:57:54,787 INFO - Resetting orphaned tasks for active dag runs
2023-10-24 05:39:11,065 INFO - Resetting orphaned tasks for active dag runs
2023-10-24 05:44:11,119 INFO - Resetting orphaned tasks for active dag runs
2023-10-24 05:49:11,176 INFO - Resetting orphaned tasks for active dag runs
2023-10-24 06:41:28,744 INFO - Resetting orphaned tasks for active dag runs
2023-10-24 06:41:28,751 INFO - Marked 1 SchedulerJob instances as failed
2023-10-24 06:46:28,768 INFO - Resetting orphaned tasks for active dag runs
2023-10-24 06:51:28,810 INFO - Resetting orphaned tasks for active dag runs
2023-10-24 06:56:28,871 INFO - Resetting orphaned tasks for active dag runs
2023-10-24 07:33:21,191 INFO - Resetting orphaned tasks for active dag runs
2023-10-24 07:43:18,793 INFO - Resetting orphaned tasks for active dag runs
2023-10-24 07:48:18,837 INFO - Resetting orphaned tasks for active dag runs
2023-10-24 07:53:18,885 INFO - Resetting orphaned tasks for active dag runs
2023-10-24 08:58:44,528 INFO - Resetting orphaned tasks for active dag runs
2023-10-24 09:32:22,252 INFO - Resetting orphaned tasks for active dag runs
2023-10-24 09:41:33,113 INFO - Resetting orphaned tasks for active dag runs
2023-10-24 09:46:33,158 INFO - Resetting orphaned tasks for active dag runs
2023-10-24 09:59:51,663 INFO - Resetting orphaned tasks for active dag runs
2023-10-24 10:33:27,498 INFO - Resetting orphaned tasks for active dag runs
2023-10-24 10:44:51,411 INFO - Resetting orphaned tasks for active dag runs
2023-10-24 11:12:18,791 INFO - Resetting orphaned tasks for active dag runs
2023-10-24 11:27:58,488 INFO - Resetting orphaned tasks for active dag runs
2023-10-24 11:27:58,499 INFO - Marked 1 SchedulerJob instances as failed
2023-10-24 11:32:58,544 INFO - Resetting orphaned tasks for active dag runs
2023-10-24 11:37:58,586 INFO - Resetting orphaned tasks for active dag runs
2023-10-24 11:42:58,629 INFO - Resetting orphaned tasks for active dag runs
2023-10-24 11:47:58,674 INFO - Resetting orphaned tasks for active dag runs
2023-10-24 11:52:58,723 INFO - Resetting orphaned tasks for active dag runs
2023-10-24 11:57:58,770 INFO - Resetting orphaned tasks for active dag runs
2023-10-24 12:02:58,825 INFO - Resetting orphaned tasks for active dag runs
2023-10-24 12:07:58,886 INFO - Resetting orphaned tasks for active dag runs
2023-10-24 12:12:58,919 INFO - Resetting orphaned tasks for active dag runs
2023-10-24 12:17:58,960 INFO - Resetting orphaned tasks for active dag runs
2023-10-24 12:33:00,692 INFO - Resetting orphaned tasks for active dag runs
2023-10-24 12:42:23,216 INFO - Exiting gracefully upon receiving signal 15
2023-10-24 12:42:24,233 INFO - Sending Signals.SIGTERM to group 71776. PIDs of all processes in the group: [71776]
2023-10-24 12:42:24,235 INFO - Sending the signal Signals.SIGTERM to group 71776
2023-10-24 12:42:24,700 INFO - Process psutil.Process(pid=71776, status='terminated', exitcode=0, started='19:43:29') (71776) terminated with exit code 0
2023-10-24 12:42:24,709 INFO - Sending Signals.SIGTERM to group 71776. PIDs of all processes in the group: []
2023-10-24 12:42:24,709 INFO - Sending the signal Signals.SIGTERM to group 71776
2023-10-24 12:42:24,709 INFO - Sending the signal Signals.SIGTERM to process 71776 as process group is missing.
2023-10-24 12:42:24,710 INFO - Exited execute loop
2023-10-24 13:29:20,934 INFO - Starting the scheduler
2023-10-24 13:29:20,935 INFO - Processing each file at most -1 times
2023-10-24 13:29:20,937 INFO - Loaded executor: SequentialExecutor
2023-10-24 13:29:20,939 INFO - Launched DagFileProcessorManager with pid: 1703
2023-10-24 13:29:20,941 INFO - Resetting orphaned tasks for active dag runs
2023-10-24 13:34:20,965 INFO - Resetting orphaned tasks for active dag runs
2023-10-24 13:34:47,236 INFO - Exiting gracefully upon receiving signal 15
2023-10-24 13:34:48,253 INFO - Sending Signals.SIGTERM to group 1703. PIDs of all processes in the group: [1703]
2023-10-24 13:34:48,255 INFO - Sending the signal Signals.SIGTERM to group 1703
2023-10-24 13:34:48,602 INFO - Process psutil.Process(pid=1703, status='terminated', exitcode=0, started='13:29:20') (1703) terminated with exit code 0
2023-10-24 13:34:48,608 INFO - Sending Signals.SIGTERM to group 1703. PIDs of all processes in the group: []
2023-10-24 13:34:48,608 INFO - Sending the signal Signals.SIGTERM to group 1703
2023-10-24 13:34:48,609 INFO - Sending the signal Signals.SIGTERM to process 1703 as process group is missing.
2023-10-24 13:34:48,609 INFO - Exited execute loop
2023-10-24 13:37:51,463 INFO - Starting the scheduler
2023-10-24 13:37:51,464 INFO - Processing each file at most -1 times
2023-10-24 13:37:51,467 INFO - Loaded executor: SequentialExecutor
2023-10-24 13:37:51,470 INFO - Launched DagFileProcessorManager with pid: 2597
2023-10-24 13:37:51,471 INFO - Resetting orphaned tasks for active dag runs
2023-10-24 13:41:20,684 INFO - Exiting gracefully upon receiving signal 15
2023-10-24 13:41:21,696 INFO - Sending Signals.SIGTERM to group 2597. PIDs of all processes in the group: [2597]
2023-10-24 13:41:21,697 INFO - Sending the signal Signals.SIGTERM to group 2597
2023-10-24 13:41:21,998 INFO - Process psutil.Process(pid=2597, status='terminated', exitcode=0, started='13:37:51') (2597) terminated with exit code 0
2023-10-24 13:41:22,003 INFO - Sending Signals.SIGTERM to group 2597. PIDs of all processes in the group: []
2023-10-24 13:41:22,004 INFO - Sending the signal Signals.SIGTERM to group 2597
2023-10-24 13:41:22,004 INFO - Sending the signal Signals.SIGTERM to process 2597 as process group is missing.
2023-10-24 13:41:22,004 INFO - Exited execute loop
2023-10-24 13:58:16,810 INFO - Starting the scheduler
2023-10-24 13:58:16,811 INFO - Processing each file at most -1 times
2023-10-24 13:58:16,813 INFO - Loaded executor: SequentialExecutor
2023-10-24 13:58:16,816 INFO - Launched DagFileProcessorManager with pid: 4468
2023-10-24 13:58:16,817 INFO - Resetting orphaned tasks for active dag runs
2023-10-24 13:58:18,574 INFO - 2 tasks up for execution:
<TaskInstance: extract_dag.extract_task manual__2023-10-24T20:53:22.436374+00:00 [scheduled]>
<TaskInstance: extract_dag.extract_task manual__2023-10-24T20:53:52.472045+00:00 [scheduled]>
2023-10-24 13:58:18,574 INFO - DAG extract_dag has 0/16 running and queued tasks
2023-10-24 13:58:18,575 INFO - DAG extract_dag has 1/16 running and queued tasks
2023-10-24 13:58:18,575 INFO - Setting the following tasks to queued state:
<TaskInstance: extract_dag.extract_task manual__2023-10-24T20:53:22.436374+00:00 [scheduled]>
<TaskInstance: extract_dag.extract_task manual__2023-10-24T20:53:52.472045+00:00 [scheduled]>
2023-10-24 13:58:18,576 INFO - Sending TaskInstanceKey(dag_id='extract_dag', task_id='extract_task', run_id='manual__2023-10-24T20:53:22.436374+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default
2023-10-24 13:58:18,576 INFO - Adding to queue: ['airflow', 'tasks', 'run', 'extract_dag', 'extract_task', 'manual__2023-10-24T20:53:22.436374+00:00', '--local', '--subdir', 'DAGS_FOLDER/automate_extraction_dag.py']
2023-10-24 13:58:18,577 INFO - Sending TaskInstanceKey(dag_id='extract_dag', task_id='extract_task', run_id='manual__2023-10-24T20:53:52.472045+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default
2023-10-24 13:58:18,577 INFO - Adding to queue: ['airflow', 'tasks', 'run', 'extract_dag', 'extract_task', 'manual__2023-10-24T20:53:52.472045+00:00', '--local', '--subdir', 'DAGS_FOLDER/automate_extraction_dag.py']
2023-10-24 13:58:18,578 INFO - Executing command: ['airflow', 'tasks', 'run', 'extract_dag', 'extract_task', 'manual__2023-10-24T20:53:22.436374+00:00', '--local', '--subdir', 'DAGS_FOLDER/automate_extraction_dag.py']
2023-10-24 13:58:19,748 INFO - Executing command: ['airflow', 'tasks', 'run', 'extract_dag', 'extract_task', 'manual__2023-10-24T20:53:52.472045+00:00', '--local', '--subdir', 'DAGS_FOLDER/automate_extraction_dag.py']
2023-10-24 13:58:20,941 INFO - Executor reports execution of extract_dag.extract_task run_id=manual__2023-10-24T20:53:22.436374+00:00 exited with status success for try_number 1
2023-10-24 13:58:20,942 INFO - Executor reports execution of extract_dag.extract_task run_id=manual__2023-10-24T20:53:52.472045+00:00 exited with status success for try_number 1
2023-10-24 13:58:20,950 INFO - TaskInstance Finished: dag_id=extract_dag, task_id=extract_task, run_id=manual__2023-10-24T20:53:22.436374+00:00, map_index=-1, run_start_date=2023-10-24 20:58:19.450159+00:00, run_end_date=2023-10-24 20:58:19.529632+00:00, run_duration=0.079473, state=failed, executor_state=success, try_number=1, max_tries=0, job_id=12, pool=default_pool, queue=default, priority_weight=1, operator=BashOperator, queued_dttm=2023-10-24 20:58:18.575838+00:00, queued_by_job_id=11, pid=4475
2023-10-24 13:58:20,950 INFO - TaskInstance Finished: dag_id=extract_dag, task_id=extract_task, run_id=manual__2023-10-24T20:53:52.472045+00:00, map_index=-1, run_start_date=2023-10-24 20:58:20.606110+00:00, run_end_date=2023-10-24 20:58:20.675826+00:00, run_duration=0.069716, state=failed, executor_state=success, try_number=1, max_tries=0, job_id=13, pool=default_pool, queue=default, priority_weight=1, operator=BashOperator, queued_dttm=2023-10-24 20:58:18.575838+00:00, queued_by_job_id=11, pid=4481
2023-10-24 13:58:22,112 ERROR - Marking run <DagRun extract_dag @ 2023-10-24 20:53:22.436374+00:00: manual__2023-10-24T20:53:22.436374+00:00, state:running, queued_at: 2023-10-24 20:53:22.459807+00:00. externally triggered: True> failed
2023-10-24 13:58:22,114 INFO - DagRun Finished: dag_id=extract_dag, execution_date=2023-10-24 20:53:22.436374+00:00, run_id=manual__2023-10-24T20:53:22.436374+00:00, run_start_date=2023-10-24 20:58:18.558069+00:00, run_end_date=2023-10-24 20:58:22.114366+00:00, run_duration=3.556297, state=failed, external_trigger=True, run_type=manual, data_interval_start=2023-10-24 20:53:22.436374+00:00, data_interval_end=2023-10-24 20:53:22.436374+00:00, dag_hash=b0c641ba157fc0cc03a5d59fc0192311
2023-10-24 13:58:22,116 INFO - Setting next_dagrun for extract_dag to None, run_after=None
2023-10-24 13:58:22,117 ERROR - Marking run <DagRun extract_dag @ 2023-10-24 20:53:52.472045+00:00: manual__2023-10-24T20:53:52.472045+00:00, state:running, queued_at: 2023-10-24 20:53:52.493530+00:00. externally triggered: True> failed
2023-10-24 13:58:22,117 INFO - DagRun Finished: dag_id=extract_dag, execution_date=2023-10-24 20:53:52.472045+00:00, run_id=manual__2023-10-24T20:53:52.472045+00:00, run_start_date=2023-10-24 20:58:18.558103+00:00, run_end_date=2023-10-24 20:58:22.117605+00:00, run_duration=3.559502, state=failed, external_trigger=True, run_type=manual, data_interval_start=2023-10-24 20:53:52.472045+00:00, data_interval_end=2023-10-24 20:53:52.472045+00:00, dag_hash=b0c641ba157fc0cc03a5d59fc0192311
2023-10-24 13:58:22,118 INFO - Setting next_dagrun for extract_dag to None, run_after=None
2023-10-24 13:58:26,154 INFO - 1 tasks up for execution:
<TaskInstance: extract_dag.extract_task manual__2023-10-24T20:58:25.894245+00:00 [scheduled]>
2023-10-24 13:58:26,155 INFO - DAG extract_dag has 0/16 running and queued tasks
2023-10-24 13:58:26,155 INFO - Setting the following tasks to queued state:
<TaskInstance: extract_dag.extract_task manual__2023-10-24T20:58:25.894245+00:00 [scheduled]>
2023-10-24 13:58:26,157 INFO - Sending TaskInstanceKey(dag_id='extract_dag', task_id='extract_task', run_id='manual__2023-10-24T20:58:25.894245+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default
2023-10-24 13:58:26,157 INFO - Adding to queue: ['airflow', 'tasks', 'run', 'extract_dag', 'extract_task', 'manual__2023-10-24T20:58:25.894245+00:00', '--local', '--subdir', 'DAGS_FOLDER/automate_extraction_dag.py']
2023-10-24 13:58:26,158 INFO - Executing command: ['airflow', 'tasks', 'run', 'extract_dag', 'extract_task', 'manual__2023-10-24T20:58:25.894245+00:00', '--local', '--subdir', 'DAGS_FOLDER/automate_extraction_dag.py']
2023-10-24 13:58:27,300 INFO - Executor reports execution of extract_dag.extract_task run_id=manual__2023-10-24T20:58:25.894245+00:00 exited with status success for try_number 1
2023-10-24 13:58:27,305 INFO - TaskInstance Finished: dag_id=extract_dag, task_id=extract_task, run_id=manual__2023-10-24T20:58:25.894245+00:00, map_index=-1, run_start_date=2023-10-24 20:58:27.033327+00:00, run_end_date=2023-10-24 20:58:27.106031+00:00, run_duration=0.072704, state=failed, executor_state=success, try_number=1, max_tries=0, job_id=14, pool=default_pool, queue=default, priority_weight=1, operator=BashOperator, queued_dttm=2023-10-24 20:58:26.156338+00:00, queued_by_job_id=11, pid=4496
2023-10-24 13:58:27,335 ERROR - Marking run <DagRun extract_dag @ 2023-10-24 20:58:25.894245+00:00: manual__2023-10-24T20:58:25.894245+00:00, state:running, queued_at: 2023-10-24 20:58:25.912683+00:00. externally triggered: True> failed
2023-10-24 13:58:27,335 INFO - DagRun Finished: dag_id=extract_dag, execution_date=2023-10-24 20:58:25.894245+00:00, run_id=manual__2023-10-24T20:58:25.894245+00:00, run_start_date=2023-10-24 20:58:26.147134+00:00, run_end_date=2023-10-24 20:58:27.335487+00:00, run_duration=1.188353, state=failed, external_trigger=True, run_type=manual, data_interval_start=2023-10-24 20:58:25.894245+00:00, data_interval_end=2023-10-24 20:58:25.894245+00:00, dag_hash=b0c641ba157fc0cc03a5d59fc0192311
2023-10-24 13:58:27,336 INFO - Setting next_dagrun for extract_dag to None, run_after=None
2023-10-24 14:00:54,847 INFO - 1 tasks up for execution:
<TaskInstance: extract_dag.extract_task manual__2023-10-24T21:00:53.980031+00:00 [scheduled]>
2023-10-24 14:00:54,849 INFO - DAG extract_dag has 0/16 running and queued tasks
2023-10-24 14:00:54,849 INFO - Setting the following tasks to queued state:
<TaskInstance: extract_dag.extract_task manual__2023-10-24T21:00:53.980031+00:00 [scheduled]>
2023-10-24 14:00:54,852 INFO - Sending TaskInstanceKey(dag_id='extract_dag', task_id='extract_task', run_id='manual__2023-10-24T21:00:53.980031+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default
2023-10-24 14:00:54,853 INFO - Adding to queue: ['airflow', 'tasks', 'run', 'extract_dag', 'extract_task', 'manual__2023-10-24T21:00:53.980031+00:00', '--local', '--subdir', 'DAGS_FOLDER/automate_extraction_dag.py']
2023-10-24 14:00:54,854 INFO - Executing command: ['airflow', 'tasks', 'run', 'extract_dag', 'extract_task', 'manual__2023-10-24T21:00:53.980031+00:00', '--local', '--subdir', 'DAGS_FOLDER/automate_extraction_dag.py']
2023-10-24 14:00:56,275 INFO - Executor reports execution of extract_dag.extract_task run_id=manual__2023-10-24T21:00:53.980031+00:00 exited with status success for try_number 1
2023-10-24 14:00:56,279 INFO - TaskInstance Finished: dag_id=extract_dag, task_id=extract_task, run_id=manual__2023-10-24T21:00:53.980031+00:00, map_index=-1, run_start_date=2023-10-24 21:00:56.013714+00:00, run_end_date=2023-10-24 21:00:56.086787+00:00, run_duration=0.073073, state=failed, executor_state=success, try_number=1, max_tries=0, job_id=15, pool=default_pool, queue=default, priority_weight=1, operator=BashOperator, queued_dttm=2023-10-24 21:00:54.850669+00:00, queued_by_job_id=11, pid=4716
2023-10-24 14:00:57,184 ERROR - Marking run <DagRun extract_dag @ 2023-10-24 21:00:53.980031+00:00: manual__2023-10-24T21:00:53.980031+00:00, state:running, queued_at: 2023-10-24 21:00:53.994230+00:00. externally triggered: True> failed
2023-10-24 14:00:57,184 INFO - DagRun Finished: dag_id=extract_dag, execution_date=2023-10-24 21:00:53.980031+00:00, run_id=manual__2023-10-24T21:00:53.980031+00:00, run_start_date=2023-10-24 21:00:54.827686+00:00, run_end_date=2023-10-24 21:00:57.184668+00:00, run_duration=2.356982, state=failed, external_trigger=True, run_type=manual, data_interval_start=2023-10-24 21:00:53.980031+00:00, data_interval_end=2023-10-24 21:00:53.980031+00:00, dag_hash=b0c641ba157fc0cc03a5d59fc0192311
2023-10-24 14:00:57,185 INFO - Setting next_dagrun for extract_dag to None, run_after=None
2023-10-24 14:01:33,299 INFO - 1 tasks up for execution:
<TaskInstance: one_task_dag.one_task manual__2023-10-24T21:01:32.463029+00:00 [scheduled]>
2023-10-24 14:01:33,300 INFO - DAG one_task_dag has 0/16 running and queued tasks
2023-10-24 14:01:33,300 INFO - Setting the following tasks to queued state:
<TaskInstance: one_task_dag.one_task manual__2023-10-24T21:01:32.463029+00:00 [scheduled]>
2023-10-24 14:01:33,301 INFO - Sending TaskInstanceKey(dag_id='one_task_dag', task_id='one_task', run_id='manual__2023-10-24T21:01:32.463029+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default
2023-10-24 14:01:33,302 INFO - Adding to queue: ['airflow', 'tasks', 'run', 'one_task_dag', 'one_task', 'manual__2023-10-24T21:01:32.463029+00:00', '--local', '--subdir', 'DAGS_FOLDER/one_task_dag.py']
2023-10-24 14:01:33,302 INFO - Executing command: ['airflow', 'tasks', 'run', 'one_task_dag', 'one_task', 'manual__2023-10-24T21:01:32.463029+00:00', '--local', '--subdir', 'DAGS_FOLDER/one_task_dag.py']
2023-10-24 14:01:34,354 INFO - Executor reports execution of one_task_dag.one_task run_id=manual__2023-10-24T21:01:32.463029+00:00 exited with status success for try_number 1
2023-10-24 14:01:34,357 INFO - TaskInstance Finished: dag_id=one_task_dag, task_id=one_task, run_id=manual__2023-10-24T21:01:32.463029+00:00, map_index=-1, run_start_date=2023-10-24 21:01:34.133655+00:00, run_end_date=2023-10-24 21:01:34.200211+00:00, run_duration=0.066556, state=success, executor_state=success, try_number=1, max_tries=0, job_id=16, pool=default_pool, queue=default, priority_weight=1, operator=BashOperator, queued_dttm=2023-10-24 21:01:33.301134+00:00, queued_by_job_id=11, pid=4776
2023-10-24 14:01:34,386 INFO - Marking run <DagRun one_task_dag @ 2023-10-24 21:01:32.463029+00:00: manual__2023-10-24T21:01:32.463029+00:00, state:running, queued_at: 2023-10-24 21:01:32.474030+00:00. externally triggered: True> successful
2023-10-24 14:01:34,387 INFO - DagRun Finished: dag_id=one_task_dag, execution_date=2023-10-24 21:01:32.463029+00:00, run_id=manual__2023-10-24T21:01:32.463029+00:00, run_start_date=2023-10-24 21:01:33.290679+00:00, run_end_date=2023-10-24 21:01:34.387235+00:00, run_duration=1.096556, state=success, external_trigger=True, run_type=manual, data_interval_start=2023-10-24 21:01:32.463029+00:00, data_interval_end=2023-10-24 21:01:32.463029+00:00, dag_hash=02922e8c970c3875a3986a665faffe01
2023-10-24 14:01:34,388 INFO - Setting next_dagrun for one_task_dag to None, run_after=None
2023-10-24 14:01:58,772 INFO - 1 tasks up for execution:
<TaskInstance: extract_dag.extract_task manual__2023-10-24T21:01:57.648495+00:00 [scheduled]>
2023-10-24 14:01:58,774 INFO - DAG extract_dag has 0/16 running and queued tasks
2023-10-24 14:01:58,775 INFO - Setting the following tasks to queued state:
<TaskInstance: extract_dag.extract_task manual__2023-10-24T21:01:57.648495+00:00 [scheduled]>
2023-10-24 14:01:58,777 INFO - Sending TaskInstanceKey(dag_id='extract_dag', task_id='extract_task', run_id='manual__2023-10-24T21:01:57.648495+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default
2023-10-24 14:01:58,777 INFO - Adding to queue: ['airflow', 'tasks', 'run', 'extract_dag', 'extract_task', 'manual__2023-10-24T21:01:57.648495+00:00', '--local', '--subdir', 'DAGS_FOLDER/automate_extraction_dag.py']
2023-10-24 14:01:58,779 INFO - Executing command: ['airflow', 'tasks', 'run', 'extract_dag', 'extract_task', 'manual__2023-10-24T21:01:57.648495+00:00', '--local', '--subdir', 'DAGS_FOLDER/automate_extraction_dag.py']
2023-10-24 14:02:00,030 INFO - Executor reports execution of extract_dag.extract_task run_id=manual__2023-10-24T21:01:57.648495+00:00 exited with status success for try_number 1
2023-10-24 14:02:00,034 INFO - TaskInstance Finished: dag_id=extract_dag, task_id=extract_task, run_id=manual__2023-10-24T21:01:57.648495+00:00, map_index=-1, run_start_date=2023-10-24 21:01:59.750334+00:00, run_end_date=2023-10-24 21:01:59.821346+00:00, run_duration=0.071012, state=failed, executor_state=success, try_number=1, max_tries=0, job_id=17, pool=default_pool, queue=default, priority_weight=1, operator=BashOperator, queued_dttm=2023-10-24 21:01:58.775958+00:00, queued_by_job_id=11, pid=4811
2023-10-24 14:02:00,931 ERROR - Marking run <DagRun extract_dag @ 2023-10-24 21:01:57.648495+00:00: manual__2023-10-24T21:01:57.648495+00:00, state:running, queued_at: 2023-10-24 21:01:57.656682+00:00. externally triggered: True> failed
2023-10-24 14:02:00,931 INFO - DagRun Finished: dag_id=extract_dag, execution_date=2023-10-24 21:01:57.648495+00:00, run_id=manual__2023-10-24T21:01:57.648495+00:00, run_start_date=2023-10-24 21:01:58.752516+00:00, run_end_date=2023-10-24 21:02:00.931416+00:00, run_duration=2.1789, state=failed, external_trigger=True, run_type=manual, data_interval_start=2023-10-24 21:01:57.648495+00:00, data_interval_end=2023-10-24 21:01:57.648495+00:00, dag_hash=b3d69f8c566103cc2f4861910cb412b7
2023-10-24 14:02:00,932 INFO - Setting next_dagrun for extract_dag to None, run_after=None
2023-10-24 14:03:16,842 INFO - Resetting orphaned tasks for active dag runs
2023-10-24 14:03:28,504 INFO - 1 tasks up for execution:
<TaskInstance: extract_dag.extract_task manual__2023-10-24T21:03:27.708764+00:00 [scheduled]>
2023-10-24 14:03:28,506 INFO - DAG extract_dag has 0/16 running and queued tasks
2023-10-24 14:03:28,506 INFO - Setting the following tasks to queued state:
<TaskInstance: extract_dag.extract_task manual__2023-10-24T21:03:27.708764+00:00 [scheduled]>
2023-10-24 14:03:28,509 INFO - Sending TaskInstanceKey(dag_id='extract_dag', task_id='extract_task', run_id='manual__2023-10-24T21:03:27.708764+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default
2023-10-24 14:03:28,509 INFO - Adding to queue: ['airflow', 'tasks', 'run', 'extract_dag', 'extract_task', 'manual__2023-10-24T21:03:27.708764+00:00', '--local', '--subdir', 'DAGS_FOLDER/automate_extraction_dag.py']
2023-10-24 14:03:28,511 INFO - Executing command: ['airflow', 'tasks', 'run', 'extract_dag', 'extract_task', 'manual__2023-10-24T21:03:27.708764+00:00', '--local', '--subdir', 'DAGS_FOLDER/automate_extraction_dag.py']
2023-10-24 14:03:29,976 INFO - Executor reports execution of extract_dag.extract_task run_id=manual__2023-10-24T21:03:27.708764+00:00 exited with status success for try_number 1
2023-10-24 14:03:29,982 INFO - TaskInstance Finished: dag_id=extract_dag, task_id=extract_task, run_id=manual__2023-10-24T21:03:27.708764+00:00, map_index=-1, run_start_date=2023-10-24 21:03:29.707591+00:00, run_end_date=2023-10-24 21:03:29.796306+00:00, run_duration=0.088715, state=failed, executor_state=success, try_number=1, max_tries=0, job_id=18, pool=default_pool, queue=default, priority_weight=1, operator=BashOperator, queued_dttm=2023-10-24 21:03:28.507692+00:00, queued_by_job_id=11, pid=4932
2023-10-24 14:03:30,005 ERROR - Marking run <DagRun extract_dag @ 2023-10-24 21:03:27.708764+00:00: manual__2023-10-24T21:03:27.708764+00:00, state:running, queued_at: 2023-10-24 21:03:27.717944+00:00. externally triggered: True> failed
2023-10-24 14:03:30,005 INFO - DagRun Finished: dag_id=extract_dag, execution_date=2023-10-24 21:03:27.708764+00:00, run_id=manual__2023-10-24T21:03:27.708764+00:00, run_start_date=2023-10-24 21:03:28.483052+00:00, run_end_date=2023-10-24 21:03:30.005462+00:00, run_duration=1.52241, state=failed, external_trigger=True, run_type=manual, data_interval_start=2023-10-24 21:03:27.708764+00:00, data_interval_end=2023-10-24 21:03:27.708764+00:00, dag_hash=b3d69f8c566103cc2f4861910cb412b7
2023-10-24 14:03:30,006 INFO - Setting next_dagrun for extract_dag to None, run_after=None
2023-10-24 14:04:06,472 INFO - 1 tasks up for execution:
<TaskInstance: extract_dag.extract_task manual__2023-10-24T21:04:05.628105+00:00 [scheduled]>
2023-10-24 14:04:06,474 INFO - DAG extract_dag has 0/16 running and queued tasks
2023-10-24 14:04:06,474 INFO - Setting the following tasks to queued state:
<TaskInstance: extract_dag.extract_task manual__2023-10-24T21:04:05.628105+00:00 [scheduled]>
2023-10-24 14:04:06,475 INFO - Sending TaskInstanceKey(dag_id='extract_dag', task_id='extract_task', run_id='manual__2023-10-24T21:04:05.628105+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default
2023-10-24 14:04:06,476 INFO - Adding to queue: ['airflow', 'tasks', 'run', 'extract_dag', 'extract_task', 'manual__2023-10-24T21:04:05.628105+00:00', '--local', '--subdir', 'DAGS_FOLDER/automate_extraction_dag.py']
2023-10-24 14:04:06,476 INFO - Executing command: ['airflow', 'tasks', 'run', 'extract_dag', 'extract_task', 'manual__2023-10-24T21:04:05.628105+00:00', '--local', '--subdir', 'DAGS_FOLDER/automate_extraction_dag.py']
2023-10-24 14:04:07,557 INFO - Executor reports execution of extract_dag.extract_task run_id=manual__2023-10-24T21:04:05.628105+00:00 exited with status success for try_number 1
2023-10-24 14:04:07,561 INFO - TaskInstance Finished: dag_id=extract_dag, task_id=extract_task, run_id=manual__2023-10-24T21:04:05.628105+00:00, map_index=-1, run_start_date=2023-10-24 21:04:07.281438+00:00, run_end_date=2023-10-24 21:04:07.350242+00:00, run_duration=0.068804, state=failed, executor_state=success, try_number=1, max_tries=0, job_id=19, pool=default_pool, queue=default, priority_weight=1, operator=BashOperator, queued_dttm=2023-10-24 21:04:06.475113+00:00, queued_by_job_id=11, pid=4999
2023-10-24 14:04:08,455 ERROR - Marking run <DagRun extract_dag @ 2023-10-24 21:04:05.628105+00:00: manual__2023-10-24T21:04:05.628105+00:00, state:running, queued_at: 2023-10-24 21:04:05.641875+00:00. externally triggered: True> failed
2023-10-24 14:04:08,456 INFO - DagRun Finished: dag_id=extract_dag, execution_date=2023-10-24 21:04:05.628105+00:00, run_id=manual__2023-10-24T21:04:05.628105+00:00, run_start_date=2023-10-24 21:04:06.465034+00:00, run_end_date=2023-10-24 21:04:08.456157+00:00, run_duration=1.991123, state=failed, external_trigger=True, run_type=manual, data_interval_start=2023-10-24 21:04:05.628105+00:00, data_interval_end=2023-10-24 21:04:05.628105+00:00, dag_hash=a20888f02f5491dc32f25ef3a036ffd5
2023-10-24 14:04:08,457 INFO - Setting next_dagrun for extract_dag to None, run_after=None
2023-10-24 14:05:37,133 INFO - Exiting gracefully upon receiving signal 15
2023-10-24 14:05:38,144 INFO - Sending Signals.SIGTERM to group 4468. PIDs of all processes in the group: [4468]
2023-10-24 14:05:38,145 INFO - Sending the signal Signals.SIGTERM to group 4468
2023-10-24 14:05:38,544 INFO - Process psutil.Process(pid=4468, status='terminated', exitcode=0, started='13:58:16') (4468) terminated with exit code 0
2023-10-24 14:05:38,550 INFO - Sending Signals.SIGTERM to group 4468. PIDs of all processes in the group: []
2023-10-24 14:05:38,550 INFO - Sending the signal Signals.SIGTERM to group 4468
2023-10-24 14:05:38,550 INFO - Sending the signal Signals.SIGTERM to process 4468 as process group is missing.
2023-10-24 14:05:38,551 INFO - Exited execute loop
2023-10-24 14:05:40,953 INFO - Starting the scheduler
2023-10-24 14:05:40,954 INFO - Processing each file at most -1 times
2023-10-24 14:05:40,956 INFO - Loaded executor: SequentialExecutor
2023-10-24 14:05:40,959 INFO - Launched DagFileProcessorManager with pid: 5154
2023-10-24 14:05:40,960 INFO - Resetting orphaned tasks for active dag runs
2023-10-24 14:05:51,041 INFO - 1 tasks up for execution:
<TaskInstance: extract_dag.extract_task manual__2023-10-24T21:05:49.835700+00:00 [scheduled]>
2023-10-24 14:05:51,042 INFO - DAG extract_dag has 0/16 running and queued tasks
2023-10-24 14:05:51,043 INFO - Setting the following tasks to queued state:
<TaskInstance: extract_dag.extract_task manual__2023-10-24T21:05:49.835700+00:00 [scheduled]>
2023-10-24 14:05:51,044 INFO - Sending TaskInstanceKey(dag_id='extract_dag', task_id='extract_task', run_id='manual__2023-10-24T21:05:49.835700+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default
2023-10-24 14:05:51,045 INFO - Adding to queue: ['airflow', 'tasks', 'run', 'extract_dag', 'extract_task', 'manual__2023-10-24T21:05:49.835700+00:00', '--local', '--subdir', 'DAGS_FOLDER/automate_extraction_dag.py']
2023-10-24 14:05:51,047 INFO - Executing command: ['airflow', 'tasks', 'run', 'extract_dag', 'extract_task', 'manual__2023-10-24T21:05:49.835700+00:00', '--local', '--subdir', 'DAGS_FOLDER/automate_extraction_dag.py']
2023-10-24 14:05:54,368 INFO - Executor reports execution of extract_dag.extract_task run_id=manual__2023-10-24T21:05:49.835700+00:00 exited with status success for try_number 1
2023-10-24 14:05:54,373 INFO - TaskInstance Finished: dag_id=extract_dag, task_id=extract_task, run_id=manual__2023-10-24T21:05:49.835700+00:00, map_index=-1, run_start_date=2023-10-24 21:05:51.894647+00:00, run_end_date=2023-10-24 21:05:54.155334+00:00, run_duration=2.260687, state=success, executor_state=success, try_number=1, max_tries=0, job_id=21, pool=default_pool, queue=default, priority_weight=1, operator=BashOperator, queued_dttm=2023-10-24 21:05:51.043886+00:00, queued_by_job_id=20, pid=5182
2023-10-24 14:05:54,401 INFO - Marking run <DagRun extract_dag @ 2023-10-24 21:05:49.835700+00:00: manual__2023-10-24T21:05:49.835700+00:00, state:running, queued_at: 2023-10-24 21:05:49.871821+00:00. externally triggered: True> successful
2023-10-24 14:05:54,402 INFO - DagRun Finished: dag_id=extract_dag, execution_date=2023-10-24 21:05:49.835700+00:00, run_id=manual__2023-10-24T21:05:49.835700+00:00, run_start_date=2023-10-24 21:05:51.019174+00:00, run_end_date=2023-10-24 21:05:54.402583+00:00, run_duration=3.383409, state=success, external_trigger=True, run_type=manual, data_interval_start=2023-10-24 21:05:49.835700+00:00, data_interval_end=2023-10-24 21:05:49.835700+00:00, dag_hash=ca019365fc918a7a65ed993e855a8712
2023-10-24 14:05:54,404 INFO - Setting next_dagrun for extract_dag to None, run_after=None
2023-10-24 14:10:40,996 INFO - Resetting orphaned tasks for active dag runs
2023-10-24 14:15:30,398 INFO - Exiting gracefully upon receiving signal 15
2023-10-24 14:15:31,414 INFO - Sending Signals.SIGTERM to group 5154. PIDs of all processes in the group: [5154]
2023-10-24 14:15:31,416 INFO - Sending the signal Signals.SIGTERM to group 5154
2023-10-24 14:15:31,718 INFO - Process psutil.Process(pid=5154, status='terminated', exitcode=0, started='14:05:40') (5154) terminated with exit code 0
2023-10-24 14:15:31,725 INFO - Sending Signals.SIGTERM to group 5154. PIDs of all processes in the group: []
2023-10-24 14:15:31,726 INFO - Sending the signal Signals.SIGTERM to group 5154
2023-10-24 14:15:31,726 INFO - Sending the signal Signals.SIGTERM to process 5154 as process group is missing.
2023-10-24 14:15:31,726 INFO - Exited execute loop
2023-10-24 14:15:32,987 INFO - Starting the scheduler
2023-10-24 14:15:32,988 INFO - Processing each file at most -1 times
2023-10-24 14:15:32,990 INFO - Loaded executor: SequentialExecutor
2023-10-24 14:15:32,992 INFO - Launched DagFileProcessorManager with pid: 6082
2023-10-24 14:15:32,994 INFO - Resetting orphaned tasks for active dag runs
2023-10-24 14:17:26,234 INFO - 1 tasks up for execution:
<TaskInstance: transform_dag.transform_task manual__2023-10-24T21:17:25.089233+00:00 [scheduled]>
2023-10-24 14:17:26,236 INFO - DAG transform_dag has 0/16 running and queued tasks
2023-10-24 14:17:26,242 INFO - Setting the following tasks to queued state:
<TaskInstance: transform_dag.transform_task manual__2023-10-24T21:17:25.089233+00:00 [scheduled]>
2023-10-24 14:17:26,244 INFO - Sending TaskInstanceKey(dag_id='transform_dag', task_id='transform_task', run_id='manual__2023-10-24T21:17:25.089233+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default
2023-10-24 14:17:26,244 INFO - Adding to queue: ['airflow', 'tasks', 'run', 'transform_dag', 'transform_task', 'manual__2023-10-24T21:17:25.089233+00:00', '--local', '--subdir', 'DAGS_FOLDER/autmate_transform_dag.py']
2023-10-24 14:17:26,246 INFO - Executing command: ['airflow', 'tasks', 'run', 'transform_dag', 'transform_task', 'manual__2023-10-24T21:17:25.089233+00:00', '--local', '--subdir', 'DAGS_FOLDER/autmate_transform_dag.py']
2023-10-24 14:17:27,589 INFO - Executor reports execution of transform_dag.transform_task run_id=manual__2023-10-24T21:17:25.089233+00:00 exited with status success for try_number 1
2023-10-24 14:17:27,595 INFO - TaskInstance Finished: dag_id=transform_dag, task_id=transform_task, run_id=manual__2023-10-24T21:17:25.089233+00:00, map_index=-1, run_start_date=2023-10-24 21:17:27.300013+00:00, run_end_date=2023-10-24 21:17:27.390022+00:00, run_duration=0.090009, state=success, executor_state=success, try_number=1, max_tries=0, job_id=23, pool=default_pool, queue=default, priority_weight=1, operator=PythonOperator, queued_dttm=2023-10-24 21:17:26.243074+00:00, queued_by_job_id=22, pid=6294
2023-10-24 14:17:27,617 INFO - Marking run <DagRun transform_dag @ 2023-10-24 21:17:25.089233+00:00: manual__2023-10-24T21:17:25.089233+00:00, state:running, queued_at: 2023-10-24 21:17:25.119302+00:00. externally triggered: True> successful
2023-10-24 14:17:27,618 INFO - DagRun Finished: dag_id=transform_dag, execution_date=2023-10-24 21:17:25.089233+00:00, run_id=manual__2023-10-24T21:17:25.089233+00:00, run_start_date=2023-10-24 21:17:26.207572+00:00, run_end_date=2023-10-24 21:17:27.618358+00:00, run_duration=1.410786, state=success, external_trigger=True, run_type=manual, data_interval_start=2023-10-24 21:17:25.089233+00:00, data_interval_end=2023-10-24 21:17:25.089233+00:00, dag_hash=e08dc4546b6771485e92afa9a1f1d5ba
2023-10-24 14:17:27,619 INFO - Setting next_dagrun for transform_dag to None, run_after=None
2023-10-24 14:20:33,027 INFO - Resetting orphaned tasks for active dag runs
2023-10-24 14:25:33,056 INFO - Resetting orphaned tasks for active dag runs
2023-10-24 14:30:33,085 INFO - Resetting orphaned tasks for active dag runs
2023-10-24 14:48:51,322 INFO - Resetting orphaned tasks for active dag runs
2023-10-24 14:53:51,358 INFO - Resetting orphaned tasks for active dag runs
2023-10-24 14:58:51,395 INFO - Resetting orphaned tasks for active dag runs
2023-10-24 15:03:51,434 INFO - Resetting orphaned tasks for active dag runs
2023-10-24 15:08:51,461 INFO - Resetting orphaned tasks for active dag runs
2023-10-24 15:13:51,490 INFO - Resetting orphaned tasks for active dag runs
2023-10-24 15:18:51,528 INFO - Resetting orphaned tasks for active dag runs
2023-10-24 15:23:51,565 INFO - Resetting orphaned tasks for active dag runs
2023-10-24 15:28:51,605 INFO - Resetting orphaned tasks for active dag runs
2023-10-24 15:33:52,476 INFO - Resetting orphaned tasks for active dag runs
2023-10-24 15:38:52,545 INFO - Resetting orphaned tasks for active dag runs
2023-10-24 15:43:53,479 INFO - Resetting orphaned tasks for active dag runs
2023-10-24 15:48:53,514 INFO - Resetting orphaned tasks for active dag runs
2023-10-24 15:53:53,533 INFO - Resetting orphaned tasks for active dag runs
2023-10-24 15:58:53,572 INFO - Resetting orphaned tasks for active dag runs
2023-10-24 16:03:53,625 INFO - Resetting orphaned tasks for active dag runs
2023-10-24 16:08:53,675 INFO - Resetting orphaned tasks for active dag runs
2023-10-24 16:13:53,712 INFO - Resetting orphaned tasks for active dag runs
2023-10-24 16:18:53,760 INFO - Resetting orphaned tasks for active dag runs
2023-10-24 16:23:53,802 INFO - Resetting orphaned tasks for active dag runs
2023-10-24 16:28:54,730 INFO - Resetting orphaned tasks for active dag runs
2023-10-24 16:33:54,767 INFO - Resetting orphaned tasks for active dag runs
2023-10-24 16:38:55,798 INFO - Resetting orphaned tasks for active dag runs
2023-10-24 16:43:55,828 INFO - Resetting orphaned tasks for active dag runs
2023-10-24 16:48:55,874 INFO - Resetting orphaned tasks for active dag runs
2023-10-24 16:53:55,920 INFO - Resetting orphaned tasks for active dag runs
2023-10-24 16:58:55,967 INFO - Resetting orphaned tasks for active dag runs
2023-10-24 17:03:56,495 INFO - Resetting orphaned tasks for active dag runs
2023-10-24 17:08:56,480 INFO - Resetting orphaned tasks for active dag runs
2023-10-24 17:13:56,516 INFO - Resetting orphaned tasks for active dag runs
2023-10-24 17:59:00,715 INFO - Resetting orphaned tasks for active dag runs
2023-10-24 17:59:00,718 INFO - Marked 1 SchedulerJob instances as failed
2023-10-24 19:14:59,124 INFO - Resetting orphaned tasks for active dag runs
2023-10-24 19:58:43,507 INFO - Resetting orphaned tasks for active dag runs
2023-10-24 20:02:30,162 INFO - 1 tasks up for execution:
<TaskInstance: load_dag.load_task manual__2023-10-25T03:02:29.885835+00:00 [scheduled]>
2023-10-24 20:02:30,163 INFO - DAG load_dag has 0/16 running and queued tasks
2023-10-24 20:02:30,163 INFO - Setting the following tasks to queued state:
<TaskInstance: load_dag.load_task manual__2023-10-25T03:02:29.885835+00:00 [scheduled]>
2023-10-24 20:02:30,166 INFO - Sending TaskInstanceKey(dag_id='load_dag', task_id='load_task', run_id='manual__2023-10-25T03:02:29.885835+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default
2023-10-24 20:02:30,166 INFO - Adding to queue: ['airflow', 'tasks', 'run', 'load_dag', 'load_task', 'manual__2023-10-25T03:02:29.885835+00:00', '--local', '--subdir', 'DAGS_FOLDER/automate_load_dag.py']
2023-10-24 20:02:30,167 INFO - Executing command: ['airflow', 'tasks', 'run', 'load_dag', 'load_task', 'manual__2023-10-25T03:02:29.885835+00:00', '--local', '--subdir', 'DAGS_FOLDER/automate_load_dag.py']
2023-10-24 20:02:31,531 INFO - Executor reports execution of load_dag.load_task run_id=manual__2023-10-25T03:02:29.885835+00:00 exited with status success for try_number 1
2023-10-24 20:02:31,536 INFO - TaskInstance Finished: dag_id=load_dag, task_id=load_task, run_id=manual__2023-10-25T03:02:29.885835+00:00, map_index=-1, run_start_date=2023-10-25 03:02:31.230433+00:00, run_end_date=2023-10-25 03:02:31.320113+00:00, run_duration=0.08968, state=success, executor_state=success, try_number=1, max_tries=0, job_id=24, pool=default_pool, queue=default, priority_weight=1, operator=BashOperator, queued_dttm=2023-10-25 03:02:30.163949+00:00, queued_by_job_id=22, pid=20543
2023-10-24 20:02:31,560 INFO - Marking run <DagRun load_dag @ 2023-10-25 03:02:29.885835+00:00: manual__2023-10-25T03:02:29.885835+00:00, state:running, queued_at: 2023-10-25 03:02:29.931282+00:00. externally triggered: True> successful
2023-10-24 20:02:31,560 INFO - DagRun Finished: dag_id=load_dag, execution_date=2023-10-25 03:02:29.885835+00:00, run_id=manual__2023-10-25T03:02:29.885835+00:00, run_start_date=2023-10-25 03:02:30.149780+00:00, run_end_date=2023-10-25 03:02:31.560449+00:00, run_duration=1.410669, state=success, external_trigger=True, run_type=manual, data_interval_start=2023-10-25 03:02:29.885835+00:00, data_interval_end=2023-10-25 03:02:29.885835+00:00, dag_hash=d5ae4c4aeabd077f07ac7a3bb283568c
2023-10-24 20:02:31,561 INFO - Setting next_dagrun for load_dag to None, run_after=None
2023-10-24 20:03:43,572 INFO - Resetting orphaned tasks for active dag runs
2023-10-24 20:07:29,147 INFO - 1 tasks up for execution:
<TaskInstance: transform_dag.transform_task manual__2023-10-25T03:07:28.184240+00:00 [scheduled]>
2023-10-24 20:07:29,150 INFO - DAG transform_dag has 0/16 running and queued tasks
2023-10-24 20:07:29,150 INFO - Setting the following tasks to queued state:
<TaskInstance: transform_dag.transform_task manual__2023-10-25T03:07:28.184240+00:00 [scheduled]>
2023-10-24 20:07:29,153 INFO - Sending TaskInstanceKey(dag_id='transform_dag', task_id='transform_task', run_id='manual__2023-10-25T03:07:28.184240+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default
2023-10-24 20:07:29,153 INFO - Adding to queue: ['airflow', 'tasks', 'run', 'transform_dag', 'transform_task', 'manual__2023-10-25T03:07:28.184240+00:00', '--local', '--subdir', 'DAGS_FOLDER/autmate_transform_dag.py']
2023-10-24 20:07:29,154 INFO - Executing command: ['airflow', 'tasks', 'run', 'transform_dag', 'transform_task', 'manual__2023-10-25T03:07:28.184240+00:00', '--local', '--subdir', 'DAGS_FOLDER/autmate_transform_dag.py']
2023-10-24 20:07:30,478 INFO - Executor reports execution of transform_dag.transform_task run_id=manual__2023-10-25T03:07:28.184240+00:00 exited with status success for try_number 1
2023-10-24 20:07:30,482 INFO - TaskInstance Finished: dag_id=transform_dag, task_id=transform_task, run_id=manual__2023-10-25T03:07:28.184240+00:00, map_index=-1, run_start_date=2023-10-25 03:07:30.197206+00:00, run_end_date=2023-10-25 03:07:30.293385+00:00, run_duration=0.096179, state=success, executor_state=success, try_number=1, max_tries=0, job_id=25, pool=default_pool, queue=default, priority_weight=1, operator=PythonOperator, queued_dttm=2023-10-25 03:07:29.151596+00:00, queued_by_job_id=22, pid=21111
2023-10-24 20:07:30,505 INFO - Marking run <DagRun transform_dag @ 2023-10-25 03:07:28.184240+00:00: manual__2023-10-25T03:07:28.184240+00:00, state:running, queued_at: 2023-10-25 03:07:28.226326+00:00. externally triggered: True> successful
2023-10-24 20:07:30,506 INFO - DagRun Finished: dag_id=transform_dag, execution_date=2023-10-25 03:07:28.184240+00:00, run_id=manual__2023-10-25T03:07:28.184240+00:00, run_start_date=2023-10-25 03:07:29.123388+00:00, run_end_date=2023-10-25 03:07:30.506319+00:00, run_duration=1.382931, state=success, external_trigger=True, run_type=manual, data_interval_start=2023-10-25 03:07:28.184240+00:00, data_interval_end=2023-10-25 03:07:28.184240+00:00, dag_hash=e08dc4546b6771485e92afa9a1f1d5ba
2023-10-24 20:07:30,507 INFO - Setting next_dagrun for transform_dag to None, run_after=None
2023-10-24 20:08:43,599 INFO - Resetting orphaned tasks for active dag runs
2023-10-24 20:08:55,062 INFO - 1 tasks up for execution:
<TaskInstance: transform_dag.transform_task manual__2023-10-25T03:08:54.904407+00:00 [scheduled]>
2023-10-24 20:08:55,064 INFO - DAG transform_dag has 0/16 running and queued tasks
2023-10-24 20:08:55,064 INFO - Setting the following tasks to queued state:
<TaskInstance: transform_dag.transform_task manual__2023-10-25T03:08:54.904407+00:00 [scheduled]>
2023-10-24 20:08:55,067 INFO - Sending TaskInstanceKey(dag_id='transform_dag', task_id='transform_task', run_id='manual__2023-10-25T03:08:54.904407+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default
2023-10-24 20:08:55,067 INFO - Adding to queue: ['airflow', 'tasks', 'run', 'transform_dag', 'transform_task', 'manual__2023-10-25T03:08:54.904407+00:00', '--local', '--subdir', 'DAGS_FOLDER/autmate_transform_dag.py']
2023-10-24 20:08:55,069 INFO - Executing command: ['airflow', 'tasks', 'run', 'transform_dag', 'transform_task', 'manual__2023-10-25T03:08:54.904407+00:00', '--local', '--subdir', 'DAGS_FOLDER/autmate_transform_dag.py']
2023-10-24 20:08:56,654 INFO - Executor reports execution of transform_dag.transform_task run_id=manual__2023-10-25T03:08:54.904407+00:00 exited with status success for try_number 1
2023-10-24 20:08:56,660 INFO - TaskInstance Finished: dag_id=transform_dag, task_id=transform_task, run_id=manual__2023-10-25T03:08:54.904407+00:00, map_index=-1, run_start_date=2023-10-25 03:08:56.358923+00:00, run_end_date=2023-10-25 03:08:56.435679+00:00, run_duration=0.076756, state=success, executor_state=success, try_number=1, max_tries=0, job_id=26, pool=default_pool, queue=default, priority_weight=1, operator=PythonOperator, queued_dttm=2023-10-25 03:08:55.065589+00:00, queued_by_job_id=22, pid=21257
2023-10-24 20:08:57,583 INFO - Marking run <DagRun transform_dag @ 2023-10-25 03:08:54.904407+00:00: manual__2023-10-25T03:08:54.904407+00:00, state:running, queued_at: 2023-10-25 03:08:54.922073+00:00. externally triggered: True> successful
2023-10-24 20:08:57,584 INFO - DagRun Finished: dag_id=transform_dag, execution_date=2023-10-25 03:08:54.904407+00:00, run_id=manual__2023-10-25T03:08:54.904407+00:00, run_start_date=2023-10-25 03:08:55.022170+00:00, run_end_date=2023-10-25 03:08:57.584380+00:00, run_duration=2.56221, state=success, external_trigger=True, run_type=manual, data_interval_start=2023-10-25 03:08:54.904407+00:00, data_interval_end=2023-10-25 03:08:54.904407+00:00, dag_hash=e08dc4546b6771485e92afa9a1f1d5ba
2023-10-24 20:08:57,585 INFO - Setting next_dagrun for transform_dag to None, run_after=None
2023-10-24 20:09:55,764 INFO - 1 tasks up for execution:
<TaskInstance: load_dag.load_task manual__2023-10-25T03:09:54.523501+00:00 [scheduled]>
2023-10-24 20:09:55,765 INFO - DAG load_dag has 0/16 running and queued tasks
2023-10-24 20:09:55,765 INFO - Setting the following tasks to queued state:
<TaskInstance: load_dag.load_task manual__2023-10-25T03:09:54.523501+00:00 [scheduled]>
2023-10-24 20:09:55,767 INFO - Sending TaskInstanceKey(dag_id='load_dag', task_id='load_task', run_id='manual__2023-10-25T03:09:54.523501+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default
2023-10-24 20:09:55,768 INFO - Adding to queue: ['airflow', 'tasks', 'run', 'load_dag', 'load_task', 'manual__2023-10-25T03:09:54.523501+00:00', '--local', '--subdir', 'DAGS_FOLDER/automate_load_dag.py']
2023-10-24 20:09:55,769 INFO - Executing command: ['airflow', 'tasks', 'run', 'load_dag', 'load_task', 'manual__2023-10-25T03:09:54.523501+00:00', '--local', '--subdir', 'DAGS_FOLDER/automate_load_dag.py']
2023-10-24 20:09:56,901 INFO - Executor reports execution of load_dag.load_task run_id=manual__2023-10-25T03:09:54.523501+00:00 exited with status success for try_number 1
2023-10-24 20:09:56,905 INFO - TaskInstance Finished: dag_id=load_dag, task_id=load_task, run_id=manual__2023-10-25T03:09:54.523501+00:00, map_index=-1, run_start_date=2023-10-25 03:09:56.619170+00:00, run_end_date=2023-10-25 03:09:56.701814+00:00, run_duration=0.082644, state=success, executor_state=success, try_number=1, max_tries=0, job_id=27, pool=default_pool, queue=default, priority_weight=1, operator=BashOperator, queued_dttm=2023-10-25 03:09:55.766416+00:00, queued_by_job_id=22, pid=21355
2023-10-24 20:09:56,927 INFO - Marking run <DagRun load_dag @ 2023-10-25 03:09:54.523501+00:00: manual__2023-10-25T03:09:54.523501+00:00, state:running, queued_at: 2023-10-25 03:09:54.530463+00:00. externally triggered: True> successful
2023-10-24 20:09:56,927 INFO - DagRun Finished: dag_id=load_dag, execution_date=2023-10-25 03:09:54.523501+00:00, run_id=manual__2023-10-25T03:09:54.523501+00:00, run_start_date=2023-10-25 03:09:55.755649+00:00, run_end_date=2023-10-25 03:09:56.927880+00:00, run_duration=1.172231, state=success, external_trigger=True, run_type=manual, data_interval_start=2023-10-25 03:09:54.523501+00:00, data_interval_end=2023-10-25 03:09:54.523501+00:00, dag_hash=d5ae4c4aeabd077f07ac7a3bb283568c
2023-10-24 20:09:56,929 INFO - Setting next_dagrun for load_dag to None, run_after=None
2023-10-24 20:13:43,646 INFO - Resetting orphaned tasks for active dag runs
2023-10-24 20:17:57,025 INFO - 1 tasks up for execution:
<TaskInstance: etl_dag.extract_task manual__2023-10-25T03:17:55.811978+00:00 [scheduled]>
2023-10-24 20:17:57,027 INFO - DAG etl_dag has 0/16 running and queued tasks
2023-10-24 20:17:57,027 INFO - Setting the following tasks to queued state:
<TaskInstance: etl_dag.extract_task manual__2023-10-25T03:17:55.811978+00:00 [scheduled]>
2023-10-24 20:17:57,028 INFO - Sending TaskInstanceKey(dag_id='etl_dag', task_id='extract_task', run_id='manual__2023-10-25T03:17:55.811978+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default
2023-10-24 20:17:57,029 INFO - Adding to queue: ['airflow', 'tasks', 'run', 'etl_dag', 'extract_task', 'manual__2023-10-25T03:17:55.811978+00:00', '--local', '--subdir', 'DAGS_FOLDER/basic_etl_dag.py']
2023-10-24 20:17:57,029 INFO - Executing command: ['airflow', 'tasks', 'run', 'etl_dag', 'extract_task', 'manual__2023-10-25T03:17:55.811978+00:00', '--local', '--subdir', 'DAGS_FOLDER/basic_etl_dag.py']
2023-10-24 20:18:01,698 INFO - Executor reports execution of etl_dag.extract_task run_id=manual__2023-10-25T03:17:55.811978+00:00 exited with status success for try_number 1
2023-10-24 20:18:01,705 INFO - TaskInstance Finished: dag_id=etl_dag, task_id=extract_task, run_id=manual__2023-10-25T03:17:55.811978+00:00, map_index=-1, run_start_date=2023-10-25 03:17:57.986149+00:00, run_end_date=2023-10-25 03:18:01.461814+00:00, run_duration=3.475665, state=success, executor_state=success, try_number=1, max_tries=0, job_id=28, pool=default_pool, queue=default, priority_weight=3, operator=BashOperator, queued_dttm=2023-10-25 03:17:57.027761+00:00, queued_by_job_id=22, pid=22245
2023-10-24 20:18:01,742 INFO - 1 tasks up for execution:
<TaskInstance: etl_dag.transform_task manual__2023-10-25T03:17:55.811978+00:00 [scheduled]>
2023-10-24 20:18:01,742 INFO - DAG etl_dag has 0/16 running and queued tasks
2023-10-24 20:18:01,743 INFO - Setting the following tasks to queued state:
<TaskInstance: etl_dag.transform_task manual__2023-10-25T03:17:55.811978+00:00 [scheduled]>
2023-10-24 20:18:01,743 INFO - Sending TaskInstanceKey(dag_id='etl_dag', task_id='transform_task', run_id='manual__2023-10-25T03:17:55.811978+00:00', try_number=1, map_index=-1) to executor with priority 2 and queue default
2023-10-24 20:18:01,744 INFO - Adding to queue: ['airflow', 'tasks', 'run', 'etl_dag', 'transform_task', 'manual__2023-10-25T03:17:55.811978+00:00', '--local', '--subdir', 'DAGS_FOLDER/basic_etl_dag.py']
2023-10-24 20:18:01,744 INFO - Executing command: ['airflow', 'tasks', 'run', 'etl_dag', 'transform_task', 'manual__2023-10-25T03:17:55.811978+00:00', '--local', '--subdir', 'DAGS_FOLDER/basic_etl_dag.py']
2023-10-24 20:18:02,940 INFO - Executor reports execution of etl_dag.transform_task run_id=manual__2023-10-25T03:17:55.811978+00:00 exited with status success for try_number 1
2023-10-24 20:18:02,944 INFO - TaskInstance Finished: dag_id=etl_dag, task_id=transform_task, run_id=manual__2023-10-25T03:17:55.811978+00:00, map_index=-1, run_start_date=2023-10-25 03:18:02.693717+00:00, run_end_date=2023-10-25 03:18:02.761866+00:00, run_duration=0.068149, state=success, executor_state=success, try_number=1, max_tries=0, job_id=29, pool=default_pool, queue=default, priority_weight=2, operator=PythonOperator, queued_dttm=2023-10-25 03:18:01.743386+00:00, queued_by_job_id=22, pid=22254
2023-10-24 20:18:02,967 INFO - 1 tasks up for execution:
<TaskInstance: etl_dag.load_task manual__2023-10-25T03:17:55.811978+00:00 [scheduled]>
2023-10-24 20:18:02,967 INFO - DAG etl_dag has 0/16 running and queued tasks
2023-10-24 20:18:02,967 INFO - Setting the following tasks to queued state:
<TaskInstance: etl_dag.load_task manual__2023-10-25T03:17:55.811978+00:00 [scheduled]>
2023-10-24 20:18:02,968 INFO - Sending TaskInstanceKey(dag_id='etl_dag', task_id='load_task', run_id='manual__2023-10-25T03:17:55.811978+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default
2023-10-24 20:18:02,968 INFO - Adding to queue: ['airflow', 'tasks', 'run', 'etl_dag', 'load_task', 'manual__2023-10-25T03:17:55.811978+00:00', '--local', '--subdir', 'DAGS_FOLDER/basic_etl_dag.py']
2023-10-24 20:18:02,969 INFO - Executing command: ['airflow', 'tasks', 'run', 'etl_dag', 'load_task', 'manual__2023-10-25T03:17:55.811978+00:00', '--local', '--subdir', 'DAGS_FOLDER/basic_etl_dag.py']
2023-10-24 20:18:04,155 INFO - Executor reports execution of etl_dag.load_task run_id=manual__2023-10-25T03:17:55.811978+00:00 exited with status success for try_number 1
2023-10-24 20:18:04,159 INFO - TaskInstance Finished: dag_id=etl_dag, task_id=load_task, run_id=manual__2023-10-25T03:17:55.811978+00:00, map_index=-1, run_start_date=2023-10-25 03:18:03.866715+00:00, run_end_date=2023-10-25 03:18:03.946860+00:00, run_duration=0.080145, state=success, executor_state=success, try_number=1, max_tries=0, job_id=30, pool=default_pool, queue=default, priority_weight=1, operator=BashOperator, queued_dttm=2023-10-25 03:18:02.968253+00:00, queued_by_job_id=22, pid=22258
2023-10-24 20:18:04,177 INFO - Marking run <DagRun etl_dag @ 2023-10-25 03:17:55.811978+00:00: manual__2023-10-25T03:17:55.811978+00:00, state:running, queued_at: 2023-10-25 03:17:55.821335+00:00. externally triggered: True> successful
2023-10-24 20:18:04,178 INFO - DagRun Finished: dag_id=etl_dag, execution_date=2023-10-25 03:17:55.811978+00:00, run_id=manual__2023-10-25T03:17:55.811978+00:00, run_start_date=2023-10-25 03:17:56.994970+00:00, run_end_date=2023-10-25 03:18:04.178771+00:00, run_duration=7.183801, state=success, external_trigger=True, run_type=manual, data_interval_start=2023-10-25 03:17:55.811978+00:00, data_interval_end=2023-10-25 03:17:55.811978+00:00, dag_hash=657c4e0f87f86c1dee4056057f25cae2
2023-10-24 20:18:04,180 INFO - Setting next_dagrun for etl_dag to None, run_after=None
2023-10-24 20:18:43,589 INFO - Resetting orphaned tasks for active dag runs
2023-10-24 20:23:43,628 INFO - Resetting orphaned tasks for active dag runs
2023-10-24 20:28:43,647 INFO - Resetting orphaned tasks for active dag runs
2023-10-24 20:33:43,681 INFO - Resetting orphaned tasks for active dag runs
2023-10-24 20:36:51,035 INFO - Exiting gracefully upon receiving signal 15
2023-10-24 20:36:52,049 INFO - Sending Signals.SIGTERM to group 6082. PIDs of all processes in the group: [6082]
2023-10-24 20:36:52,051 INFO - Sending the signal Signals.SIGTERM to group 6082
2023-10-24 20:36:52,474 INFO - Process psutil.Process(pid=6082, status='terminated', exitcode=0, started='14:15:32') (6082) terminated with exit code 0
2023-10-24 20:36:52,481 INFO - Sending Signals.SIGTERM to group 6082. PIDs of all processes in the group: []
2023-10-24 20:36:52,482 INFO - Sending the signal Signals.SIGTERM to group 6082
2023-10-24 20:36:52,482 INFO - Sending the signal Signals.SIGTERM to process 6082 as process group is missing.
2023-10-24 20:36:52,482 INFO - Exited execute loop
2023-10-24 20:36:55,897 INFO - Starting the scheduler
2023-10-24 20:36:55,898 INFO - Processing each file at most -1 times
2023-10-24 20:36:55,900 INFO - Loaded executor: SequentialExecutor
2023-10-24 20:36:55,902 INFO - Launched DagFileProcessorManager with pid: 23850
2023-10-24 20:36:55,904 INFO - Resetting orphaned tasks for active dag runs
2023-10-24 20:39:06,253 INFO - 1 tasks up for execution:
<TaskInstance: challenge_dag.extract_task manual__2023-10-25T03:39:05.963868+00:00 [scheduled]>
2023-10-24 20:39:06,253 INFO - DAG challenge_dag has 0/16 running and queued tasks
2023-10-24 20:39:06,254 INFO - Setting the following tasks to queued state:
<TaskInstance: challenge_dag.extract_task manual__2023-10-25T03:39:05.963868+00:00 [scheduled]>
2023-10-24 20:39:06,255 INFO - Sending TaskInstanceKey(dag_id='challenge_dag', task_id='extract_task', run_id='manual__2023-10-25T03:39:05.963868+00:00', try_number=1, map_index=-1) to executor with priority 3 and queue default
2023-10-24 20:39:06,256 INFO - Adding to queue: ['airflow', 'tasks', 'run', 'challenge_dag', 'extract_task', 'manual__2023-10-25T03:39:05.963868+00:00', '--local', '--subdir', 'DAGS_FOLDER/challenge_etl_dag.py']
2023-10-24 20:39:06,257 INFO - Executing command: ['airflow', 'tasks', 'run', 'challenge_dag', 'extract_task', 'manual__2023-10-25T03:39:05.963868+00:00', '--local', '--subdir', 'DAGS_FOLDER/challenge_etl_dag.py']
2023-10-24 20:39:10,326 INFO - Executor reports execution of challenge_dag.extract_task run_id=manual__2023-10-25T03:39:05.963868+00:00 exited with status success for try_number 1
2023-10-24 20:39:10,337 INFO - TaskInstance Finished: dag_id=challenge_dag, task_id=extract_task, run_id=manual__2023-10-25T03:39:05.963868+00:00, map_index=-1, run_start_date=2023-10-25 03:39:07.263257+00:00, run_end_date=2023-10-25 03:39:10.082692+00:00, run_duration=2.819435, state=success, executor_state=success, try_number=1, max_tries=0, job_id=32, pool=default_pool, queue=default, priority_weight=3, operator=BashOperator, queued_dttm=2023-10-25 03:39:06.254815+00:00, queued_by_job_id=31, pid=24118
2023-10-24 20:39:11,383 INFO - 1 tasks up for execution:
<TaskInstance: challenge_dag.transform_task manual__2023-10-25T03:39:05.963868+00:00 [scheduled]>
2023-10-24 20:39:11,383 INFO - DAG challenge_dag has 0/16 running and queued tasks
2023-10-24 20:39:11,384 INFO - Setting the following tasks to queued state:
<TaskInstance: challenge_dag.transform_task manual__2023-10-25T03:39:05.963868+00:00 [scheduled]>
2023-10-24 20:39:11,385 INFO - Sending TaskInstanceKey(dag_id='challenge_dag', task_id='transform_task', run_id='manual__2023-10-25T03:39:05.963868+00:00', try_number=1, map_index=-1) to executor with priority 2 and queue default
2023-10-24 20:39:11,385 INFO - Adding to queue: ['airflow', 'tasks', 'run', 'challenge_dag', 'transform_task', 'manual__2023-10-25T03:39:05.963868+00:00', '--local', '--subdir', 'DAGS_FOLDER/challenge_etl_dag.py']
2023-10-24 20:39:11,386 INFO - Executing command: ['airflow', 'tasks', 'run', 'challenge_dag', 'transform_task', 'manual__2023-10-25T03:39:05.963868+00:00', '--local', '--subdir', 'DAGS_FOLDER/challenge_etl_dag.py']
2023-10-24 20:39:12,569 INFO - Executor reports execution of challenge_dag.transform_task run_id=manual__2023-10-25T03:39:05.963868+00:00 exited with status success for try_number 1
2023-10-24 20:39:12,572 INFO - TaskInstance Finished: dag_id=challenge_dag, task_id=transform_task, run_id=manual__2023-10-25T03:39:05.963868+00:00, map_index=-1, run_start_date=2023-10-25 03:39:12.271505+00:00, run_end_date=2023-10-25 03:39:12.354736+00:00, run_duration=0.083231, state=success, executor_state=success, try_number=1, max_tries=0, job_id=33, pool=default_pool, queue=default, priority_weight=2, operator=PythonOperator, queued_dttm=2023-10-25 03:39:11.384430+00:00, queued_by_job_id=31, pid=24130
2023-10-24 20:39:13,605 INFO - 1 tasks up for execution:
<TaskInstance: challenge_dag.load_task manual__2023-10-25T03:39:05.963868+00:00 [scheduled]>
2023-10-24 20:39:13,605 INFO - DAG challenge_dag has 0/16 running and queued tasks
2023-10-24 20:39:13,605 INFO - Setting the following tasks to queued state:
<TaskInstance: challenge_dag.load_task manual__2023-10-25T03:39:05.963868+00:00 [scheduled]>
2023-10-24 20:39:13,606 INFO - Sending TaskInstanceKey(dag_id='challenge_dag', task_id='load_task', run_id='manual__2023-10-25T03:39:05.963868+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default
2023-10-24 20:39:13,606 INFO - Adding to queue: ['airflow', 'tasks', 'run', 'challenge_dag', 'load_task', 'manual__2023-10-25T03:39:05.963868+00:00', '--local', '--subdir', 'DAGS_FOLDER/challenge_etl_dag.py']
2023-10-24 20:39:13,607 INFO - Executing command: ['airflow', 'tasks', 'run', 'challenge_dag', 'load_task', 'manual__2023-10-25T03:39:05.963868+00:00', '--local', '--subdir', 'DAGS_FOLDER/challenge_etl_dag.py']
2023-10-24 20:39:14,795 INFO - Executor reports execution of challenge_dag.load_task run_id=manual__2023-10-25T03:39:05.963868+00:00 exited with status success for try_number 1
2023-10-24 20:39:14,799 INFO - TaskInstance Finished: dag_id=challenge_dag, task_id=load_task, run_id=manual__2023-10-25T03:39:05.963868+00:00, map_index=-1, run_start_date=2023-10-25 03:39:14.518409+00:00, run_end_date=2023-10-25 03:39:14.594364+00:00, run_duration=0.075955, state=success, executor_state=success, try_number=1, max_tries=0, job_id=34, pool=default_pool, queue=default, priority_weight=1, operator=BashOperator, queued_dttm=2023-10-25 03:39:13.606095+00:00, queued_by_job_id=31, pid=24135
2023-10-24 20:39:15,712 INFO - Marking run <DagRun challenge_dag @ 2023-10-25 03:39:05.963868+00:00: manual__2023-10-25T03:39:05.963868+00:00, state:running, queued_at: 2023-10-25 03:39:05.991914+00:00. externally triggered: True> successful
2023-10-24 20:39:15,713 INFO - DagRun Finished: dag_id=challenge_dag, execution_date=2023-10-25 03:39:05.963868+00:00, run_id=manual__2023-10-25T03:39:05.963868+00:00, run_start_date=2023-10-25 03:39:06.229581+00:00, run_end_date=2023-10-25 03:39:15.713219+00:00, run_duration=9.483638, state=success, external_trigger=True, run_type=manual, data_interval_start=2023-10-25 03:39:05.963868+00:00, data_interval_end=2023-10-25 03:39:05.963868+00:00, dag_hash=c0841fd68405765473c9a3184eeaa4fb
2023-10-24 20:39:15,715 INFO - Setting next_dagrun for challenge_dag to None, run_after=None
2023-10-24 20:41:56,852 INFO - Resetting orphaned tasks for active dag runs
2023-10-24 20:46:56,889 INFO - Resetting orphaned tasks for active dag runs
2023-10-24 20:50:34,831 INFO - Exiting gracefully upon receiving signal 15
2023-10-24 20:50:35,848 INFO - Sending Signals.SIGTERM to group 23850. PIDs of all processes in the group: [23850]
2023-10-24 20:50:35,849 INFO - Sending the signal Signals.SIGTERM to group 23850
2023-10-24 20:50:36,232 INFO - Process psutil.Process(pid=23850, status='terminated', exitcode=0, started='20:36:55') (23850) terminated with exit code 0
2023-10-24 20:50:36,240 INFO - Sending Signals.SIGTERM to group 23850. PIDs of all processes in the group: []
2023-10-24 20:50:36,241 INFO - Sending the signal Signals.SIGTERM to group 23850
2023-10-24 20:50:36,241 INFO - Sending the signal Signals.SIGTERM to process 23850 as process group is missing.
2023-10-24 20:50:36,241 INFO - Exited execute loop
2023-11-01 18:02:02,993 INFO - Starting the scheduler
2023-11-01 18:02:02,994 INFO - Processing each file at most -1 times
2023-11-01 18:02:02,996 INFO - Loaded executor: SequentialExecutor
2023-11-01 18:02:02,999 INFO - Launched DagFileProcessorManager with pid: 84451
2023-11-01 18:02:03,000 INFO - Resetting orphaned tasks for active dag runs
2023-11-01 18:05:16,170 INFO - Setting next_dagrun for 1_init_once_seed_data to None, run_after=None
2023-11-01 18:05:16,196 INFO - 1 tasks up for execution:
<TaskInstance: 1_init_once_seed_data.load_seed_data_once scheduled__2020-08-01T00:00:00+00:00 [scheduled]>
2023-11-01 18:05:16,197 INFO - DAG 1_init_once_seed_data has 0/16 running and queued tasks
2023-11-01 18:05:16,197 INFO - Setting the following tasks to queued state:
<TaskInstance: 1_init_once_seed_data.load_seed_data_once scheduled__2020-08-01T00:00:00+00:00 [scheduled]>
2023-11-01 18:05:16,199 INFO - Sending TaskInstanceKey(dag_id='1_init_once_seed_data', task_id='load_seed_data_once', run_id='scheduled__2020-08-01T00:00:00+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default
2023-11-01 18:05:16,199 INFO - Adding to queue: ['airflow', 'tasks', 'run', '1_init_once_seed_data', 'load_seed_data_once', 'scheduled__2020-08-01T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/__pycache__/init.py']
2023-11-01 18:05:16,201 INFO - Executing command: ['airflow', 'tasks', 'run', '1_init_once_seed_data', 'load_seed_data_once', 'scheduled__2020-08-01T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/__pycache__/init.py']
2023-11-01 18:05:17,455 INFO - Executor reports execution of 1_init_once_seed_data.load_seed_data_once run_id=scheduled__2020-08-01T00:00:00+00:00 exited with status success for try_number 1
2023-11-01 18:05:17,461 INFO - TaskInstance Finished: dag_id=1_init_once_seed_data, task_id=load_seed_data_once, run_id=scheduled__2020-08-01T00:00:00+00:00, map_index=-1, run_start_date=2023-11-02 01:05:17.171526+00:00, run_end_date=2023-11-02 01:05:17.253287+00:00, run_duration=0.081761, state=failed, executor_state=success, try_number=1, max_tries=0, job_id=36, pool=default_pool, queue=default, priority_weight=1, operator=BashOperator, queued_dttm=2023-11-02 01:05:16.198434+00:00, queued_by_job_id=35, pid=84841
2023-11-01 18:05:17,490 ERROR - Marking run <DagRun 1_init_once_seed_data @ 2020-08-01 00:00:00+00:00: scheduled__2020-08-01T00:00:00+00:00, state:running, queued_at: 2023-11-02 01:05:16.165618+00:00. externally triggered: False> failed
2023-11-01 18:05:17,491 INFO - DagRun Finished: dag_id=1_init_once_seed_data, execution_date=2020-08-01 00:00:00+00:00, run_id=scheduled__2020-08-01T00:00:00+00:00, run_start_date=2023-11-02 01:05:16.178099+00:00, run_end_date=2023-11-02 01:05:17.491449+00:00, run_duration=1.31335, state=failed, external_trigger=False, run_type=scheduled, data_interval_start=2020-08-01 00:00:00+00:00, data_interval_end=2020-08-01 00:00:00+00:00, dag_hash=75ef8b6ef76199a086ca2c1610b977db
2023-11-01 18:05:17,492 INFO - Setting next_dagrun for 1_init_once_seed_data to None, run_after=None
2023-11-01 18:05:17,496 INFO - 1 tasks up for execution:
<TaskInstance: 1_init_once_seed_data.load_seed_data_once manual__2023-11-02T01:05:16.026913+00:00 [scheduled]>
2023-11-01 18:05:17,496 INFO - DAG 1_init_once_seed_data has 0/16 running and queued tasks
2023-11-01 18:05:17,496 INFO - Setting the following tasks to queued state:
<TaskInstance: 1_init_once_seed_data.load_seed_data_once manual__2023-11-02T01:05:16.026913+00:00 [scheduled]>
2023-11-01 18:05:17,497 INFO - Sending TaskInstanceKey(dag_id='1_init_once_seed_data', task_id='load_seed_data_once', run_id='manual__2023-11-02T01:05:16.026913+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default
2023-11-01 18:05:17,498 INFO - Adding to queue: ['airflow', 'tasks', 'run', '1_init_once_seed_data', 'load_seed_data_once', 'manual__2023-11-02T01:05:16.026913+00:00', '--local', '--subdir', 'DAGS_FOLDER/__pycache__/init.py']
2023-11-01 18:05:17,498 INFO - Executing command: ['airflow', 'tasks', 'run', '1_init_once_seed_data', 'load_seed_data_once', 'manual__2023-11-02T01:05:16.026913+00:00', '--local', '--subdir', 'DAGS_FOLDER/__pycache__/init.py']
2023-11-01 18:05:18,629 INFO - Executor reports execution of 1_init_once_seed_data.load_seed_data_once run_id=manual__2023-11-02T01:05:16.026913+00:00 exited with status success for try_number 1
2023-11-01 18:05:18,633 INFO - TaskInstance Finished: dag_id=1_init_once_seed_data, task_id=load_seed_data_once, run_id=manual__2023-11-02T01:05:16.026913+00:00, map_index=-1, run_start_date=2023-11-02 01:05:18.406102+00:00, run_end_date=2023-11-02 01:05:18.467076+00:00, run_duration=0.060974, state=failed, executor_state=success, try_number=1, max_tries=0, job_id=37, pool=default_pool, queue=default, priority_weight=1, operator=BashOperator, queued_dttm=2023-11-02 01:05:17.497162+00:00, queued_by_job_id=35, pid=84845
2023-11-01 18:05:18,654 ERROR - Marking run <DagRun 1_init_once_seed_data @ 2023-11-02 01:05:16.026913+00:00: manual__2023-11-02T01:05:16.026913+00:00, state:running, queued_at: 2023-11-02 01:05:16.059888+00:00. externally triggered: True> failed
2023-11-01 18:05:18,655 INFO - DagRun Finished: dag_id=1_init_once_seed_data, execution_date=2023-11-02 01:05:16.026913+00:00, run_id=manual__2023-11-02T01:05:16.026913+00:00, run_start_date=2023-11-02 01:05:17.484971+00:00, run_end_date=2023-11-02 01:05:18.655208+00:00, run_duration=1.170237, state=failed, external_trigger=True, run_type=manual, data_interval_start=2023-11-02 01:05:16.026913+00:00, data_interval_end=2023-11-02 01:05:16.026913+00:00, dag_hash=75ef8b6ef76199a086ca2c1610b977db
2023-11-01 18:05:18,656 INFO - Setting next_dagrun for 1_init_once_seed_data to None, run_after=None
2023-11-01 18:07:03,866 INFO - Resetting orphaned tasks for active dag runs
2023-11-01 18:12:03,896 INFO - Resetting orphaned tasks for active dag runs
2023-11-01 18:17:04,651 INFO - Resetting orphaned tasks for active dag runs
2023-11-01 18:22:04,681 INFO - Resetting orphaned tasks for active dag runs
2023-11-01 18:22:18,055 INFO - Exiting gracefully upon receiving signal 15
2023-11-01 18:22:19,067 INFO - Sending Signals.SIGTERM to group 84451. PIDs of all processes in the group: [84451]
2023-11-01 18:22:19,068 INFO - Sending the signal Signals.SIGTERM to group 84451
2023-11-01 18:22:19,410 INFO - Process psutil.Process(pid=84451, status='terminated', exitcode=0, started='18:02:02') (84451) terminated with exit code 0
2023-11-01 18:22:19,417 INFO - Sending Signals.SIGTERM to group 84451. PIDs of all processes in the group: []
2023-11-01 18:22:19,417 INFO - Sending the signal Signals.SIGTERM to group 84451
2023-11-01 18:22:19,417 INFO - Sending the signal Signals.SIGTERM to process 84451 as process group is missing.
2023-11-01 18:22:19,418 INFO - Exited execute loop
2023-11-01 18:22:31,828 INFO - Starting the scheduler
2023-11-01 18:22:31,829 INFO - Processing each file at most -1 times
2023-11-01 18:22:31,831 INFO - Loaded executor: SequentialExecutor
2023-11-01 18:22:31,833 INFO - Launched DagFileProcessorManager with pid: 86366
2023-11-01 18:22:31,834 INFO - Resetting orphaned tasks for active dag runs
2023-11-01 18:27:32,816 INFO - Resetting orphaned tasks for active dag runs
2023-11-01 18:32:32,851 INFO - Resetting orphaned tasks for active dag runs
2023-11-01 18:37:32,881 INFO - Resetting orphaned tasks for active dag runs
2023-11-01 18:42:36,242 INFO - Resetting orphaned tasks for active dag runs
2023-11-01 18:47:20,112 INFO - 3 tasks up for execution:
<TaskInstance: dbt_snowflake_dag.bookings_1_seed manual__2023-11-02T01:47:18.699280+00:00 [scheduled]>
<TaskInstance: dbt_snowflake_dag.bookings_2_seed manual__2023-11-02T01:47:18.699280+00:00 [scheduled]>
<TaskInstance: dbt_snowflake_dag.customers_seed manual__2023-11-02T01:47:18.699280+00:00 [scheduled]>
2023-11-01 18:47:20,113 INFO - DAG dbt_snowflake_dag has 0/16 running and queued tasks
2023-11-01 18:47:20,114 INFO - DAG dbt_snowflake_dag has 1/16 running and queued tasks
2023-11-01 18:47:20,114 INFO - DAG dbt_snowflake_dag has 2/16 running and queued tasks
2023-11-01 18:47:20,115 INFO - Setting the following tasks to queued state:
<TaskInstance: dbt_snowflake_dag.bookings_1_seed manual__2023-11-02T01:47:18.699280+00:00 [scheduled]>
<TaskInstance: dbt_snowflake_dag.bookings_2_seed manual__2023-11-02T01:47:18.699280+00:00 [scheduled]>
<TaskInstance: dbt_snowflake_dag.customers_seed manual__2023-11-02T01:47:18.699280+00:00 [scheduled]>
2023-11-01 18:47:20,118 INFO - Sending TaskInstanceKey(dag_id='dbt_snowflake_dag', task_id='bookings_1_seed', run_id='manual__2023-11-02T01:47:18.699280+00:00', try_number=1, map_index=-1) to executor with priority 5 and queue default
2023-11-01 18:47:20,119 INFO - Adding to queue: ['airflow', 'tasks', 'run', 'dbt_snowflake_dag', 'bookings_1_seed', 'manual__2023-11-02T01:47:18.699280+00:00', '--local', '--subdir', 'DAGS_FOLDER/dbt_airflow_snowflake.py']
2023-11-01 18:47:20,119 INFO - Sending TaskInstanceKey(dag_id='dbt_snowflake_dag', task_id='bookings_2_seed', run_id='manual__2023-11-02T01:47:18.699280+00:00', try_number=1, map_index=-1) to executor with priority 5 and queue default
2023-11-01 18:47:20,119 INFO - Adding to queue: ['airflow', 'tasks', 'run', 'dbt_snowflake_dag', 'bookings_2_seed', 'manual__2023-11-02T01:47:18.699280+00:00', '--local', '--subdir', 'DAGS_FOLDER/dbt_airflow_snowflake.py']
2023-11-01 18:47:20,120 INFO - Sending TaskInstanceKey(dag_id='dbt_snowflake_dag', task_id='customers_seed', run_id='manual__2023-11-02T01:47:18.699280+00:00', try_number=1, map_index=-1) to executor with priority 5 and queue default
2023-11-01 18:47:20,120 INFO - Adding to queue: ['airflow', 'tasks', 'run', 'dbt_snowflake_dag', 'customers_seed', 'manual__2023-11-02T01:47:18.699280+00:00', '--local', '--subdir', 'DAGS_FOLDER/dbt_airflow_snowflake.py']
2023-11-01 18:47:20,121 INFO - Executing command: ['airflow', 'tasks', 'run', 'dbt_snowflake_dag', 'bookings_1_seed', 'manual__2023-11-02T01:47:18.699280+00:00', '--local', '--subdir', 'DAGS_FOLDER/dbt_airflow_snowflake.py']
2023-11-01 18:47:29,387 INFO - Executing command: ['airflow', 'tasks', 'run', 'dbt_snowflake_dag', 'bookings_2_seed', 'manual__2023-11-02T01:47:18.699280+00:00', '--local', '--subdir', 'DAGS_FOLDER/dbt_airflow_snowflake.py']
2023-11-01 18:47:38,264 INFO - Executing command: ['airflow', 'tasks', 'run', 'dbt_snowflake_dag', 'customers_seed', 'manual__2023-11-02T01:47:18.699280+00:00', '--local', '--subdir', 'DAGS_FOLDER/dbt_airflow_snowflake.py']
2023-11-01 18:47:46,950 INFO - Executor reports execution of dbt_snowflake_dag.bookings_1_seed run_id=manual__2023-11-02T01:47:18.699280+00:00 exited with status success for try_number 1
2023-11-01 18:47:46,953 INFO - Executor reports execution of dbt_snowflake_dag.bookings_2_seed run_id=manual__2023-11-02T01:47:18.699280+00:00 exited with status success for try_number 1
2023-11-01 18:47:46,953 INFO - Executor reports execution of dbt_snowflake_dag.customers_seed run_id=manual__2023-11-02T01:47:18.699280+00:00 exited with status success for try_number 1
2023-11-01 18:47:46,961 INFO - TaskInstance Finished: dag_id=dbt_snowflake_dag, task_id=bookings_1_seed, run_id=manual__2023-11-02T01:47:18.699280+00:00, map_index=-1, run_start_date=2023-11-02 01:47:26.655052+00:00, run_end_date=2023-11-02 01:47:29.205729+00:00, run_duration=2.550677, state=failed, executor_state=success, try_number=1, max_tries=0, job_id=39, pool=default_pool, queue=default, priority_weight=5, operator=DbtSeedLocalOperator, queued_dttm=2023-11-02 01:47:20.116989+00:00, queued_by_job_id=38, pid=89311
2023-11-01 18:47:46,961 INFO - TaskInstance Finished: dag_id=dbt_snowflake_dag, task_id=bookings_2_seed, run_id=manual__2023-11-02T01:47:18.699280+00:00, map_index=-1, run_start_date=2023-11-02 01:47:35.603601+00:00, run_end_date=2023-11-02 01:47:38.093231+00:00, run_duration=2.48963, state=failed, executor_state=success, try_number=1, max_tries=0, job_id=40, pool=default_pool, queue=default, priority_weight=5, operator=DbtSeedLocalOperator, queued_dttm=2023-11-02 01:47:20.116989+00:00, queued_by_job_id=38, pid=89336
2023-11-01 18:47:46,962 INFO - TaskInstance Finished: dag_id=dbt_snowflake_dag, task_id=customers_seed, run_id=manual__2023-11-02T01:47:18.699280+00:00, map_index=-1, run_start_date=2023-11-02 01:47:44.197877+00:00, run_end_date=2023-11-02 01:47:46.794841+00:00, run_duration=2.596964, state=failed, executor_state=success, try_number=1, max_tries=0, job_id=41, pool=default_pool, queue=default, priority_weight=5, operator=DbtSeedLocalOperator, queued_dttm=2023-11-02 01:47:20.116989+00:00, queued_by_job_id=38, pid=89358
2023-11-01 18:47:46,980 INFO - Resetting orphaned tasks for active dag runs
2023-11-01 18:47:46,981 INFO - Marked 1 SchedulerJob instances as failed
2023-11-01 18:47:52,976 ERROR - Marking run <DagRun dbt_snowflake_dag @ 2023-11-02 01:47:18.699280+00:00: manual__2023-11-02T01:47:18.699280+00:00, state:running, queued_at: 2023-11-02 01:47:18.726705+00:00. externally triggered: True> failed
2023-11-01 18:47:52,978 INFO - DagRun Finished: dag_id=dbt_snowflake_dag, execution_date=2023-11-02 01:47:18.699280+00:00, run_id=manual__2023-11-02T01:47:18.699280+00:00, run_start_date=2023-11-02 01:47:20.090906+00:00, run_end_date=2023-11-02 01:47:52.978267+00:00, run_duration=32.887361, state=failed, external_trigger=True, run_type=manual, data_interval_start=2023-11-01 00:00:00+00:00, data_interval_end=2023-11-02 00:00:00+00:00, dag_hash=40aba182c3cf0b0715abb84333c36964
2023-11-01 18:47:52,983 INFO - Setting next_dagrun for dbt_snowflake_dag to 2023-11-02T00:00:00+00:00, run_after=2023-11-03T00:00:00+00:00
2023-11-01 18:52:52,169 INFO - Resetting orphaned tasks for active dag runs
2023-11-01 18:57:52,361 INFO - Resetting orphaned tasks for active dag runs
2023-11-01 19:02:52,563 INFO - Resetting orphaned tasks for active dag runs
2023-11-01 19:07:52,597 INFO - Resetting orphaned tasks for active dag runs
2023-11-01 19:12:03,111 INFO - 3 tasks up for execution:
<TaskInstance: dbt_snowflake_dag.bookings_1_seed manual__2023-11-02T02:11:58.830568+00:00 [scheduled]>
<TaskInstance: dbt_snowflake_dag.bookings_2_seed manual__2023-11-02T02:11:58.830568+00:00 [scheduled]>
<TaskInstance: dbt_snowflake_dag.customers_seed manual__2023-11-02T02:11:58.830568+00:00 [scheduled]>
2023-11-01 19:12:03,112 INFO - DAG dbt_snowflake_dag has 0/16 running and queued tasks
2023-11-01 19:12:03,113 INFO - DAG dbt_snowflake_dag has 1/16 running and queued tasks
2023-11-01 19:12:03,113 INFO - DAG dbt_snowflake_dag has 2/16 running and queued tasks
2023-11-01 19:12:03,113 INFO - Setting the following tasks to queued state:
<TaskInstance: dbt_snowflake_dag.bookings_1_seed manual__2023-11-02T02:11:58.830568+00:00 [scheduled]>
<TaskInstance: dbt_snowflake_dag.bookings_2_seed manual__2023-11-02T02:11:58.830568+00:00 [scheduled]>
<TaskInstance: dbt_snowflake_dag.customers_seed manual__2023-11-02T02:11:58.830568+00:00 [scheduled]>
2023-11-01 19:12:03,117 INFO - Sending TaskInstanceKey(dag_id='dbt_snowflake_dag', task_id='bookings_1_seed', run_id='manual__2023-11-02T02:11:58.830568+00:00', try_number=1, map_index=-1) to executor with priority 5 and queue default
2023-11-01 19:12:03,118 INFO - Adding to queue: ['airflow', 'tasks', 'run', 'dbt_snowflake_dag', 'bookings_1_seed', 'manual__2023-11-02T02:11:58.830568+00:00', '--local', '--subdir', 'DAGS_FOLDER/dbt_airflow_snowflake.py']
2023-11-01 19:12:03,118 INFO - Sending TaskInstanceKey(dag_id='dbt_snowflake_dag', task_id='bookings_2_seed', run_id='manual__2023-11-02T02:11:58.830568+00:00', try_number=1, map_index=-1) to executor with priority 5 and queue default
2023-11-01 19:12:03,118 INFO - Adding to queue: ['airflow', 'tasks', 'run', 'dbt_snowflake_dag', 'bookings_2_seed', 'manual__2023-11-02T02:11:58.830568+00:00', '--local', '--subdir', 'DAGS_FOLDER/dbt_airflow_snowflake.py']
2023-11-01 19:12:03,119 INFO - Sending TaskInstanceKey(dag_id='dbt_snowflake_dag', task_id='customers_seed', run_id='manual__2023-11-02T02:11:58.830568+00:00', try_number=1, map_index=-1) to executor with priority 5 and queue default
2023-11-01 19:12:03,119 INFO - Adding to queue: ['airflow', 'tasks', 'run', 'dbt_snowflake_dag', 'customers_seed', 'manual__2023-11-02T02:11:58.830568+00:00', '--local', '--subdir', 'DAGS_FOLDER/dbt_airflow_snowflake.py']
2023-11-01 19:12:03,120 INFO - Executing command: ['airflow', 'tasks', 'run', 'dbt_snowflake_dag', 'bookings_1_seed', 'manual__2023-11-02T02:11:58.830568+00:00', '--local', '--subdir', 'DAGS_FOLDER/dbt_airflow_snowflake.py']
2023-11-01 19:12:13,459 INFO - Executing command: ['airflow', 'tasks', 'run', 'dbt_snowflake_dag', 'bookings_2_seed', 'manual__2023-11-02T02:11:58.830568+00:00', '--local', '--subdir', 'DAGS_FOLDER/dbt_airflow_snowflake.py']
2023-11-01 19:12:23,158 INFO - Executing command: ['airflow', 'tasks', 'run', 'dbt_snowflake_dag', 'customers_seed', 'manual__2023-11-02T02:11:58.830568+00:00', '--local', '--subdir', 'DAGS_FOLDER/dbt_airflow_snowflake.py']
2023-11-01 19:12:33,206 INFO - Executor reports execution of dbt_snowflake_dag.bookings_1_seed run_id=manual__2023-11-02T02:11:58.830568+00:00 exited with status success for try_number 1
2023-11-01 19:12:33,208 INFO - Executor reports execution of dbt_snowflake_dag.bookings_2_seed run_id=manual__2023-11-02T02:11:58.830568+00:00 exited with status success for try_number 1
2023-11-01 19:12:33,208 INFO - Executor reports execution of dbt_snowflake_dag.customers_seed run_id=manual__2023-11-02T02:11:58.830568+00:00 exited with status success for try_number 1
2023-11-01 19:12:33,215 INFO - TaskInstance Finished: dag_id=dbt_snowflake_dag, task_id=bookings_1_seed, run_id=manual__2023-11-02T02:11:58.830568+00:00, map_index=-1, run_start_date=2023-11-02 02:12:10.281145+00:00, run_end_date=2023-11-02 02:12:13.295010+00:00, run_duration=3.013865, state=failed, executor_state=success, try_number=1, max_tries=0, job_id=42, pool=default_pool, queue=default, priority_weight=5, operator=DbtSeedLocalOperator, queued_dttm=2023-11-02 02:12:03.113937+00:00, queued_by_job_id=38, pid=91741
2023-11-01 19:12:33,215 INFO - TaskInstance Finished: dag_id=dbt_snowflake_dag, task_id=bookings_2_seed, run_id=manual__2023-11-02T02:11:58.830568+00:00, map_index=-1, run_start_date=2023-11-02 02:12:20.063446+00:00, run_end_date=2023-11-02 02:12:22.982414+00:00, run_duration=2.918968, state=failed, executor_state=success, try_number=1, max_tries=0, job_id=43, pool=default_pool, queue=default, priority_weight=5, operator=DbtSeedLocalOperator, queued_dttm=2023-11-02 02:12:03.113937+00:00, queued_by_job_id=38, pid=91766
2023-11-01 19:12:33,216 INFO - TaskInstance Finished: dag_id=dbt_snowflake_dag, task_id=customers_seed, run_id=manual__2023-11-02T02:11:58.830568+00:00, map_index=-1, run_start_date=2023-11-02 02:12:30.007693+00:00, run_end_date=2023-11-02 02:12:33.008169+00:00, run_duration=3.000476, state=failed, executor_state=success, try_number=1, max_tries=0, job_id=44, pool=default_pool, queue=default, priority_weight=5, operator=DbtSeedLocalOperator, queued_dttm=2023-11-02 02:12:03.113937+00:00, queued_by_job_id=38, pid=91790
2023-11-01 19:12:40,248 ERROR - Marking run <DagRun dbt_snowflake_dag @ 2023-11-02 02:11:58.830568+00:00: manual__2023-11-02T02:11:58.830568+00:00, state:running, queued_at: 2023-11-02 02:11:58.861358+00:00. externally triggered: True> failed
2023-11-01 19:12:40,249 INFO - DagRun Finished: dag_id=dbt_snowflake_dag, execution_date=2023-11-02 02:11:58.830568+00:00, run_id=manual__2023-11-02T02:11:58.830568+00:00, run_start_date=2023-11-02 02:12:03.086083+00:00, run_end_date=2023-11-02 02:12:40.249357+00:00, run_duration=37.163274, state=failed, external_trigger=True, run_type=manual, data_interval_start=2023-11-01 00:00:00+00:00, data_interval_end=2023-11-02 00:00:00+00:00, dag_hash=40aba182c3cf0b0715abb84333c36964
2023-11-01 19:12:40,254 INFO - Setting next_dagrun for dbt_snowflake_dag to 2023-11-02T00:00:00+00:00, run_after=2023-11-03T00:00:00+00:00
2023-11-01 19:12:53,542 INFO - Resetting orphaned tasks for active dag runs
2023-11-01 19:17:54,193 INFO - Resetting orphaned tasks for active dag runs
2023-11-01 19:22:54,231 INFO - Resetting orphaned tasks for active dag runs
2023-11-01 19:26:36,395 INFO - 3 tasks up for execution:
<TaskInstance: dbt_snowflake_dag.bookings_1_seed manual__2023-11-02T02:26:35.971258+00:00 [scheduled]>
<TaskInstance: dbt_snowflake_dag.bookings_2_seed manual__2023-11-02T02:26:35.971258+00:00 [scheduled]>
<TaskInstance: dbt_snowflake_dag.customers_seed manual__2023-11-02T02:26:35.971258+00:00 [scheduled]>
2023-11-01 19:26:36,397 INFO - DAG dbt_snowflake_dag has 0/16 running and queued tasks
2023-11-01 19:26:36,397 INFO - DAG dbt_snowflake_dag has 1/16 running and queued tasks
2023-11-01 19:26:36,398 INFO - DAG dbt_snowflake_dag has 2/16 running and queued tasks
2023-11-01 19:26:36,398 INFO - Setting the following tasks to queued state:
<TaskInstance: dbt_snowflake_dag.bookings_1_seed manual__2023-11-02T02:26:35.971258+00:00 [scheduled]>
<TaskInstance: dbt_snowflake_dag.bookings_2_seed manual__2023-11-02T02:26:35.971258+00:00 [scheduled]>
<TaskInstance: dbt_snowflake_dag.customers_seed manual__2023-11-02T02:26:35.971258+00:00 [scheduled]>
2023-11-01 19:26:36,401 INFO - Sending TaskInstanceKey(dag_id='dbt_snowflake_dag', task_id='bookings_1_seed', run_id='manual__2023-11-02T02:26:35.971258+00:00', try_number=1, map_index=-1) to executor with priority 5 and queue default
2023-11-01 19:26:36,402 INFO - Adding to queue: ['airflow', 'tasks', 'run', 'dbt_snowflake_dag', 'bookings_1_seed', 'manual__2023-11-02T02:26:35.971258+00:00', '--local', '--subdir', 'DAGS_FOLDER/dbt_airflow_snowflake.py']
2023-11-01 19:26:36,402 INFO - Sending TaskInstanceKey(dag_id='dbt_snowflake_dag', task_id='bookings_2_seed', run_id='manual__2023-11-02T02:26:35.971258+00:00', try_number=1, map_index=-1) to executor with priority 5 and queue default
2023-11-01 19:26:36,402 INFO - Adding to queue: ['airflow', 'tasks', 'run', 'dbt_snowflake_dag', 'bookings_2_seed', 'manual__2023-11-02T02:26:35.971258+00:00', '--local', '--subdir', 'DAGS_FOLDER/dbt_airflow_snowflake.py']
2023-11-01 19:26:36,403 INFO - Sending TaskInstanceKey(dag_id='dbt_snowflake_dag', task_id='customers_seed', run_id='manual__2023-11-02T02:26:35.971258+00:00', try_number=1, map_index=-1) to executor with priority 5 and queue default
2023-11-01 19:26:36,403 INFO - Adding to queue: ['airflow', 'tasks', 'run', 'dbt_snowflake_dag', 'customers_seed', 'manual__2023-11-02T02:26:35.971258+00:00', '--local', '--subdir', 'DAGS_FOLDER/dbt_airflow_snowflake.py']
2023-11-01 19:26:36,404 INFO - Executing command: ['airflow', 'tasks', 'run', 'dbt_snowflake_dag', 'bookings_1_seed', 'manual__2023-11-02T02:26:35.971258+00:00', '--local', '--subdir', 'DAGS_FOLDER/dbt_airflow_snowflake.py']
2023-11-01 19:26:45,502 INFO - Executing command: ['airflow', 'tasks', 'run', 'dbt_snowflake_dag', 'bookings_2_seed', 'manual__2023-11-02T02:26:35.971258+00:00', '--local', '--subdir', 'DAGS_FOLDER/dbt_airflow_snowflake.py']
2023-11-01 19:26:54,389 INFO - Executing command: ['airflow', 'tasks', 'run', 'dbt_snowflake_dag', 'customers_seed', 'manual__2023-11-02T02:26:35.971258+00:00', '--local', '--subdir', 'DAGS_FOLDER/dbt_airflow_snowflake.py']
2023-11-01 19:27:03,040 INFO - Executor reports execution of dbt_snowflake_dag.bookings_1_seed run_id=manual__2023-11-02T02:26:35.971258+00:00 exited with status success for try_number 1
2023-11-01 19:27:03,043 INFO - Executor reports execution of dbt_snowflake_dag.bookings_2_seed run_id=manual__2023-11-02T02:26:35.971258+00:00 exited with status success for try_number 1
2023-11-01 19:27:03,043 INFO - Executor reports execution of dbt_snowflake_dag.customers_seed run_id=manual__2023-11-02T02:26:35.971258+00:00 exited with status success for try_number 1
2023-11-01 19:27:03,049 INFO - TaskInstance Finished: dag_id=dbt_snowflake_dag, task_id=bookings_1_seed, run_id=manual__2023-11-02T02:26:35.971258+00:00, map_index=-1, run_start_date=2023-11-02 02:26:42.635144+00:00, run_end_date=2023-11-02 02:26:45.291720+00:00, run_duration=2.656576, state=failed, executor_state=success, try_number=1, max_tries=0, job_id=45, pool=default_pool, queue=default, priority_weight=5, operator=DbtSeedLocalOperator, queued_dttm=2023-11-02 02:26:36.398908+00:00, queued_by_job_id=38, pid=93295
2023-11-01 19:27:03,050 INFO - TaskInstance Finished: dag_id=dbt_snowflake_dag, task_id=bookings_2_seed, run_id=manual__2023-11-02T02:26:35.971258+00:00, map_index=-1, run_start_date=2023-11-02 02:26:51.645269+00:00, run_end_date=2023-11-02 02:26:54.187918+00:00, run_duration=2.542649, state=failed, executor_state=success, try_number=1, max_tries=0, job_id=46, pool=default_pool, queue=default, priority_weight=5, operator=DbtSeedLocalOperator, queued_dttm=2023-11-02 02:26:36.398908+00:00, queued_by_job_id=38, pid=93320
2023-11-01 19:27:03,050 INFO - TaskInstance Finished: dag_id=dbt_snowflake_dag, task_id=customers_seed, run_id=manual__2023-11-02T02:26:35.971258+00:00, map_index=-1, run_start_date=2023-11-02 02:27:00.311070+00:00, run_end_date=2023-11-02 02:27:02.864116+00:00, run_duration=2.553046, state=failed, executor_state=success, try_number=1, max_tries=0, job_id=47, pool=default_pool, queue=default, priority_weight=5, operator=DbtSeedLocalOperator, queued_dttm=2023-11-02 02:26:36.398908+00:00, queued_by_job_id=38, pid=93344
2023-11-01 19:27:09,366 ERROR - Marking run <DagRun dbt_snowflake_dag @ 2023-11-02 02:26:35.971258+00:00: manual__2023-11-02T02:26:35.971258+00:00, state:running, queued_at: 2023-11-02 02:26:36.001295+00:00. externally triggered: True> failed
2023-11-01 19:27:09,367 INFO - DagRun Finished: dag_id=dbt_snowflake_dag, execution_date=2023-11-02 02:26:35.971258+00:00, run_id=manual__2023-11-02T02:26:35.971258+00:00, run_start_date=2023-11-02 02:26:36.375983+00:00, run_end_date=2023-11-02 02:27:09.367913+00:00, run_duration=32.99193, state=failed, external_trigger=True, run_type=manual, data_interval_start=2023-11-01 00:00:00+00:00, data_interval_end=2023-11-02 00:00:00+00:00, dag_hash=40aba182c3cf0b0715abb84333c36964
2023-11-01 19:27:09,371 INFO - Setting next_dagrun for dbt_snowflake_dag to 2023-11-02T00:00:00+00:00, run_after=2023-11-03T00:00:00+00:00
2023-11-01 19:27:55,328 INFO - Resetting orphaned tasks for active dag runs
2023-11-01 19:32:55,537 INFO - Resetting orphaned tasks for active dag runs
2023-11-01 19:33:31,710 INFO - 3 tasks up for execution:
<TaskInstance: dbt_snowflake_dag.bookings_1_seed manual__2023-11-02T02:33:30.606613+00:00 [scheduled]>
<TaskInstance: dbt_snowflake_dag.bookings_2_seed manual__2023-11-02T02:33:30.606613+00:00 [scheduled]>
<TaskInstance: dbt_snowflake_dag.customers_seed manual__2023-11-02T02:33:30.606613+00:00 [scheduled]>
2023-11-01 19:33:31,711 INFO - DAG dbt_snowflake_dag has 0/16 running and queued tasks
2023-11-01 19:33:31,711 INFO - DAG dbt_snowflake_dag has 1/16 running and queued tasks
2023-11-01 19:33:31,712 INFO - DAG dbt_snowflake_dag has 2/16 running and queued tasks
2023-11-01 19:33:31,712 INFO - Setting the following tasks to queued state:
<TaskInstance: dbt_snowflake_dag.bookings_1_seed manual__2023-11-02T02:33:30.606613+00:00 [scheduled]>
<TaskInstance: dbt_snowflake_dag.bookings_2_seed manual__2023-11-02T02:33:30.606613+00:00 [scheduled]>
<TaskInstance: dbt_snowflake_dag.customers_seed manual__2023-11-02T02:33:30.606613+00:00 [scheduled]>
2023-11-01 19:33:31,715 INFO - Sending TaskInstanceKey(dag_id='dbt_snowflake_dag', task_id='bookings_1_seed', run_id='manual__2023-11-02T02:33:30.606613+00:00', try_number=1, map_index=-1) to executor with priority 5 and queue default
2023-11-01 19:33:31,716 INFO - Adding to queue: ['airflow', 'tasks', 'run', 'dbt_snowflake_dag', 'bookings_1_seed', 'manual__2023-11-02T02:33:30.606613+00:00', '--local', '--subdir', 'DAGS_FOLDER/dbt_airflow_snowflake.py']
2023-11-01 19:33:31,716 INFO - Sending TaskInstanceKey(dag_id='dbt_snowflake_dag', task_id='bookings_2_seed', run_id='manual__2023-11-02T02:33:30.606613+00:00', try_number=1, map_index=-1) to executor with priority 5 and queue default
2023-11-01 19:33:31,717 INFO - Adding to queue: ['airflow', 'tasks', 'run', 'dbt_snowflake_dag', 'bookings_2_seed', 'manual__2023-11-02T02:33:30.606613+00:00', '--local', '--subdir', 'DAGS_FOLDER/dbt_airflow_snowflake.py']
2023-11-01 19:33:31,717 INFO - Sending TaskInstanceKey(dag_id='dbt_snowflake_dag', task_id='customers_seed', run_id='manual__2023-11-02T02:33:30.606613+00:00', try_number=1, map_index=-1) to executor with priority 5 and queue default
2023-11-01 19:33:31,717 INFO - Adding to queue: ['airflow', 'tasks', 'run', 'dbt_snowflake_dag', 'customers_seed', 'manual__2023-11-02T02:33:30.606613+00:00', '--local', '--subdir', 'DAGS_FOLDER/dbt_airflow_snowflake.py']
2023-11-01 19:33:31,718 INFO - Executing command: ['airflow', 'tasks', 'run', 'dbt_snowflake_dag', 'bookings_1_seed', 'manual__2023-11-02T02:33:30.606613+00:00', '--local', '--subdir', 'DAGS_FOLDER/dbt_airflow_snowflake.py']
2023-11-01 19:33:40,482 INFO - Executing command: ['airflow', 'tasks', 'run', 'dbt_snowflake_dag', 'bookings_2_seed', 'manual__2023-11-02T02:33:30.606613+00:00', '--local', '--subdir', 'DAGS_FOLDER/dbt_airflow_snowflake.py']
2023-11-01 19:33:49,246 INFO - Executing command: ['airflow', 'tasks', 'run', 'dbt_snowflake_dag', 'customers_seed', 'manual__2023-11-02T02:33:30.606613+00:00', '--local', '--subdir', 'DAGS_FOLDER/dbt_airflow_snowflake.py']
2023-11-01 19:33:58,226 INFO - Executor reports execution of dbt_snowflake_dag.bookings_1_seed run_id=manual__2023-11-02T02:33:30.606613+00:00 exited with status success for try_number 1
2023-11-01 19:33:58,228 INFO - Executor reports execution of dbt_snowflake_dag.bookings_2_seed run_id=manual__2023-11-02T02:33:30.606613+00:00 exited with status success for try_number 1
2023-11-01 19:33:58,228 INFO - Executor reports execution of dbt_snowflake_dag.customers_seed run_id=manual__2023-11-02T02:33:30.606613+00:00 exited with status success for try_number 1
2023-11-01 19:33:58,235 INFO - TaskInstance Finished: dag_id=dbt_snowflake_dag, task_id=bookings_1_seed, run_id=manual__2023-11-02T02:33:30.606613+00:00, map_index=-1, run_start_date=2023-11-02 02:33:37.706630+00:00, run_end_date=2023-11-02 02:33:40.267839+00:00, run_duration=2.561209, state=failed, executor_state=success, try_number=1, max_tries=0, job_id=48, pool=default_pool, queue=default, priority_weight=5, operator=DbtSeedLocalOperator, queued_dttm=2023-11-02 02:33:31.713243+00:00, queued_by_job_id=38, pid=94134
2023-11-01 19:33:58,236 INFO - TaskInstance Finished: dag_id=dbt_snowflake_dag, task_id=bookings_2_seed, run_id=manual__2023-11-02T02:33:30.606613+00:00, map_index=-1, run_start_date=2023-11-02 02:33:46.426100+00:00, run_end_date=2023-11-02 02:33:49.043354+00:00, run_duration=2.617254, state=failed, executor_state=success, try_number=1, max_tries=0, job_id=49, pool=default_pool, queue=default, priority_weight=5, operator=DbtSeedLocalOperator, queued_dttm=2023-11-02 02:33:31.713243+00:00, queued_by_job_id=38, pid=94163
2023-11-01 19:33:58,236 INFO - TaskInstance Finished: dag_id=dbt_snowflake_dag, task_id=customers_seed, run_id=manual__2023-11-02T02:33:30.606613+00:00, map_index=-1, run_start_date=2023-11-02 02:33:55.314062+00:00, run_end_date=2023-11-02 02:33:58.027557+00:00, run_duration=2.713495, state=failed, executor_state=success, try_number=1, max_tries=0, job_id=50, pool=default_pool, queue=default, priority_weight=5, operator=DbtSeedLocalOperator, queued_dttm=2023-11-02 02:33:31.713243+00:00, queued_by_job_id=38, pid=94186
2023-11-01 19:34:04,483 ERROR - Marking run <DagRun dbt_snowflake_dag @ 2023-11-02 02:33:30.606613+00:00: manual__2023-11-02T02:33:30.606613+00:00, state:running, queued_at: 2023-11-02 02:33:30.613376+00:00. externally triggered: True> failed
2023-11-01 19:34:04,484 INFO - DagRun Finished: dag_id=dbt_snowflake_dag, execution_date=2023-11-02 02:33:30.606613+00:00, run_id=manual__2023-11-02T02:33:30.606613+00:00, run_start_date=2023-11-02 02:33:31.698361+00:00, run_end_date=2023-11-02 02:34:04.484469+00:00, run_duration=32.786108, state=failed, external_trigger=True, run_type=manual, data_interval_start=2023-11-01 00:00:00+00:00, data_interval_end=2023-11-02 00:00:00+00:00, dag_hash=40aba182c3cf0b0715abb84333c36964
2023-11-01 19:34:04,486 INFO - Setting next_dagrun for dbt_snowflake_dag to 2023-11-02T00:00:00+00:00, run_after=2023-11-03T00:00:00+00:00
2023-11-01 19:37:56,503 INFO - Resetting orphaned tasks for active dag runs
2023-11-01 19:42:56,963 INFO - Resetting orphaned tasks for active dag runs
2023-11-01 19:46:39,390 INFO - 3 tasks up for execution:
<TaskInstance: dbt_snowflake_dag.bookings_1_seed manual__2023-11-02T02:46:38.148171+00:00 [scheduled]>
<TaskInstance: dbt_snowflake_dag.bookings_2_seed manual__2023-11-02T02:46:38.148171+00:00 [scheduled]>
<TaskInstance: dbt_snowflake_dag.customers_seed manual__2023-11-02T02:46:38.148171+00:00 [scheduled]>
2023-11-01 19:46:39,391 INFO - DAG dbt_snowflake_dag has 0/16 running and queued tasks
2023-11-01 19:46:39,391 INFO - DAG dbt_snowflake_dag has 1/16 running and queued tasks
2023-11-01 19:46:39,392 INFO - DAG dbt_snowflake_dag has 2/16 running and queued tasks
2023-11-01 19:46:39,392 INFO - Setting the following tasks to queued state:
<TaskInstance: dbt_snowflake_dag.bookings_1_seed manual__2023-11-02T02:46:38.148171+00:00 [scheduled]>
<TaskInstance: dbt_snowflake_dag.bookings_2_seed manual__2023-11-02T02:46:38.148171+00:00 [scheduled]>
<TaskInstance: dbt_snowflake_dag.customers_seed manual__2023-11-02T02:46:38.148171+00:00 [scheduled]>
2023-11-01 19:46:39,394 INFO - Sending TaskInstanceKey(dag_id='dbt_snowflake_dag', task_id='bookings_1_seed', run_id='manual__2023-11-02T02:46:38.148171+00:00', try_number=1, map_index=-1) to executor with priority 5 and queue default
2023-11-01 19:46:39,395 INFO - Adding to queue: ['airflow', 'tasks', 'run', 'dbt_snowflake_dag', 'bookings_1_seed', 'manual__2023-11-02T02:46:38.148171+00:00', '--local', '--subdir', 'DAGS_FOLDER/dbt_airflow_snowflake.py']
2023-11-01 19:46:39,395 INFO - Sending TaskInstanceKey(dag_id='dbt_snowflake_dag', task_id='bookings_2_seed', run_id='manual__2023-11-02T02:46:38.148171+00:00', try_number=1, map_index=-1) to executor with priority 5 and queue default
2023-11-01 19:46:39,395 INFO - Adding to queue: ['airflow', 'tasks', 'run', 'dbt_snowflake_dag', 'bookings_2_seed', 'manual__2023-11-02T02:46:38.148171+00:00', '--local', '--subdir', 'DAGS_FOLDER/dbt_airflow_snowflake.py']
2023-11-01 19:46:39,396 INFO - Sending TaskInstanceKey(dag_id='dbt_snowflake_dag', task_id='customers_seed', run_id='manual__2023-11-02T02:46:38.148171+00:00', try_number=1, map_index=-1) to executor with priority 5 and queue default
2023-11-01 19:46:39,396 INFO - Adding to queue: ['airflow', 'tasks', 'run', 'dbt_snowflake_dag', 'customers_seed', 'manual__2023-11-02T02:46:38.148171+00:00', '--local', '--subdir', 'DAGS_FOLDER/dbt_airflow_snowflake.py']
2023-11-01 19:46:39,397 INFO - Executing command: ['airflow', 'tasks', 'run', 'dbt_snowflake_dag', 'bookings_1_seed', 'manual__2023-11-02T02:46:38.148171+00:00', '--local', '--subdir', 'DAGS_FOLDER/dbt_airflow_snowflake.py']
2023-11-01 19:46:48,664 INFO - Executing command: ['airflow', 'tasks', 'run', 'dbt_snowflake_dag', 'bookings_2_seed', 'manual__2023-11-02T02:46:38.148171+00:00', '--local', '--subdir', 'DAGS_FOLDER/dbt_airflow_snowflake.py']
2023-11-01 19:46:57,788 INFO - Executing command: ['airflow', 'tasks', 'run', 'dbt_snowflake_dag', 'customers_seed', 'manual__2023-11-02T02:46:38.148171+00:00', '--local', '--subdir', 'DAGS_FOLDER/dbt_airflow_snowflake.py']
2023-11-01 19:47:06,873 INFO - Executor reports execution of dbt_snowflake_dag.bookings_1_seed run_id=manual__2023-11-02T02:46:38.148171+00:00 exited with status success for try_number 1
2023-11-01 19:47:06,874 INFO - Executor reports execution of dbt_snowflake_dag.bookings_2_seed run_id=manual__2023-11-02T02:46:38.148171+00:00 exited with status success for try_number 1
2023-11-01 19:47:06,875 INFO - Executor reports execution of dbt_snowflake_dag.customers_seed run_id=manual__2023-11-02T02:46:38.148171+00:00 exited with status success for try_number 1
2023-11-01 19:47:06,883 INFO - TaskInstance Finished: dag_id=dbt_snowflake_dag, task_id=bookings_1_seed, run_id=manual__2023-11-02T02:46:38.148171+00:00, map_index=-1, run_start_date=2023-11-02 02:46:45.869236+00:00, run_end_date=2023-11-02 02:46:48.497649+00:00, run_duration=2.628413, state=failed, executor_state=success, try_number=1, max_tries=0, job_id=51, pool=default_pool, queue=default, priority_weight=5, operator=DbtSeedLocalOperator, queued_dttm=2023-11-02 02:46:39.393016+00:00, queued_by_job_id=38, pid=95460
2023-11-01 19:47:06,883 INFO - TaskInstance Finished: dag_id=dbt_snowflake_dag, task_id=bookings_2_seed, run_id=manual__2023-11-02T02:46:38.148171+00:00, map_index=-1, run_start_date=2023-11-02 02:46:54.848808+00:00, run_end_date=2023-11-02 02:46:57.571355+00:00, run_duration=2.722547, state=failed, executor_state=success, try_number=1, max_tries=0, job_id=52, pool=default_pool, queue=default, priority_weight=5, operator=DbtSeedLocalOperator, queued_dttm=2023-11-02 02:46:39.393016+00:00, queued_by_job_id=38, pid=95491
2023-11-01 19:47:06,883 INFO - TaskInstance Finished: dag_id=dbt_snowflake_dag, task_id=customers_seed, run_id=manual__2023-11-02T02:46:38.148171+00:00, map_index=-1, run_start_date=2023-11-02 02:47:03.822192+00:00, run_end_date=2023-11-02 02:47:06.690229+00:00, run_duration=2.868037, state=failed, executor_state=success, try_number=1, max_tries=0, job_id=53, pool=default_pool, queue=default, priority_weight=5, operator=DbtSeedLocalOperator, queued_dttm=2023-11-02 02:46:39.393016+00:00, queued_by_job_id=38, pid=95515
2023-11-01 19:47:07,830 ERROR - Marking run <DagRun dbt_snowflake_dag @ 2023-11-02 02:46:38.148171+00:00: manual__2023-11-02T02:46:38.148171+00:00, state:running, queued_at: 2023-11-02 02:46:38.157137+00:00. externally triggered: True> failed
2023-11-01 19:47:07,831 INFO - DagRun Finished: dag_id=dbt_snowflake_dag, execution_date=2023-11-02 02:46:38.148171+00:00, run_id=manual__2023-11-02T02:46:38.148171+00:00, run_start_date=2023-11-02 02:46:39.372823+00:00, run_end_date=2023-11-02 02:47:07.831817+00:00, run_duration=28.458994, state=failed, external_trigger=True, run_type=manual, data_interval_start=2023-11-01 00:00:00+00:00, data_interval_end=2023-11-02 00:00:00+00:00, dag_hash=40aba182c3cf0b0715abb84333c36964
2023-11-01 19:47:07,835 INFO - Setting next_dagrun for dbt_snowflake_dag to 2023-11-02T00:00:00+00:00, run_after=2023-11-03T00:00:00+00:00
2023-11-01 19:47:57,215 INFO - Resetting orphaned tasks for active dag runs
2023-11-01 19:52:38,657 INFO - 3 tasks up for execution:
<TaskInstance: dbt_snowflake_dag.bookings_1_seed manual__2023-11-02T02:52:37.576838+00:00 [scheduled]>
<TaskInstance: dbt_snowflake_dag.bookings_2_seed manual__2023-11-02T02:52:37.576838+00:00 [scheduled]>
<TaskInstance: dbt_snowflake_dag.customers_seed manual__2023-11-02T02:52:37.576838+00:00 [scheduled]>
2023-11-01 19:52:38,659 INFO - DAG dbt_snowflake_dag has 0/16 running and queued tasks
2023-11-01 19:52:38,659 INFO - DAG dbt_snowflake_dag has 1/16 running and queued tasks
2023-11-01 19:52:38,660 INFO - DAG dbt_snowflake_dag has 2/16 running and queued tasks
2023-11-01 19:52:38,660 INFO - Setting the following tasks to queued state:
<TaskInstance: dbt_snowflake_dag.bookings_1_seed manual__2023-11-02T02:52:37.576838+00:00 [scheduled]>
<TaskInstance: dbt_snowflake_dag.bookings_2_seed manual__2023-11-02T02:52:37.576838+00:00 [scheduled]>
<TaskInstance: dbt_snowflake_dag.customers_seed manual__2023-11-02T02:52:37.576838+00:00 [scheduled]>
2023-11-01 19:52:38,662 INFO - Sending TaskInstanceKey(dag_id='dbt_snowflake_dag', task_id='bookings_1_seed', run_id='manual__2023-11-02T02:52:37.576838+00:00', try_number=1, map_index=-1) to executor with priority 5 and queue default
2023-11-01 19:52:38,663 INFO - Adding to queue: ['airflow', 'tasks', 'run', 'dbt_snowflake_dag', 'bookings_1_seed', 'manual__2023-11-02T02:52:37.576838+00:00', '--local', '--subdir', 'DAGS_FOLDER/dbt_airflow_snowflake.py']
2023-11-01 19:52:38,663 INFO - Sending TaskInstanceKey(dag_id='dbt_snowflake_dag', task_id='bookings_2_seed', run_id='manual__2023-11-02T02:52:37.576838+00:00', try_number=1, map_index=-1) to executor with priority 5 and queue default
2023-11-01 19:52:38,664 INFO - Adding to queue: ['airflow', 'tasks', 'run', 'dbt_snowflake_dag', 'bookings_2_seed', 'manual__2023-11-02T02:52:37.576838+00:00', '--local', '--subdir', 'DAGS_FOLDER/dbt_airflow_snowflake.py']
2023-11-01 19:52:38,664 INFO - Sending TaskInstanceKey(dag_id='dbt_snowflake_dag', task_id='customers_seed', run_id='manual__2023-11-02T02:52:37.576838+00:00', try_number=1, map_index=-1) to executor with priority 5 and queue default
2023-11-01 19:52:38,665 INFO - Adding to queue: ['airflow', 'tasks', 'run', 'dbt_snowflake_dag', 'customers_seed', 'manual__2023-11-02T02:52:37.576838+00:00', '--local', '--subdir', 'DAGS_FOLDER/dbt_airflow_snowflake.py']
2023-11-01 19:52:38,666 INFO - Executing command: ['airflow', 'tasks', 'run', 'dbt_snowflake_dag', 'bookings_1_seed', 'manual__2023-11-02T02:52:37.576838+00:00', '--local', '--subdir', 'DAGS_FOLDER/dbt_airflow_snowflake.py']
2023-11-01 19:52:47,817 INFO - Executing command: ['airflow', 'tasks', 'run', 'dbt_snowflake_dag', 'bookings_2_seed', 'manual__2023-11-02T02:52:37.576838+00:00', '--local', '--subdir', 'DAGS_FOLDER/dbt_airflow_snowflake.py']
2023-11-01 19:52:57,182 INFO - Executing command: ['airflow', 'tasks', 'run', 'dbt_snowflake_dag', 'customers_seed', 'manual__2023-11-02T02:52:37.576838+00:00', '--local', '--subdir', 'DAGS_FOLDER/dbt_airflow_snowflake.py']
2023-11-01 19:53:05,850 INFO - Executor reports execution of dbt_snowflake_dag.bookings_1_seed run_id=manual__2023-11-02T02:52:37.576838+00:00 exited with status success for try_number 1
2023-11-01 19:53:05,852 INFO - Executor reports execution of dbt_snowflake_dag.bookings_2_seed run_id=manual__2023-11-02T02:52:37.576838+00:00 exited with status success for try_number 1
2023-11-01 19:53:05,852 INFO - Executor reports execution of dbt_snowflake_dag.customers_seed run_id=manual__2023-11-02T02:52:37.576838+00:00 exited with status success for try_number 1
2023-11-01 19:53:05,859 INFO - TaskInstance Finished: dag_id=dbt_snowflake_dag, task_id=bookings_1_seed, run_id=manual__2023-11-02T02:52:37.576838+00:00, map_index=-1, run_start_date=2023-11-02 02:52:45.052848+00:00, run_end_date=2023-11-02 02:52:47.634923+00:00, run_duration=2.582075, state=failed, executor_state=success, try_number=1, max_tries=0, job_id=54, pool=default_pool, queue=default, priority_weight=5, operator=DbtSeedLocalOperator, queued_dttm=2023-11-02 02:52:38.661584+00:00, queued_by_job_id=38, pid=96102
2023-11-01 19:53:05,859 INFO - TaskInstance Finished: dag_id=dbt_snowflake_dag, task_id=bookings_2_seed, run_id=manual__2023-11-02T02:52:37.576838+00:00, map_index=-1, run_start_date=2023-11-02 02:52:54.057655+00:00, run_end_date=2023-11-02 02:52:57.004864+00:00, run_duration=2.947209, state=failed, executor_state=success, try_number=1, max_tries=0, job_id=55, pool=default_pool, queue=default, priority_weight=5, operator=DbtSeedLocalOperator, queued_dttm=2023-11-02 02:52:38.661584+00:00, queued_by_job_id=38, pid=96127
2023-11-01 19:53:05,859 INFO - TaskInstance Finished: dag_id=dbt_snowflake_dag, task_id=customers_seed, run_id=manual__2023-11-02T02:52:37.576838+00:00, map_index=-1, run_start_date=2023-11-02 02:53:03.049998+00:00, run_end_date=2023-11-02 02:53:05.647797+00:00, run_duration=2.597799, state=failed, executor_state=success, try_number=1, max_tries=0, job_id=56, pool=default_pool, queue=default, priority_weight=5, operator=DbtSeedLocalOperator, queued_dttm=2023-11-02 02:52:38.661584+00:00, queued_by_job_id=38, pid=96151
2023-11-01 19:53:05,878 INFO - Resetting orphaned tasks for active dag runs
2023-11-01 19:53:11,858 ERROR - Marking run <DagRun dbt_snowflake_dag @ 2023-11-02 02:52:37.576838+00:00: manual__2023-11-02T02:52:37.576838+00:00, state:running, queued_at: 2023-11-02 02:52:37.597708+00:00. externally triggered: True> failed
2023-11-01 19:53:11,859 INFO - DagRun Finished: dag_id=dbt_snowflake_dag, execution_date=2023-11-02 02:52:37.576838+00:00, run_id=manual__2023-11-02T02:52:37.576838+00:00, run_start_date=2023-11-02 02:52:38.634678+00:00, run_end_date=2023-11-02 02:53:11.859082+00:00, run_duration=33.224404, state=failed, external_trigger=True, run_type=manual, data_interval_start=2023-11-01 00:00:00+00:00, data_interval_end=2023-11-02 00:00:00+00:00, dag_hash=40aba182c3cf0b0715abb84333c36964
2023-11-01 19:53:11,861 INFO - Setting next_dagrun for dbt_snowflake_dag to 2023-11-02T00:00:00+00:00, run_after=2023-11-03T00:00:00+00:00
2023-11-01 19:58:07,399 INFO - Resetting orphaned tasks for active dag runs
2023-11-01 20:03:08,390 INFO - Resetting orphaned tasks for active dag runs
2023-11-01 20:04:29,442 INFO - 3 tasks up for execution:
<TaskInstance: dbt_snowflake_dag.bookings_1_seed manual__2023-11-02T03:04:28.843503+00:00 [scheduled]>
<TaskInstance: dbt_snowflake_dag.bookings_2_seed manual__2023-11-02T03:04:28.843503+00:00 [scheduled]>
<TaskInstance: dbt_snowflake_dag.customers_seed manual__2023-11-02T03:04:28.843503+00:00 [scheduled]>
2023-11-01 20:04:29,444 INFO - DAG dbt_snowflake_dag has 0/16 running and queued tasks
2023-11-01 20:04:29,444 INFO - DAG dbt_snowflake_dag has 1/16 running and queued tasks
2023-11-01 20:04:29,444 INFO - DAG dbt_snowflake_dag has 2/16 running and queued tasks
2023-11-01 20:04:29,444 INFO - Setting the following tasks to queued state:
<TaskInstance: dbt_snowflake_dag.bookings_1_seed manual__2023-11-02T03:04:28.843503+00:00 [scheduled]>
<TaskInstance: dbt_snowflake_dag.bookings_2_seed manual__2023-11-02T03:04:28.843503+00:00 [scheduled]>
<TaskInstance: dbt_snowflake_dag.customers_seed manual__2023-11-02T03:04:28.843503+00:00 [scheduled]>
2023-11-01 20:04:29,446 INFO - Sending TaskInstanceKey(dag_id='dbt_snowflake_dag', task_id='bookings_1_seed', run_id='manual__2023-11-02T03:04:28.843503+00:00', try_number=1, map_index=-1) to executor with priority 5 and queue default
2023-11-01 20:04:29,446 INFO - Adding to queue: ['airflow', 'tasks', 'run', 'dbt_snowflake_dag', 'bookings_1_seed', 'manual__2023-11-02T03:04:28.843503+00:00', '--local', '--subdir', 'DAGS_FOLDER/dbt_airflow_snowflake.py']
2023-11-01 20:04:29,447 INFO - Sending TaskInstanceKey(dag_id='dbt_snowflake_dag', task_id='bookings_2_seed', run_id='manual__2023-11-02T03:04:28.843503+00:00', try_number=1, map_index=-1) to executor with priority 5 and queue default
2023-11-01 20:04:29,447 INFO - Adding to queue: ['airflow', 'tasks', 'run', 'dbt_snowflake_dag', 'bookings_2_seed', 'manual__2023-11-02T03:04:28.843503+00:00', '--local', '--subdir', 'DAGS_FOLDER/dbt_airflow_snowflake.py']
2023-11-01 20:04:29,447 INFO - Sending TaskInstanceKey(dag_id='dbt_snowflake_dag', task_id='customers_seed', run_id='manual__2023-11-02T03:04:28.843503+00:00', try_number=1, map_index=-1) to executor with priority 5 and queue default
2023-11-01 20:04:29,447 INFO - Adding to queue: ['airflow', 'tasks', 'run', 'dbt_snowflake_dag', 'customers_seed', 'manual__2023-11-02T03:04:28.843503+00:00', '--local', '--subdir', 'DAGS_FOLDER/dbt_airflow_snowflake.py']
2023-11-01 20:04:29,448 INFO - Executing command: ['airflow', 'tasks', 'run', 'dbt_snowflake_dag', 'bookings_1_seed', 'manual__2023-11-02T03:04:28.843503+00:00', '--local', '--subdir', 'DAGS_FOLDER/dbt_airflow_snowflake.py']
2023-11-01 20:04:38,821 INFO - Executing command: ['airflow', 'tasks', 'run', 'dbt_snowflake_dag', 'bookings_2_seed', 'manual__2023-11-02T03:04:28.843503+00:00', '--local', '--subdir', 'DAGS_FOLDER/dbt_airflow_snowflake.py']
2023-11-01 20:04:47,589 INFO - Executing command: ['airflow', 'tasks', 'run', 'dbt_snowflake_dag', 'customers_seed', 'manual__2023-11-02T03:04:28.843503+00:00', '--local', '--subdir', 'DAGS_FOLDER/dbt_airflow_snowflake.py']
2023-11-01 20:04:56,654 INFO - Executor reports execution of dbt_snowflake_dag.bookings_1_seed run_id=manual__2023-11-02T03:04:28.843503+00:00 exited with status success for try_number 1
2023-11-01 20:04:56,656 INFO - Executor reports execution of dbt_snowflake_dag.bookings_2_seed run_id=manual__2023-11-02T03:04:28.843503+00:00 exited with status success for try_number 1
2023-11-01 20:04:56,656 INFO - Executor reports execution of dbt_snowflake_dag.customers_seed run_id=manual__2023-11-02T03:04:28.843503+00:00 exited with status success for try_number 1
2023-11-01 20:04:56,663 INFO - TaskInstance Finished: dag_id=dbt_snowflake_dag, task_id=bookings_1_seed, run_id=manual__2023-11-02T03:04:28.843503+00:00, map_index=-1, run_start_date=2023-11-02 03:04:35.776668+00:00, run_end_date=2023-11-02 03:04:38.618015+00:00, run_duration=2.841347, state=failed, executor_state=success, try_number=1, max_tries=0, job_id=57, pool=default_pool, queue=default, priority_weight=5, operator=DbtSeedLocalOperator, queued_dttm=2023-11-02 03:04:29.445309+00:00, queued_by_job_id=38, pid=97278
2023-11-01 20:04:56,663 INFO - TaskInstance Finished: dag_id=dbt_snowflake_dag, task_id=bookings_2_seed, run_id=manual__2023-11-02T03:04:28.843503+00:00, map_index=-1, run_start_date=2023-11-02 03:04:44.822911+00:00, run_end_date=2023-11-02 03:04:47.401284+00:00, run_duration=2.578373, state=failed, executor_state=success, try_number=1, max_tries=0, job_id=58, pool=default_pool, queue=default, priority_weight=5, operator=DbtSeedLocalOperator, queued_dttm=2023-11-02 03:04:29.445309+00:00, queued_by_job_id=38, pid=97300
2023-11-01 20:04:56,663 INFO - TaskInstance Finished: dag_id=dbt_snowflake_dag, task_id=customers_seed, run_id=manual__2023-11-02T03:04:28.843503+00:00, map_index=-1, run_start_date=2023-11-02 03:04:53.813996+00:00, run_end_date=2023-11-02 03:04:56.451773+00:00, run_duration=2.637777, state=failed, executor_state=success, try_number=1, max_tries=0, job_id=59, pool=default_pool, queue=default, priority_weight=5, operator=DbtSeedLocalOperator, queued_dttm=2023-11-02 03:04:29.445309+00:00, queued_by_job_id=38, pid=97324
2023-11-01 20:04:57,781 ERROR - Marking run <DagRun dbt_snowflake_dag @ 2023-11-02 03:04:28.843503+00:00: manual__2023-11-02T03:04:28.843503+00:00, state:running, queued_at: 2023-11-02 03:04:28.852946+00:00. externally triggered: True> failed
2023-11-01 20:04:57,782 INFO - DagRun Finished: dag_id=dbt_snowflake_dag, execution_date=2023-11-02 03:04:28.843503+00:00, run_id=manual__2023-11-02T03:04:28.843503+00:00, run_start_date=2023-11-02 03:04:29.422766+00:00, run_end_date=2023-11-02 03:04:57.782287+00:00, run_duration=28.359521, state=failed, external_trigger=True, run_type=manual, data_interval_start=2023-11-01 00:00:00+00:00, data_interval_end=2023-11-02 00:00:00+00:00, dag_hash=40aba182c3cf0b0715abb84333c36964
2023-11-01 20:04:57,787 INFO - Setting next_dagrun for dbt_snowflake_dag to 2023-11-02T00:00:00+00:00, run_after=2023-11-03T00:00:00+00:00
2023-11-01 20:05:14,770 INFO - 3 tasks up for execution:
<TaskInstance: dbt_snowflake_dag.bookings_1_seed manual__2023-11-02T03:05:13.632989+00:00 [scheduled]>
<TaskInstance: dbt_snowflake_dag.bookings_2_seed manual__2023-11-02T03:05:13.632989+00:00 [scheduled]>
<TaskInstance: dbt_snowflake_dag.customers_seed manual__2023-11-02T03:05:13.632989+00:00 [scheduled]>
2023-11-01 20:05:14,771 INFO - DAG dbt_snowflake_dag has 0/16 running and queued tasks
2023-11-01 20:05:14,771 INFO - DAG dbt_snowflake_dag has 1/16 running and queued tasks
2023-11-01 20:05:14,772 INFO - DAG dbt_snowflake_dag has 2/16 running and queued tasks
2023-11-01 20:05:14,772 INFO - Setting the following tasks to queued state:
<TaskInstance: dbt_snowflake_dag.bookings_1_seed manual__2023-11-02T03:05:13.632989+00:00 [scheduled]>
<TaskInstance: dbt_snowflake_dag.bookings_2_seed manual__2023-11-02T03:05:13.632989+00:00 [scheduled]>
<TaskInstance: dbt_snowflake_dag.customers_seed manual__2023-11-02T03:05:13.632989+00:00 [scheduled]>
2023-11-01 20:05:14,773 INFO - Sending TaskInstanceKey(dag_id='dbt_snowflake_dag', task_id='bookings_1_seed', run_id='manual__2023-11-02T03:05:13.632989+00:00', try_number=1, map_index=-1) to executor with priority 5 and queue default
2023-11-01 20:05:14,773 INFO - Adding to queue: ['airflow', 'tasks', 'run', 'dbt_snowflake_dag', 'bookings_1_seed', 'manual__2023-11-02T03:05:13.632989+00:00', '--local', '--subdir', 'DAGS_FOLDER/dbt_airflow_snowflake.py']
2023-11-01 20:05:14,773 INFO - Sending TaskInstanceKey(dag_id='dbt_snowflake_dag', task_id='bookings_2_seed', run_id='manual__2023-11-02T03:05:13.632989+00:00', try_number=1, map_index=-1) to executor with priority 5 and queue default
2023-11-01 20:05:14,774 INFO - Adding to queue: ['airflow', 'tasks', 'run', 'dbt_snowflake_dag', 'bookings_2_seed', 'manual__2023-11-02T03:05:13.632989+00:00', '--local', '--subdir', 'DAGS_FOLDER/dbt_airflow_snowflake.py']
2023-11-01 20:05:14,774 INFO - Sending TaskInstanceKey(dag_id='dbt_snowflake_dag', task_id='customers_seed', run_id='manual__2023-11-02T03:05:13.632989+00:00', try_number=1, map_index=-1) to executor with priority 5 and queue default
2023-11-01 20:05:14,774 INFO - Adding to queue: ['airflow', 'tasks', 'run', 'dbt_snowflake_dag', 'customers_seed', 'manual__2023-11-02T03:05:13.632989+00:00', '--local', '--subdir', 'DAGS_FOLDER/dbt_airflow_snowflake.py']
2023-11-01 20:05:14,775 INFO - Executing command: ['airflow', 'tasks', 'run', 'dbt_snowflake_dag', 'bookings_1_seed', 'manual__2023-11-02T03:05:13.632989+00:00', '--local', '--subdir', 'DAGS_FOLDER/dbt_airflow_snowflake.py']
2023-11-01 20:05:23,721 INFO - Executing command: ['airflow', 'tasks', 'run', 'dbt_snowflake_dag', 'bookings_2_seed', 'manual__2023-11-02T03:05:13.632989+00:00', '--local', '--subdir', 'DAGS_FOLDER/dbt_airflow_snowflake.py']
2023-11-01 20:05:32,807 INFO - Executing command: ['airflow', 'tasks', 'run', 'dbt_snowflake_dag', 'customers_seed', 'manual__2023-11-02T03:05:13.632989+00:00', '--local', '--subdir', 'DAGS_FOLDER/dbt_airflow_snowflake.py']
2023-11-01 20:05:41,645 INFO - Executor reports execution of dbt_snowflake_dag.bookings_1_seed run_id=manual__2023-11-02T03:05:13.632989+00:00 exited with status success for try_number 1
2023-11-01 20:05:41,646 INFO - Executor reports execution of dbt_snowflake_dag.bookings_2_seed run_id=manual__2023-11-02T03:05:13.632989+00:00 exited with status success for try_number 1
2023-11-01 20:05:41,647 INFO - Executor reports execution of dbt_snowflake_dag.customers_seed run_id=manual__2023-11-02T03:05:13.632989+00:00 exited with status success for try_number 1
2023-11-01 20:05:41,653 INFO - TaskInstance Finished: dag_id=dbt_snowflake_dag, task_id=bookings_1_seed, run_id=manual__2023-11-02T03:05:13.632989+00:00, map_index=-1, run_start_date=2023-11-02 03:05:20.919658+00:00, run_end_date=2023-11-02 03:05:23.535877+00:00, run_duration=2.616219, state=failed, executor_state=success, try_number=1, max_tries=0, job_id=60, pool=default_pool, queue=default, priority_weight=5, operator=DbtSeedLocalOperator, queued_dttm=2023-11-02 03:05:14.772691+00:00, queued_by_job_id=38, pid=97407
2023-11-01 20:05:41,654 INFO - TaskInstance Finished: dag_id=dbt_snowflake_dag, task_id=bookings_2_seed, run_id=manual__2023-11-02T03:05:13.632989+00:00, map_index=-1, run_start_date=2023-11-02 03:05:30.068802+00:00, run_end_date=2023-11-02 03:05:32.624761+00:00, run_duration=2.555959, state=failed, executor_state=success, try_number=1, max_tries=0, job_id=61, pool=default_pool, queue=default, priority_weight=5, operator=DbtSeedLocalOperator, queued_dttm=2023-11-02 03:05:14.772691+00:00, queued_by_job_id=38, pid=97437
2023-11-01 20:05:41,654 INFO - TaskInstance Finished: dag_id=dbt_snowflake_dag, task_id=customers_seed, run_id=manual__2023-11-02T03:05:13.632989+00:00, map_index=-1, run_start_date=2023-11-02 03:05:38.827505+00:00, run_end_date=2023-11-02 03:05:41.424113+00:00, run_duration=2.596608, state=failed, executor_state=success, try_number=1, max_tries=0, job_id=62, pool=default_pool, queue=default, priority_weight=5, operator=DbtSeedLocalOperator, queued_dttm=2023-11-02 03:05:14.772691+00:00, queued_by_job_id=38, pid=97462
2023-11-01 20:05:42,830 ERROR - Marking run <DagRun dbt_snowflake_dag @ 2023-11-02 03:05:13.632989+00:00: manual__2023-11-02T03:05:13.632989+00:00, state:running, queued_at: 2023-11-02 03:05:13.650638+00:00. externally triggered: True> failed
2023-11-01 20:05:42,831 INFO - DagRun Finished: dag_id=dbt_snowflake_dag, execution_date=2023-11-02 03:05:13.632989+00:00, run_id=manual__2023-11-02T03:05:13.632989+00:00, run_start_date=2023-11-02 03:05:14.760963+00:00, run_end_date=2023-11-02 03:05:42.831212+00:00, run_duration=28.070249, state=failed, external_trigger=True, run_type=manual, data_interval_start=2023-11-01 00:00:00+00:00, data_interval_end=2023-11-02 00:00:00+00:00, dag_hash=40aba182c3cf0b0715abb84333c36964
2023-11-01 20:05:42,833 INFO - Setting next_dagrun for dbt_snowflake_dag to 2023-11-02T00:00:00+00:00, run_after=2023-11-03T00:00:00+00:00
2023-11-01 20:08:08,455 INFO - Resetting orphaned tasks for active dag runs
2023-11-01 20:08:22,944 INFO - Exiting gracefully upon receiving signal 15
2023-11-01 20:08:23,957 INFO - Sending Signals.SIGTERM to group 86366. PIDs of all processes in the group: [86366]
2023-11-01 20:08:23,958 INFO - Sending the signal Signals.SIGTERM to group 86366
2023-11-01 20:08:24,384 INFO - Process psutil.Process(pid=86366, status='terminated', exitcode=0, started='18:22:31') (86366) terminated with exit code 0
2023-11-01 20:08:24,390 INFO - Sending Signals.SIGTERM to group 86366. PIDs of all processes in the group: []
2023-11-01 20:08:24,390 INFO - Sending the signal Signals.SIGTERM to group 86366
2023-11-01 20:08:24,391 INFO - Sending the signal Signals.SIGTERM to process 86366 as process group is missing.
2023-11-01 20:08:24,391 INFO - Exited execute loop
2023-11-01 20:08:28,011 INFO - Starting the scheduler
2023-11-01 20:08:28,011 INFO - Processing each file at most -1 times
2023-11-01 20:08:28,013 INFO - Loaded executor: SequentialExecutor
2023-11-01 20:08:28,016 INFO - Launched DagFileProcessorManager with pid: 97900
2023-11-01 20:08:28,017 INFO - Resetting orphaned tasks for active dag runs
2023-11-01 20:11:43,920 INFO - 3 tasks up for execution:
<TaskInstance: dbt_snowflake_dag.bookings_1_seed manual__2023-11-02T03:11:38.188517+00:00 [scheduled]>
<TaskInstance: dbt_snowflake_dag.bookings_2_seed manual__2023-11-02T03:11:38.188517+00:00 [scheduled]>
<TaskInstance: dbt_snowflake_dag.customers_seed manual__2023-11-02T03:11:38.188517+00:00 [scheduled]>
2023-11-01 20:11:43,921 INFO - DAG dbt_snowflake_dag has 0/16 running and queued tasks
2023-11-01 20:11:43,921 INFO - DAG dbt_snowflake_dag has 1/16 running and queued tasks
2023-11-01 20:11:43,922 INFO - DAG dbt_snowflake_dag has 2/16 running and queued tasks
2023-11-01 20:11:43,922 INFO - Setting the following tasks to queued state:
<TaskInstance: dbt_snowflake_dag.bookings_1_seed manual__2023-11-02T03:11:38.188517+00:00 [scheduled]>
<TaskInstance: dbt_snowflake_dag.bookings_2_seed manual__2023-11-02T03:11:38.188517+00:00 [scheduled]>
<TaskInstance: dbt_snowflake_dag.customers_seed manual__2023-11-02T03:11:38.188517+00:00 [scheduled]>
2023-11-01 20:11:43,923 INFO - Sending TaskInstanceKey(dag_id='dbt_snowflake_dag', task_id='bookings_1_seed', run_id='manual__2023-11-02T03:11:38.188517+00:00', try_number=1, map_index=-1) to executor with priority 5 and queue default
2023-11-01 20:11:43,923 INFO - Adding to queue: ['airflow', 'tasks', 'run', 'dbt_snowflake_dag', 'bookings_1_seed', 'manual__2023-11-02T03:11:38.188517+00:00', '--local', '--subdir', 'DAGS_FOLDER/dbt_airflow_snowflake.py']
2023-11-01 20:11:43,924 INFO - Sending TaskInstanceKey(dag_id='dbt_snowflake_dag', task_id='bookings_2_seed', run_id='manual__2023-11-02T03:11:38.188517+00:00', try_number=1, map_index=-1) to executor with priority 5 and queue default
2023-11-01 20:11:43,924 INFO - Adding to queue: ['airflow', 'tasks', 'run', 'dbt_snowflake_dag', 'bookings_2_seed', 'manual__2023-11-02T03:11:38.188517+00:00', '--local', '--subdir', 'DAGS_FOLDER/dbt_airflow_snowflake.py']
2023-11-01 20:11:43,924 INFO - Sending TaskInstanceKey(dag_id='dbt_snowflake_dag', task_id='customers_seed', run_id='manual__2023-11-02T03:11:38.188517+00:00', try_number=1, map_index=-1) to executor with priority 5 and queue default
2023-11-01 20:11:43,925 INFO - Adding to queue: ['airflow', 'tasks', 'run', 'dbt_snowflake_dag', 'customers_seed', 'manual__2023-11-02T03:11:38.188517+00:00', '--local', '--subdir', 'DAGS_FOLDER/dbt_airflow_snowflake.py']
2023-11-01 20:11:43,925 INFO - Executing command: ['airflow', 'tasks', 'run', 'dbt_snowflake_dag', 'bookings_1_seed', 'manual__2023-11-02T03:11:38.188517+00:00', '--local', '--subdir', 'DAGS_FOLDER/dbt_airflow_snowflake.py']
2023-11-01 20:11:54,993 INFO - Executing command: ['airflow', 'tasks', 'run', 'dbt_snowflake_dag', 'bookings_2_seed', 'manual__2023-11-02T03:11:38.188517+00:00', '--local', '--subdir', 'DAGS_FOLDER/dbt_airflow_snowflake.py']
2023-11-01 20:12:09,315 INFO - Executing command: ['airflow', 'tasks', 'run', 'dbt_snowflake_dag', 'customers_seed', 'manual__2023-11-02T03:11:38.188517+00:00', '--local', '--subdir', 'DAGS_FOLDER/dbt_airflow_snowflake.py']
2023-11-01 20:12:19,734 INFO - Executor reports execution of dbt_snowflake_dag.bookings_1_seed run_id=manual__2023-11-02T03:11:38.188517+00:00 exited with status success for try_number 1
2023-11-01 20:12:19,736 INFO - Executor reports execution of dbt_snowflake_dag.bookings_2_seed run_id=manual__2023-11-02T03:11:38.188517+00:00 exited with status success for try_number 1
2023-11-01 20:12:19,736 INFO - Executor reports execution of dbt_snowflake_dag.customers_seed run_id=manual__2023-11-02T03:11:38.188517+00:00 exited with status success for try_number 1
2023-11-01 20:12:19,743 INFO - TaskInstance Finished: dag_id=dbt_snowflake_dag, task_id=bookings_1_seed, run_id=manual__2023-11-02T03:11:38.188517+00:00, map_index=-1, run_start_date=2023-11-02 03:11:51.792733+00:00, run_end_date=2023-11-02 03:11:54.809829+00:00, run_duration=3.017096, state=failed, executor_state=success, try_number=1, max_tries=0, job_id=64, pool=default_pool, queue=default, priority_weight=5, operator=DbtSeedLocalOperator, queued_dttm=2023-11-02 03:11:43.922824+00:00, queued_by_job_id=63, pid=98273
2023-11-01 20:12:19,744 INFO - TaskInstance Finished: dag_id=dbt_snowflake_dag, task_id=bookings_2_seed, run_id=manual__2023-11-02T03:11:38.188517+00:00, map_index=-1, run_start_date=2023-11-02 03:12:03.052071+00:00, run_end_date=2023-11-02 03:12:09.095239+00:00, run_duration=6.043168, state=failed, executor_state=success, try_number=1, max_tries=0, job_id=65, pool=default_pool, queue=default, priority_weight=5, operator=DbtSeedLocalOperator, queued_dttm=2023-11-02 03:11:43.922824+00:00, queued_by_job_id=63, pid=98300
2023-11-01 20:12:19,744 INFO - TaskInstance Finished: dag_id=dbt_snowflake_dag, task_id=customers_seed, run_id=manual__2023-11-02T03:11:38.188517+00:00, map_index=-1, run_start_date=2023-11-02 03:12:16.517548+00:00, run_end_date=2023-11-02 03:12:19.560811+00:00, run_duration=3.043263, state=failed, executor_state=success, try_number=1, max_tries=0, job_id=66, pool=default_pool, queue=default, priority_weight=5, operator=DbtSeedLocalOperator, queued_dttm=2023-11-02 03:11:43.922824+00:00, queued_by_job_id=63, pid=98328
2023-11-01 20:12:26,695 ERROR - Marking run <DagRun dbt_snowflake_dag @ 2023-11-02 03:11:38.188517+00:00: manual__2023-11-02T03:11:38.188517+00:00, state:running, queued_at: 2023-11-02 03:11:38.198008+00:00. externally triggered: True> failed
2023-11-01 20:12:26,697 INFO - DagRun Finished: dag_id=dbt_snowflake_dag, execution_date=2023-11-02 03:11:38.188517+00:00, run_id=manual__2023-11-02T03:11:38.188517+00:00, run_start_date=2023-11-02 03:11:43.905535+00:00, run_end_date=2023-11-02 03:12:26.697284+00:00, run_duration=42.791749, state=failed, external_trigger=True, run_type=manual, data_interval_start=2023-11-01 00:00:00+00:00, data_interval_end=2023-11-02 00:00:00+00:00, dag_hash=40aba182c3cf0b0715abb84333c36964
2023-11-01 20:12:26,700 INFO - Setting next_dagrun for dbt_snowflake_dag to 2023-11-02T00:00:00+00:00, run_after=2023-11-03T00:00:00+00:00
2023-11-01 20:13:28,033 INFO - Resetting orphaned tasks for active dag runs
2023-11-01 20:15:07,329 INFO - 3 tasks up for execution:
<TaskInstance: dbt_snowflake_dag.bookings_1_seed manual__2023-11-02T03:15:06.013746+00:00 [scheduled]>
<TaskInstance: dbt_snowflake_dag.bookings_2_seed manual__2023-11-02T03:15:06.013746+00:00 [scheduled]>
<TaskInstance: dbt_snowflake_dag.customers_seed manual__2023-11-02T03:15:06.013746+00:00 [scheduled]>
2023-11-01 20:15:07,330 INFO - DAG dbt_snowflake_dag has 0/16 running and queued tasks
2023-11-01 20:15:07,330 INFO - DAG dbt_snowflake_dag has 1/16 running and queued tasks
2023-11-01 20:15:07,331 INFO - DAG dbt_snowflake_dag has 2/16 running and queued tasks
2023-11-01 20:15:07,331 INFO - Setting the following tasks to queued state:
<TaskInstance: dbt_snowflake_dag.bookings_1_seed manual__2023-11-02T03:15:06.013746+00:00 [scheduled]>
<TaskInstance: dbt_snowflake_dag.bookings_2_seed manual__2023-11-02T03:15:06.013746+00:00 [scheduled]>
<TaskInstance: dbt_snowflake_dag.customers_seed manual__2023-11-02T03:15:06.013746+00:00 [scheduled]>
2023-11-01 20:15:07,332 INFO - Sending TaskInstanceKey(dag_id='dbt_snowflake_dag', task_id='bookings_1_seed', run_id='manual__2023-11-02T03:15:06.013746+00:00', try_number=1, map_index=-1) to executor with priority 5 and queue default
2023-11-01 20:15:07,332 INFO - Adding to queue: ['airflow', 'tasks', 'run', 'dbt_snowflake_dag', 'bookings_1_seed', 'manual__2023-11-02T03:15:06.013746+00:00', '--local', '--subdir', 'DAGS_FOLDER/dbt_airflow_snowflake.py']
2023-11-01 20:15:07,333 INFO - Sending TaskInstanceKey(dag_id='dbt_snowflake_dag', task_id='bookings_2_seed', run_id='manual__2023-11-02T03:15:06.013746+00:00', try_number=1, map_index=-1) to executor with priority 5 and queue default
2023-11-01 20:15:07,333 INFO - Adding to queue: ['airflow', 'tasks', 'run', 'dbt_snowflake_dag', 'bookings_2_seed', 'manual__2023-11-02T03:15:06.013746+00:00', '--local', '--subdir', 'DAGS_FOLDER/dbt_airflow_snowflake.py']
2023-11-01 20:15:07,333 INFO - Sending TaskInstanceKey(dag_id='dbt_snowflake_dag', task_id='customers_seed', run_id='manual__2023-11-02T03:15:06.013746+00:00', try_number=1, map_index=-1) to executor with priority 5 and queue default
2023-11-01 20:15:07,333 INFO - Adding to queue: ['airflow', 'tasks', 'run', 'dbt_snowflake_dag', 'customers_seed', 'manual__2023-11-02T03:15:06.013746+00:00', '--local', '--subdir', 'DAGS_FOLDER/dbt_airflow_snowflake.py']
2023-11-01 20:15:07,334 INFO - Executing command: ['airflow', 'tasks', 'run', 'dbt_snowflake_dag', 'bookings_1_seed', 'manual__2023-11-02T03:15:06.013746+00:00', '--local', '--subdir', 'DAGS_FOLDER/dbt_airflow_snowflake.py']
2023-11-01 20:15:16,521 INFO - Executing command: ['airflow', 'tasks', 'run', 'dbt_snowflake_dag', 'bookings_2_seed', 'manual__2023-11-02T03:15:06.013746+00:00', '--local', '--subdir', 'DAGS_FOLDER/dbt_airflow_snowflake.py']
2023-11-01 20:15:25,605 INFO - Executing command: ['airflow', 'tasks', 'run', 'dbt_snowflake_dag', 'customers_seed', 'manual__2023-11-02T03:15:06.013746+00:00', '--local', '--subdir', 'DAGS_FOLDER/dbt_airflow_snowflake.py']
2023-11-01 20:15:34,288 INFO - Executor reports execution of dbt_snowflake_dag.bookings_1_seed run_id=manual__2023-11-02T03:15:06.013746+00:00 exited with status success for try_number 1
2023-11-01 20:15:34,291 INFO - Executor reports execution of dbt_snowflake_dag.bookings_2_seed run_id=manual__2023-11-02T03:15:06.013746+00:00 exited with status success for try_number 1
2023-11-01 20:15:34,291 INFO - Executor reports execution of dbt_snowflake_dag.customers_seed run_id=manual__2023-11-02T03:15:06.013746+00:00 exited with status success for try_number 1
2023-11-01 20:15:34,297 INFO - TaskInstance Finished: dag_id=dbt_snowflake_dag, task_id=bookings_1_seed, run_id=manual__2023-11-02T03:15:06.013746+00:00, map_index=-1, run_start_date=2023-11-02 03:15:13.787407+00:00, run_end_date=2023-11-02 03:15:16.349407+00:00, run_duration=2.562, state=failed, executor_state=success, try_number=1, max_tries=0, job_id=67, pool=default_pool, queue=default, priority_weight=5, operator=DbtSeedLocalOperator, queued_dttm=2023-11-02 03:15:07.331815+00:00, queued_by_job_id=63, pid=98643
2023-11-01 20:15:34,298 INFO - TaskInstance Finished: dag_id=dbt_snowflake_dag, task_id=bookings_2_seed, run_id=manual__2023-11-02T03:15:06.013746+00:00, map_index=-1, run_start_date=2023-11-02 03:15:22.651790+00:00, run_end_date=2023-11-02 03:15:25.428093+00:00, run_duration=2.776303, state=failed, executor_state=success, try_number=1, max_tries=0, job_id=68, pool=default_pool, queue=default, priority_weight=5, operator=DbtSeedLocalOperator, queued_dttm=2023-11-02 03:15:07.331815+00:00, queued_by_job_id=63, pid=98667
2023-11-01 20:15:34,298 INFO - TaskInstance Finished: dag_id=dbt_snowflake_dag, task_id=customers_seed, run_id=manual__2023-11-02T03:15:06.013746+00:00, map_index=-1, run_start_date=2023-11-02 03:15:31.381270+00:00, run_end_date=2023-11-02 03:15:34.098708+00:00, run_duration=2.717438, state=failed, executor_state=success, try_number=1, max_tries=0, job_id=69, pool=default_pool, queue=default, priority_weight=5, operator=DbtSeedLocalOperator, queued_dttm=2023-11-02 03:15:07.331815+00:00, queued_by_job_id=63, pid=98689
2023-11-01 20:15:35,206 ERROR - Marking run <DagRun dbt_snowflake_dag @ 2023-11-02 03:15:06.013746+00:00: manual__2023-11-02T03:15:06.013746+00:00, state:running, queued_at: 2023-11-02 03:15:06.028911+00:00. externally triggered: True> failed
2023-11-01 20:15:35,206 INFO - DagRun Finished: dag_id=dbt_snowflake_dag, execution_date=2023-11-02 03:15:06.013746+00:00, run_id=manual__2023-11-02T03:15:06.013746+00:00, run_start_date=2023-11-02 03:15:07.316594+00:00, run_end_date=2023-11-02 03:15:35.206529+00:00, run_duration=27.889935, state=failed, external_trigger=True, run_type=manual, data_interval_start=2023-11-01 00:00:00+00:00, data_interval_end=2023-11-02 00:00:00+00:00, dag_hash=40aba182c3cf0b0715abb84333c36964
2023-11-01 20:15:35,208 INFO - Setting next_dagrun for dbt_snowflake_dag to 2023-11-02T00:00:00+00:00, run_after=2023-11-03T00:00:00+00:00
2023-11-01 20:16:08,558 INFO - 3 tasks up for execution:
<TaskInstance: dbt_snowflake_dag.bookings_1_seed manual__2023-11-02T03:16:07.664505+00:00 [scheduled]>
<TaskInstance: dbt_snowflake_dag.bookings_2_seed manual__2023-11-02T03:16:07.664505+00:00 [scheduled]>
<TaskInstance: dbt_snowflake_dag.customers_seed manual__2023-11-02T03:16:07.664505+00:00 [scheduled]>
2023-11-01 20:16:08,559 INFO - DAG dbt_snowflake_dag has 0/16 running and queued tasks
2023-11-01 20:16:08,560 INFO - DAG dbt_snowflake_dag has 1/16 running and queued tasks
2023-11-01 20:16:08,560 INFO - DAG dbt_snowflake_dag has 2/16 running and queued tasks
2023-11-01 20:16:08,560 INFO - Setting the following tasks to queued state:
<TaskInstance: dbt_snowflake_dag.bookings_1_seed manual__2023-11-02T03:16:07.664505+00:00 [scheduled]>
<TaskInstance: dbt_snowflake_dag.bookings_2_seed manual__2023-11-02T03:16:07.664505+00:00 [scheduled]>
<TaskInstance: dbt_snowflake_dag.customers_seed manual__2023-11-02T03:16:07.664505+00:00 [scheduled]>
2023-11-01 20:16:08,561 INFO - Sending TaskInstanceKey(dag_id='dbt_snowflake_dag', task_id='bookings_1_seed', run_id='manual__2023-11-02T03:16:07.664505+00:00', try_number=1, map_index=-1) to executor with priority 5 and queue default
2023-11-01 20:16:08,562 INFO - Adding to queue: ['airflow', 'tasks', 'run', 'dbt_snowflake_dag', 'bookings_1_seed', 'manual__2023-11-02T03:16:07.664505+00:00', '--local', '--subdir', 'DAGS_FOLDER/dbt_airflow_snowflake.py']
2023-11-01 20:16:08,562 INFO - Sending TaskInstanceKey(dag_id='dbt_snowflake_dag', task_id='bookings_2_seed', run_id='manual__2023-11-02T03:16:07.664505+00:00', try_number=1, map_index=-1) to executor with priority 5 and queue default
2023-11-01 20:16:08,562 INFO - Adding to queue: ['airflow', 'tasks', 'run', 'dbt_snowflake_dag', 'bookings_2_seed', 'manual__2023-11-02T03:16:07.664505+00:00', '--local', '--subdir', 'DAGS_FOLDER/dbt_airflow_snowflake.py']
2023-11-01 20:16:08,563 INFO - Sending TaskInstanceKey(dag_id='dbt_snowflake_dag', task_id='customers_seed', run_id='manual__2023-11-02T03:16:07.664505+00:00', try_number=1, map_index=-1) to executor with priority 5 and queue default
2023-11-01 20:16:08,563 INFO - Adding to queue: ['airflow', 'tasks', 'run', 'dbt_snowflake_dag', 'customers_seed', 'manual__2023-11-02T03:16:07.664505+00:00', '--local', '--subdir', 'DAGS_FOLDER/dbt_airflow_snowflake.py']
2023-11-01 20:16:08,564 INFO - Executing command: ['airflow', 'tasks', 'run', 'dbt_snowflake_dag', 'bookings_1_seed', 'manual__2023-11-02T03:16:07.664505+00:00', '--local', '--subdir', 'DAGS_FOLDER/dbt_airflow_snowflake.py']
2023-11-01 20:16:17,705 INFO - Executing command: ['airflow', 'tasks', 'run', 'dbt_snowflake_dag', 'bookings_2_seed', 'manual__2023-11-02T03:16:07.664505+00:00', '--local', '--subdir', 'DAGS_FOLDER/dbt_airflow_snowflake.py']
2023-11-01 20:16:26,313 INFO - Executing command: ['airflow', 'tasks', 'run', 'dbt_snowflake_dag', 'customers_seed', 'manual__2023-11-02T03:16:07.664505+00:00', '--local', '--subdir', 'DAGS_FOLDER/dbt_airflow_snowflake.py']
2023-11-01 20:16:35,966 INFO - Executor reports execution of dbt_snowflake_dag.bookings_1_seed run_id=manual__2023-11-02T03:16:07.664505+00:00 exited with status success for try_number 1
2023-11-01 20:16:35,968 INFO - Executor reports execution of dbt_snowflake_dag.bookings_2_seed run_id=manual__2023-11-02T03:16:07.664505+00:00 exited with status success for try_number 1
2023-11-01 20:16:35,968 INFO - Executor reports execution of dbt_snowflake_dag.customers_seed run_id=manual__2023-11-02T03:16:07.664505+00:00 exited with status success for try_number 1
2023-11-01 20:16:35,976 INFO - TaskInstance Finished: dag_id=dbt_snowflake_dag, task_id=bookings_1_seed, run_id=manual__2023-11-02T03:16:07.664505+00:00, map_index=-1, run_start_date=2023-11-02 03:16:14.946739+00:00, run_end_date=2023-11-02 03:16:17.509499+00:00, run_duration=2.56276, state=failed, executor_state=success, try_number=1, max_tries=0, job_id=70, pool=default_pool, queue=default, priority_weight=5, operator=DbtSeedLocalOperator, queued_dttm=2023-11-02 03:16:08.561168+00:00, queued_by_job_id=63, pid=98783
2023-11-01 20:16:35,976 INFO - TaskInstance Finished: dag_id=dbt_snowflake_dag, task_id=bookings_2_seed, run_id=manual__2023-11-02T03:16:07.664505+00:00, map_index=-1, run_start_date=2023-11-02 03:16:23.620058+00:00, run_end_date=2023-11-02 03:16:26.157805+00:00, run_duration=2.537747, state=failed, executor_state=success, try_number=1, max_tries=0, job_id=71, pool=default_pool, queue=default, priority_weight=5, operator=DbtSeedLocalOperator, queued_dttm=2023-11-02 03:16:08.561168+00:00, queued_by_job_id=63, pid=98808
2023-11-01 20:16:35,977 INFO - TaskInstance Finished: dag_id=dbt_snowflake_dag, task_id=customers_seed, run_id=manual__2023-11-02T03:16:07.664505+00:00, map_index=-1, run_start_date=2023-11-02 03:16:32.843476+00:00, run_end_date=2023-11-02 03:16:35.721510+00:00, run_duration=2.878034, state=failed, executor_state=success, try_number=1, max_tries=0, job_id=72, pool=default_pool, queue=default, priority_weight=5, operator=DbtSeedLocalOperator, queued_dttm=2023-11-02 03:16:08.561168+00:00, queued_by_job_id=63, pid=98834
2023-11-01 20:16:42,725 ERROR - Marking run <DagRun dbt_snowflake_dag @ 2023-11-02 03:16:07.664505+00:00: manual__2023-11-02T03:16:07.664505+00:00, state:running, queued_at: 2023-11-02 03:16:07.668663+00:00. externally triggered: True> failed
2023-11-01 20:16:42,726 INFO - DagRun Finished: dag_id=dbt_snowflake_dag, execution_date=2023-11-02 03:16:07.664505+00:00, run_id=manual__2023-11-02T03:16:07.664505+00:00, run_start_date=2023-11-02 03:16:08.549771+00:00, run_end_date=2023-11-02 03:16:42.726461+00:00, run_duration=34.17669, state=failed, external_trigger=True, run_type=manual, data_interval_start=2023-11-01 00:00:00+00:00, data_interval_end=2023-11-02 00:00:00+00:00, dag_hash=40aba182c3cf0b0715abb84333c36964
2023-11-01 20:16:42,728 INFO - Setting next_dagrun for dbt_snowflake_dag to 2023-11-02T00:00:00+00:00, run_after=2023-11-03T00:00:00+00:00
2023-11-01 20:18:34,650 INFO - Resetting orphaned tasks for active dag runs
2023-11-01 20:19:46,223 INFO - 1 tasks up for execution:
<TaskInstance: 1_init_once_seed_data.load_seed_data_once manual__2023-11-02T03:19:44.739006+00:00 [scheduled]>
2023-11-01 20:19:46,224 INFO - DAG 1_init_once_seed_data has 0/16 running and queued tasks
2023-11-01 20:19:46,224 INFO - Setting the following tasks to queued state:
<TaskInstance: 1_init_once_seed_data.load_seed_data_once manual__2023-11-02T03:19:44.739006+00:00 [scheduled]>
2023-11-01 20:19:46,226 INFO - Sending TaskInstanceKey(dag_id='1_init_once_seed_data', task_id='load_seed_data_once', run_id='manual__2023-11-02T03:19:44.739006+00:00', try_number=1, map_index=-1) to executor with priority 1 and queue default
2023-11-01 20:19:46,226 INFO - Adding to queue: ['airflow', 'tasks', 'run', '1_init_once_seed_data', 'load_seed_data_once', 'manual__2023-11-02T03:19:44.739006+00:00', '--local', '--subdir', 'DAGS_FOLDER/__pycache__/init.py']
2023-11-01 20:19:46,227 INFO - Executing command: ['airflow', 'tasks', 'run', '1_init_once_seed_data', 'load_seed_data_once', 'manual__2023-11-02T03:19:44.739006+00:00', '--local', '--subdir', 'DAGS_FOLDER/__pycache__/init.py']
2023-11-01 20:19:47,359 INFO - Executor reports execution of 1_init_once_seed_data.load_seed_data_once run_id=manual__2023-11-02T03:19:44.739006+00:00 exited with status success for try_number 1
2023-11-01 20:19:47,363 INFO - TaskInstance Finished: dag_id=1_init_once_seed_data, task_id=load_seed_data_once, run_id=manual__2023-11-02T03:19:44.739006+00:00, map_index=-1, run_start_date=2023-11-02 03:19:47.104671+00:00, run_end_date=2023-11-02 03:19:47.157151+00:00, run_duration=0.05248, state=failed, executor_state=success, try_number=1, max_tries=0, job_id=73, pool=default_pool, queue=default, priority_weight=1, operator=BashOperator, queued_dttm=2023-11-02 03:19:46.225340+00:00, queued_by_job_id=63, pid=99252
2023-11-01 20:19:48,410 ERROR - Marking run <DagRun 1_init_once_seed_data @ 2023-11-02 03:19:44.739006+00:00: manual__2023-11-02T03:19:44.739006+00:00, state:running, queued_at: 2023-11-02 03:19:44.758509+00:00. externally triggered: True> failed
2023-11-01 20:19:48,411 INFO - DagRun Finished: dag_id=1_init_once_seed_data, execution_date=2023-11-02 03:19:44.739006+00:00, run_id=manual__2023-11-02T03:19:44.739006+00:00, run_start_date=2023-11-02 03:19:46.210963+00:00, run_end_date=2023-11-02 03:19:48.411131+00:00, run_duration=2.200168, state=failed, external_trigger=True, run_type=manual, data_interval_start=2023-11-02 03:19:44.739006+00:00, data_interval_end=2023-11-02 03:19:44.739006+00:00, dag_hash=f7a206f5bf194ade9272ef5dfad3d161
2023-11-01 20:19:48,412 INFO - Setting next_dagrun for 1_init_once_seed_data to None, run_after=None
2023-11-01 20:23:34,685 INFO - Resetting orphaned tasks for active dag runs
2023-11-01 20:26:15,920 INFO - 3 tasks up for execution:
<TaskInstance: dbt_snowflake_dag.bookings_1_seed manual__2023-11-02T03:26:07.079285+00:00 [scheduled]>
<TaskInstance: dbt_snowflake_dag.bookings_2_seed manual__2023-11-02T03:26:07.079285+00:00 [scheduled]>
<TaskInstance: dbt_snowflake_dag.customers_seed manual__2023-11-02T03:26:07.079285+00:00 [scheduled]>
2023-11-01 20:26:15,921 INFO - DAG dbt_snowflake_dag has 0/16 running and queued tasks
2023-11-01 20:26:15,922 INFO - DAG dbt_snowflake_dag has 1/16 running and queued tasks
2023-11-01 20:26:15,922 INFO - DAG dbt_snowflake_dag has 2/16 running and queued tasks
2023-11-01 20:26:15,922 INFO - Setting the following tasks to queued state:
<TaskInstance: dbt_snowflake_dag.bookings_1_seed manual__2023-11-02T03:26:07.079285+00:00 [scheduled]>
<TaskInstance: dbt_snowflake_dag.bookings_2_seed manual__2023-11-02T03:26:07.079285+00:00 [scheduled]>
<TaskInstance: dbt_snowflake_dag.customers_seed manual__2023-11-02T03:26:07.079285+00:00 [scheduled]>
2023-11-01 20:26:15,923 INFO - Sending TaskInstanceKey(dag_id='dbt_snowflake_dag', task_id='bookings_1_seed', run_id='manual__2023-11-02T03:26:07.079285+00:00', try_number=1, map_index=-1) to executor with priority 5 and queue default
2023-11-01 20:26:15,924 INFO - Adding to queue: ['airflow', 'tasks', 'run', 'dbt_snowflake_dag', 'bookings_1_seed', 'manual__2023-11-02T03:26:07.079285+00:00', '--local', '--subdir', 'DAGS_FOLDER/dbt_airflow_snowflake.py']
2023-11-01 20:26:15,924 INFO - Sending TaskInstanceKey(dag_id='dbt_snowflake_dag', task_id='bookings_2_seed', run_id='manual__2023-11-02T03:26:07.079285+00:00', try_number=1, map_index=-1) to executor with priority 5 and queue default
2023-11-01 20:26:15,924 INFO - Adding to queue: ['airflow', 'tasks', 'run', 'dbt_snowflake_dag', 'bookings_2_seed', 'manual__2023-11-02T03:26:07.079285+00:00', '--local', '--subdir', 'DAGS_FOLDER/dbt_airflow_snowflake.py']
2023-11-01 20:26:15,925 INFO - Sending TaskInstanceKey(dag_id='dbt_snowflake_dag', task_id='customers_seed', run_id='manual__2023-11-02T03:26:07.079285+00:00', try_number=1, map_index=-1) to executor with priority 5 and queue default
2023-11-01 20:26:15,925 INFO - Adding to queue: ['airflow', 'tasks', 'run', 'dbt_snowflake_dag', 'customers_seed', 'manual__2023-11-02T03:26:07.079285+00:00', '--local', '--subdir', 'DAGS_FOLDER/dbt_airflow_snowflake.py']
2023-11-01 20:26:15,926 INFO - Executing command: ['airflow', 'tasks', 'run', 'dbt_snowflake_dag', 'bookings_1_seed', 'manual__2023-11-02T03:26:07.079285+00:00', '--local', '--subdir', 'DAGS_FOLDER/dbt_airflow_snowflake.py']
2023-11-01 20:26:22,868 ERROR - Failed to execute task Command '['airflow', 'tasks', 'run', 'dbt_snowflake_dag', 'bookings_1_seed', 'manual__2023-11-02T03:26:07.079285+00:00', '--local', '--subdir', 'DAGS_FOLDER/dbt_airflow_snowflake.py']' returned non-zero exit status 1..
2023-11-01 20:26:22,869 INFO - Executing command: ['airflow', 'tasks', 'run', 'dbt_snowflake_dag', 'bookings_2_seed', 'manual__2023-11-02T03:26:07.079285+00:00', '--local', '--subdir', 'DAGS_FOLDER/dbt_airflow_snowflake.py']
2023-11-01 20:26:27,805 ERROR - Failed to execute task Command '['airflow', 'tasks', 'run', 'dbt_snowflake_dag', 'bookings_2_seed', 'manual__2023-11-02T03:26:07.079285+00:00', '--local', '--subdir', 'DAGS_FOLDER/dbt_airflow_snowflake.py']' returned non-zero exit status 1..
2023-11-01 20:26:27,805 INFO - Executing command: ['airflow', 'tasks', 'run', 'dbt_snowflake_dag', 'customers_seed', 'manual__2023-11-02T03:26:07.079285+00:00', '--local', '--subdir', 'DAGS_FOLDER/dbt_airflow_snowflake.py']
2023-11-01 20:26:32,274 ERROR - Failed to execute task Command '['airflow', 'tasks', 'run', 'dbt_snowflake_dag', 'customers_seed', 'manual__2023-11-02T03:26:07.079285+00:00', '--local', '--subdir', 'DAGS_FOLDER/dbt_airflow_snowflake.py']' returned non-zero exit status 1..
2023-11-01 20:26:32,277 INFO - Executor reports execution of dbt_snowflake_dag.bookings_1_seed run_id=manual__2023-11-02T03:26:07.079285+00:00 exited with status failed for try_number 1
2023-11-01 20:26:32,277 INFO - Executor reports execution of dbt_snowflake_dag.bookings_2_seed run_id=manual__2023-11-02T03:26:07.079285+00:00 exited with status failed for try_number 1
2023-11-01 20:26:32,277 INFO - Executor reports execution of dbt_snowflake_dag.customers_seed run_id=manual__2023-11-02T03:26:07.079285+00:00 exited with status failed for try_number 1
2023-11-01 20:26:32,286 INFO - TaskInstance Finished: dag_id=dbt_snowflake_dag, task_id=bookings_1_seed, run_id=manual__2023-11-02T03:26:07.079285+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=0, job_id=None, pool=default_pool, queue=default, priority_weight=5, operator=DbtSeedLocalOperator, queued_dttm=2023-11-02 03:26:15.923137+00:00, queued_by_job_id=63, pid=None
2023-11-01 20:26:32,287 ERROR - Executor reports task instance <TaskInstance: dbt_snowflake_dag.bookings_1_seed manual__2023-11-02T03:26:07.079285+00:00 [queued]> finished (failed) although the task says its queued. (Info: None) Was the task killed externally?
2023-11-01 20:26:32,288 ERROR - Executor reports task instance <TaskInstance: dbt_snowflake_dag.bookings_1_seed manual__2023-11-02T03:26:07.079285+00:00 [queued]> finished (failed) although the task says its queued. (Info: None) Was the task killed externally?
2023-11-01 20:26:32,306 INFO - Marking task as FAILED. dag_id=dbt_snowflake_dag, task_id=bookings_1_seed, execution_date=20231102T032607, start_date=, end_date=20231102T032632
2023-11-01 20:26:32,317 INFO - TaskInstance Finished: dag_id=dbt_snowflake_dag, task_id=bookings_2_seed, run_id=manual__2023-11-02T03:26:07.079285+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=0, job_id=None, pool=default_pool, queue=default, priority_weight=5, operator=DbtSeedLocalOperator, queued_dttm=2023-11-02 03:26:15.923137+00:00, queued_by_job_id=63, pid=None
2023-11-01 20:26:32,317 ERROR - Executor reports task instance <TaskInstance: dbt_snowflake_dag.bookings_2_seed manual__2023-11-02T03:26:07.079285+00:00 [queued]> finished (failed) although the task says its queued. (Info: None) Was the task killed externally?
2023-11-01 20:26:32,319 ERROR - Executor reports task instance <TaskInstance: dbt_snowflake_dag.bookings_2_seed manual__2023-11-02T03:26:07.079285+00:00 [queued]> finished (failed) although the task says its queued. (Info: None) Was the task killed externally?
2023-11-01 20:26:32,322 INFO - Marking task as FAILED. dag_id=dbt_snowflake_dag, task_id=bookings_2_seed, execution_date=20231102T032607, start_date=, end_date=20231102T032632
2023-11-01 20:26:32,324 INFO - TaskInstance Finished: dag_id=dbt_snowflake_dag, task_id=customers_seed, run_id=manual__2023-11-02T03:26:07.079285+00:00, map_index=-1, run_start_date=None, run_end_date=None, run_duration=None, state=queued, executor_state=failed, try_number=1, max_tries=0, job_id=None, pool=default_pool, queue=default, priority_weight=5, operator=DbtSeedLocalOperator, queued_dttm=2023-11-02 03:26:15.923137+00:00, queued_by_job_id=63, pid=None
2023-11-01 20:26:32,324 ERROR - Executor reports task instance <TaskInstance: dbt_snowflake_dag.customers_seed manual__2023-11-02T03:26:07.079285+00:00 [queued]> finished (failed) although the task says its queued. (Info: None) Was the task killed externally?
2023-11-01 20:26:32,325 ERROR - Executor reports task instance <TaskInstance: dbt_snowflake_dag.customers_seed manual__2023-11-02T03:26:07.079285+00:00 [queued]> finished (failed) although the task says its queued. (Info: None) Was the task killed externally?