[SPARK-25299][LIVE-DIFF] Use remote storage for persisting shuffle data#7

Open

ifilonenko wants to merge 18 commits intoupstream-masterfrom

spark-25299-live-diff

Commits on Apr 4, 2019

Commits on Apr 7, 2019

Set the task context in writer benchmarks (#529)

mccheah
authored and
ifilonenko
committed

Commits on Apr 17, 2019

[SPARK-25299] Use the shuffle writer plugin for the SortShuffleWriter. (#532)

mccheah
authored and
ifilonenko
committed
[SPARK-25299] Make UnsafeShuffleWriter use the new API (#536)

mccheah
authored and
ifilonenko
committed

Commits on Apr 22, 2019

[SPARK-25299] Shuffle locations api (#517)

mccheah
authored and
ifilonenko
committed
[SPARK-25299] Move shuffle writers back to being given specific partition ids (#540)

mccheah
authored and
ifilonenko
committed
[SPARK-25299] Don't set map status twice in bypass merge sort shuffle writer (#541)

mccheah
authored and
ifilonenko
committed

Commits on May 9, 2019

merge conflicts

yifeih
authored and
ifilonenko
committed
[SPARK-25299] fix reader benchmarks (#544)

yifeih
authored and
ifilonenko
committed
merge conflicts

yifeih
authored and
ifilonenko
committed

Commits on Jun 7, 2019