Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Icetindil/fuzzy join merge master #2

Open
wants to merge 51 commits into
base: master
Choose a base branch
from
Open
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
51 commits
Select commit Hold shift + click to select a range
a282293
changing PushAssignDownThroughProductRule to PushAssignDownThroughJoi…
icetindil Aug 30, 2013
bb6ccbd
fix for issue #624
icetindil Aug 30, 2013
da6913e
Merge branch 'master' of https://code.google.com/p/hyracks into iceti…
icetindil Sep 11, 2013
6f2ea43
Merge branch 'master' of https://code.google.com/p/hyracks into iceti…
icetindil Sep 13, 2013
3c63c91
Merge branch 'master' of https://code.google.com/p/hyracks into iceti…
icetindil Sep 17, 2013
98ae61e
Merge branch 'master' of https://code.google.com/p/hyracks into iceti…
icetindil Sep 26, 2013
0579dd8
Merge branch 'master' of https://code.google.com/p/hyracks into iceti…
icetindil Oct 4, 2013
c0a9fac
Merge branch 'master' of https://code.google.com/p/hyracks into iceti…
icetindil Oct 11, 2013
3b61180
Merge branch 'master' of https://code.google.com/p/hyracks into iceti…
icetindil Oct 25, 2013
b1cf65d
fixing primary key bug
icetindil Dec 3, 2013
b989097
Merge branch 'master' of https://code.google.com/p/hyracks into iceti…
icetindil Dec 3, 2013
9c585af
Merge branch 'master' of https://code.google.com/p/hyracks into iceti…
icetindil Jan 29, 2014
3833d74
fixing a bug in unnest to product rule
icetindil Mar 10, 2014
f7bf0c6
Merge branch 'master' of https://code.google.com/p/hyracks into iceti…
icetindil May 7, 2014
25cc392
Merge branch 'master' of https://code.google.com/p/hyracks into iceti…
icetindil Jun 22, 2014
e98e68f
modifying replicate operator to materialize dependent outputs
icetindil Jun 24, 2014
b14a4dc
fixing a bug on computing live variables for unnestmap operator
icetindil Jun 24, 2014
c71ef28
- added support to find shared plans containing operators with multip…
icetindil Jun 26, 2014
e6b1c1a
Merge branch 'master' of https://code.google.com/p/hyracks into iceti…
icetindil Jun 26, 2014
340761c
Merge branch 'master' of https://code.google.com/p/hyracks into iceti…
icetindil Jun 27, 2014
4e31118
Merge branch 'master' of https://code.google.com/p/hyracks into iceti…
icetindil Jun 29, 2014
e587810
fixed issue union operator was causing in dependency analysis
icetindil Jul 1, 2014
b8233e8
Merge branch 'master' of https://code.google.com/p/hyracks into iceti…
icetindil Jul 3, 2014
b661556
in HHJ handle the case when it spills and skipInMemoryHJ is set to fa…
icetindil Jul 11, 2014
f9523bb
Merge branch 'master' of https://code.google.com/p/hyracks into iceti…
icetindil Jul 11, 2014
b91599f
Merge branch 'icetindil/join_fix' into icetindil/fuzzy_join
icetindil Jul 11, 2014
41c672b
Merge branch 'master' of https://code.google.com/p/hyracks into iceti…
icetindil Jul 11, 2014
ba17aef
Merge branch 'icetindil/materialization' into icetindil/fuzzy_join
icetindil Jul 12, 2014
c3ac8c7
Merge branch 'master' of https://code.google.com/p/hyracks into iceti…
icetindil Jul 13, 2014
7696faf
Merge branch 'master' of https://code.google.com/p/hyracks into iceti…
icetindil Jul 16, 2014
c450d1d
Merge branch 'master' of https://code.google.com/p/hyracks into iceti…
icetindil Jul 17, 2014
75ccdb9
Merge branch 'master' of https://code.google.com/p/hyracks into iceti…
icetindil Jul 18, 2014
bb51fa1
move dependency labeling from logical to physical
icetindil Jul 18, 2014
efee860
added a new method expensiveThanMaterialization() to logical operator…
icetindil Jul 18, 2014
cb0051b
Merge branch 'master' of https://code.google.com/p/hyracks into iceti…
icetindil Jul 18, 2014
b3b5651
Merge branch 'master' of https://code.google.com/p/hyracks into iceti…
icetindil Aug 6, 2014
0ca54b8
Merge branch 'master' of https://code.google.com/p/hyracks into iceti…
icetindil Aug 6, 2014
0d1e14d
addressing Yingyi's code review comments
icetindil Aug 6, 2014
b61dee6
fixed issue 794
icetindil Aug 7, 2014
6f67514
Merge branch 'icetindil/materialization' into icetindil/fuzzy_join
icetindil Aug 7, 2014
ded9af7
fixed NPE for piglet examples
icetindil Aug 8, 2014
a52b28f
Merge branch 'icetindil/issue794' into icetindil/fuzzy_join
icetindil Aug 8, 2014
d822891
Merge branch 'master' of https://code.google.com/p/hyracks into iceti…
icetindil Aug 8, 2014
3122fa1
Merge branch 'master' of https://code.google.com/p/hyracks into iceti…
icetindil Nov 4, 2014
293f059
Merge branch 'master' of https://code.google.com/p/hyracks into iceti…
icetindil Dec 26, 2014
a8fa0b2
merge master into icetindil/fuzzy_join
icetindil Apr 25, 2015
79c77e1
Merge commit '4db4f57e9204576eb2d26a419712574bd20448ee' into icetindi…
parshimers Oct 19, 2015
16daeca
Merge commit '9939b48ecc4623145383e847cc6adbd4b800c609' into icetindi…
parshimers Oct 19, 2015
6da364c
Merge commit 'e915e8c' into icetindil/fuzzy_join_merge_master
parshimers Oct 19, 2015
0e868b5
Rename rule
parshimers Oct 19, 2015
e8c4ccf
Merge branch 'master' into icetindil/fuzzy_join_merge_master
parshimers Oct 19, 2015
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Original file line number Diff line number Diff line change
Expand Up @@ -295,9 +295,11 @@ protected Set<LogicalVariable> computeGbyVars(AbstractLogicalOperator op, Set<Lo
List<LogicalVariable> all = new ArrayList<LogicalVariable>();
VariableUtilities.getLiveVariables(op, all);
all.retainAll(freeVars);
for (FunctionalDependency fd : fdList) {
if (fd.getTail().containsAll(all)) {
return new HashSet<LogicalVariable>(fd.getHead());
if (!all.isEmpty()) {
for (FunctionalDependency fd : fdList) {
if (fd.getTail().containsAll(all)) {
return new HashSet<LogicalVariable>(fd.getHead());
}
}
}
return null;
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -34,7 +34,7 @@
import org.apache.hyracks.algebricks.core.algebra.operators.logical.visitors.VariableUtilities;
import org.apache.hyracks.algebricks.core.rewriter.base.IAlgebraicRewriteRule;

public class PushAssignDownThroughProductRule implements IAlgebraicRewriteRule {
public class PushAssignDownThroughJoinRule implements IAlgebraicRewriteRule {

@Override
public boolean rewritePre(Mutable<ILogicalOperator> opRef, IOptimizationContext context) throws AlgebricksException {
Expand All @@ -53,10 +53,10 @@ public boolean rewritePost(Mutable<ILogicalOperator> opRef, IOptimizationContext
if (op2.getOperatorTag() != LogicalOperatorTag.INNERJOIN) {
return false;
}
AbstractBinaryJoinOperator join = (AbstractBinaryJoinOperator) op2;
if (join.getCondition().getValue() != ConstantExpression.TRUE) {
return false;
}
// AbstractBinaryJoinOperator join = (AbstractBinaryJoinOperator) op2;
// if (join.getCondition().getValue() != ConstantExpression.TRUE) {
// return false;
// }

List<LogicalVariable> used = new ArrayList<LogicalVariable>();
VariableUtilities.getUsedVariables(op1, used);
Expand Down