Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add a unit test using a dataset with a field order different than in … #247

Open
wants to merge 2 commits into
base: master
Choose a base branch
from

Conversation

sbarnoud
Copy link

…the Avro schema

What changes were proposed in this pull request?

Added unit test to expose Avro field order problem

How was this patch tested?

NA

sbarnoud pushed a commit to sbarnoud/shc that referenced this pull request Apr 19, 2018
I don't understand why using the row.toSeq.iterator fails in my environment
I added the Unit test hortonworks-spark#247 showing that the problem doesn't exists in Travis
See https://travis-ci.org/hortonworks-spark/shc/builds/368556158 => the Unit test fails without the patch, and succeed with.
But stills fails in my environment ...
@sbarnoud
Copy link
Author

sbarnoud commented Apr 19, 2018

This test willingly fails to show that Avro serialization depends on field order in the dataset, which in my opinion is not the expexted bahavior.

I propose in #248 a patch for that problem

@sbarnoud
Copy link
Author

May i have a feedback? Travis failed, but this is normal, the test is just intended for that, and a PR propose a fix.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant