Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Making RTree Serializable #62

Open
rahulmidha31 opened this issue Nov 2, 2016 · 5 comments
Open

Making RTree Serializable #62

rahulmidha31 opened this issue Nov 2, 2016 · 5 comments
Labels

Comments

@rahulmidha31
Copy link

Hi,

I was trying to integrate this in Spark for one of my use cases. However, post constructing the RTree object I wanted to broadcast it to the executors, but failed since the RTree object was not serializable.

Work around: Initialized it once per executor, but still it would be great if we could simply mark it serializable.

@davidmoten
Copy link
Owner

Serialization is supported and is discussed in the README.md.

On Thu, 3 Nov 2016, 02:13 rahulmidha31 [email protected] wrote:

Hi,

I was trying to integrate this in Spark for one of my use cases. However,
post constructing the RTree object I wanted to broadcast it to the
executors, but failed since the RTree object was not serializable.

Work around: Initialized it once per executor, but still it would be great
if we could simply mark it serializable.


You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub
#62, or mute the thread
https://github.com/notifications/unsubscribe-auth/AATa69zGcGIIMKT2LSxFeE687t6MP5_iks5q6KfXgaJpZM4KnWlm
.

@rahulmidha31
Copy link
Author

Thanks David, though i was talking about the default java serialization but found a way to make it work with Spark. Thanks..

@netanel246
Copy link

Hi,
Can you please describe how did you solve it?
Thanks.

@rahulmidha31
Copy link
Author

Hi,

For spark, I just added a property for using the default serializer as Kryo.

Property : spark.serializer=org.apache.spark.serializer.KryoSerializer

@q127981
Copy link

q127981 commented Dec 3, 2020

Hi,

For spark, I just added a property for using the default serializer as Kryo.

Property : spark.serializer=org.apache.spark.serializer.KryoSerializer

Hello, may I ask, I also want to use it in spark. But I added custom geometry, how can I serialize it?In addition to adding attributes, what else to do? thank you! @rahulmidha31
image
image

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

4 participants