Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

How to serialize all geometry? #108

Open
q127981 opened this issue Dec 3, 2020 · 1 comment
Open

How to serialize all geometry? #108

q127981 opened this issue Dec 3, 2020 · 1 comment
Labels

Comments

@q127981
Copy link

q127981 commented Dec 3, 2020

如何序列化所有几何?
我添加了自定义的几何图形,希望在spark程序中应用。由于目前不支持自定义几何的序列化,或者说我不知道如何使用FlatBuffers支持序列化我添加的class。导致目前每个spark程序的实例都需要重新构建一次rtree,这样效率很低。我尝试设置Property : spark.serializer=org.apache.spark.serializer.KryoSerializer 修改默认的序列化方式,但是没有作用,甚至很久都没有完成rtree的构建。有没有一种序列化方式,可以不受限制,任意添加自定义几何,且能够完成快速重建rtree?或者我应该怎样使FlatBuffers支持序列化我添加的class?
hi:
I added a custom geometric figure, hoping to apply it in the spark program. Since the serialization of custom geometries is currently not supported, or I don't know how to use FlatBuffers to support serialization of the classes I added. As a result, each instance of the spark program needs to rebuild the rtree, which is very inefficient. I tried to set Property: spark.serializer=org.apache.spark.serializer.KryoSerializer to modify the default serialization method, but it didn't work, and it didn't even complete the construction of rtree for a long time. Is there a serialization method that can add custom geometry without limitation, and can quickly rebuild the rtree?Or how should I make FlatBuffers support serialization of the class I added?

thank you!
image
image
image
image

@davidmoten
Copy link
Owner

Hi, I don't have a quick answer for you on this I'm afraid. Happy to consider suggestions.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

2 participants