Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat(tree): add multiprocessing tree data loader #1041

Merged
merged 10 commits into from
Aug 29, 2022

Conversation

Lemon-412
Copy link
Contributor

No description provided.

qinminhao and others added 6 commits August 24, 2022 13:57
* fix(tree): fix multiprocessing start method

* chore(tree): multiprocessing reusing parameter `num_parallel`

* style(tree): rename num_data_loaders to num_parallel

Co-authored-by: qinminhao <[email protected]>
@hangweiqiang-uestc
Copy link
Contributor

LGTM

@lixiaoguang01
Copy link
Contributor

LGTM

@chong1144 chong1144 merged commit 7463a12 into bytedance:master Aug 29, 2022
Lemon-412 added a commit to Lemon-412/fedlearner that referenced this pull request Aug 30, 2022
* feat(tree): add multiprocessing dataloader

* fix(tree): fix lint

* fix(tree): fix multiprocessing start method (bytedance#1040)

* fix(tree): fix multiprocessing start method

* chore(tree): multiprocessing reusing parameter `num_parallel`

* style(tree): rename num_data_loaders to num_parallel

Co-authored-by: qinminhao <[email protected]>

* test(tree): multiprocessing tree model test.sh

* style(tree): code clean

* style(tree): fix code lint(logging-not-lazy)

* test(tree): move unittest to rest_trainer.py

* docs(tree): more comments

* fix(tree): fix code lint

* style(tree): make parameter num_paralle optimal

Co-authored-by: qinminhao <[email protected]>
chong1144 pushed a commit that referenced this pull request Aug 30, 2022
* feat(tree): add multiprocessing dataloader

* fix(tree): fix lint

* fix(tree): fix multiprocessing start method (#1040)

* fix(tree): fix multiprocessing start method

* chore(tree): multiprocessing reusing parameter `num_parallel`

* style(tree): rename num_data_loaders to num_parallel

Co-authored-by: qinminhao <[email protected]>

* test(tree): multiprocessing tree model test.sh

* style(tree): code clean

* style(tree): fix code lint(logging-not-lazy)

* test(tree): move unittest to rest_trainer.py

* docs(tree): more comments

* fix(tree): fix code lint

* style(tree): make parameter num_paralle optimal

Co-authored-by: qinminhao <[email protected]>

Co-authored-by: qinminhao <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants