-
Notifications
You must be signed in to change notification settings - Fork 25
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
add multiprocessing #92
base: developer
Are you sure you want to change the base?
Commits on Apr 18, 2024
-
qgh533 committed
Apr 18, 2024 Configuration menu - View commit details
-
Copy full SHA for 0e2242e - Browse repository at this point
Copy the full SHA 0e2242eView commit details -
Configuration menu - View commit details
-
Copy full SHA for 2add9b9 - Browse repository at this point
Copy the full SHA 2add9b9View commit details
Commits on Apr 19, 2024
-
Configuration menu - View commit details
-
Copy full SHA for f645ea4 - Browse repository at this point
Copy the full SHA f645ea4View commit details -
Configuration menu - View commit details
-
Copy full SHA for f471704 - Browse repository at this point
Copy the full SHA f471704View commit details -
Configuration menu - View commit details
-
Copy full SHA for 85c28e5 - Browse repository at this point
Copy the full SHA 85c28e5View commit details -
Configuration menu - View commit details
-
Copy full SHA for 6330e92 - Browse repository at this point
Copy the full SHA 6330e92View commit details -
Configuration menu - View commit details
-
Copy full SHA for bbe1b4e - Browse repository at this point
Copy the full SHA bbe1b4eView commit details
Commits on Apr 22, 2024
-
🔥 clean-up duplicated src/move files (pkg was in main folder)
Henry Webel committedApr 22, 2024 Configuration menu - View commit details
-
Copy full SHA for 820c554 - Browse repository at this point
Copy the full SHA 820c554View commit details
Commits on Apr 23, 2024
-
✨ add identify_associations_multiprocess to src/move/tasks
- use pip install to make it available -minor adaptions to original scritp w.r.t. to imputs
Henry Webel committedApr 23, 2024 Configuration menu - View commit details
-
Copy full SHA for ce9a9dc - Browse repository at this point
Copy the full SHA ce9a9dcView commit details -
🐛 make mutliprocessing not stale: assign # of threads for each process
Henry Webel committedApr 23, 2024 Configuration menu - View commit details
-
Copy full SHA for 5327223 - Browse repository at this point
Copy the full SHA 5327223View commit details -
Configuration menu - View commit details
-
Copy full SHA for eaa858a - Browse repository at this point
Copy the full SHA eaa858aView commit details -
Updated identify_associations_multiprocess.py
qgh533 committedApr 23, 2024 Configuration menu - View commit details
-
Copy full SHA for 5ab5e59 - Browse repository at this point
Copy the full SHA 5ab5e59View commit details -
Update config files for small tries
qgh533 committedApr 23, 2024 Configuration menu - View commit details
-
Copy full SHA for 33f565a - Browse repository at this point
Copy the full SHA 33f565aView commit details
Commits on Apr 24, 2024
-
Multiprocessing for analyze_latent
qgh533 committedApr 24, 2024 Configuration menu - View commit details
-
Copy full SHA for 63f128b - Browse repository at this point
Copy the full SHA 63f128bView commit details -
Analyze latent multiprocessing
qgh533 committedApr 24, 2024 Configuration menu - View commit details
-
Copy full SHA for ca389d2 - Browse repository at this point
Copy the full SHA ca389d2View commit details -
Analyze latent multiprocessing
qgh533 committedApr 24, 2024 Configuration menu - View commit details
-
Copy full SHA for e08a94b - Browse repository at this point
Copy the full SHA e08a94bView commit details
Commits on Apr 25, 2024
-
qgh533 committed
Apr 25, 2024 Configuration menu - View commit details
-
Copy full SHA for e94ef90 - Browse repository at this point
Copy the full SHA e94ef90View commit details
Commits on Apr 26, 2024
-
Fix analyze_latent_multiprocessing
qgh533 committedApr 26, 2024 Configuration menu - View commit details
-
Copy full SHA for f4f0aa3 - Browse repository at this point
Copy the full SHA f4f0aa3View commit details
Commits on May 11, 2024
-
qgh533 committed
May 11, 2024 Configuration menu - View commit details
-
Copy full SHA for 6a0b665 - Browse repository at this point
Copy the full SHA 6a0b665View commit details -
Delete files and fix multiloop
qgh533 committedMay 11, 2024 Configuration menu - View commit details
-
Copy full SHA for a5310a6 - Browse repository at this point
Copy the full SHA a5310a6View commit details
Commits on May 21, 2024
-
Clean identify_association_multiprocess.py
qgh533 committedMay 21, 2024 Configuration menu - View commit details
-
Copy full SHA for e67bb75 - Browse repository at this point
Copy the full SHA e67bb75View commit details -
Clean analyze_latent multiprocessing.py
qgh533 committedMay 21, 2024 Configuration menu - View commit details
-
Copy full SHA for 86bfed5 - Browse repository at this point
Copy the full SHA 86bfed5View commit details
Commits on Jun 7, 2024
-
Configuration menu - View commit details
-
Copy full SHA for f9d4961 - Browse repository at this point
Copy the full SHA f9d4961View commit details
Commits on Jun 10, 2024
-
Configuration menu - View commit details
-
Copy full SHA for c2c49e8 - Browse repository at this point
Copy the full SHA c2c49e8View commit details
Commits on Jun 13, 2024
-
Configuration menu - View commit details
-
Copy full SHA for 0a4bcae - Browse repository at this point
Copy the full SHA 0a4bcaeView commit details -
Configuration menu - View commit details
-
Copy full SHA for ce20dac - Browse repository at this point
Copy the full SHA ce20dacView commit details -
Configuration menu - View commit details
-
Copy full SHA for 4a72842 - Browse repository at this point
Copy the full SHA 4a72842View commit details -
Configuration menu - View commit details
-
Copy full SHA for f537d21 - Browse repository at this point
Copy the full SHA f537d21View commit details -
Configuration menu - View commit details
-
Copy full SHA for 568aaa8 - Browse repository at this point
Copy the full SHA 568aaa8View commit details -
Configuration menu - View commit details
-
Copy full SHA for ede3707 - Browse repository at this point
Copy the full SHA ede3707View commit details -
Configuration menu - View commit details
-
Copy full SHA for 5df8a01 - Browse repository at this point
Copy the full SHA 5df8a01View commit details -
Configuration menu - View commit details
-
Copy full SHA for 52c37fd - Browse repository at this point
Copy the full SHA 52c37fdView commit details
Commits on Jun 18, 2024
-
Henry committed
Jun 18, 2024 Configuration menu - View commit details
-
Copy full SHA for 2e29f23 - Browse repository at this point
Copy the full SHA 2e29f23View commit details -
Merge branch 'main' into LFT18-main
Henry committedJun 18, 2024 Configuration menu - View commit details
-
Copy full SHA for 13678cb - Browse repository at this point
Copy the full SHA 13678cbView commit details -
Merge branch 'developer' into LFT18-main
Henry committedJun 18, 2024 Configuration menu - View commit details
-
Copy full SHA for f92a862 - Browse repository at this point
Copy the full SHA f92a862View commit details
Commits on Jun 20, 2024
-
🎨 add trigger of actions from PR
Henry committedJun 20, 2024 Configuration menu - View commit details
-
Copy full SHA for b7824f7 - Browse repository at this point
Copy the full SHA b7824f7View commit details -
Henry committed
Jun 20, 2024 Configuration menu - View commit details
-
Copy full SHA for e5253a2 - Browse repository at this point
Copy the full SHA e5253a2View commit details -
🔥 remove duplicated code and intermediate scripts
Henry committedJun 20, 2024 Configuration menu - View commit details
-
Copy full SHA for d4118a3 - Browse repository at this point
Copy the full SHA d4118a3View commit details
Commits on Jun 21, 2024
-
Merge branch 'developer' into LFT18-main
Henry committedJun 21, 2024 Configuration menu - View commit details
-
Copy full SHA for 3e19e24 - Browse repository at this point
Copy the full SHA 3e19e24View commit details
Commits on Jun 24, 2024
-
Configuration menu - View commit details
-
Copy full SHA for dbc0238 - Browse repository at this point
Copy the full SHA dbc0238View commit details -
Henry committed
Jun 24, 2024 Configuration menu - View commit details
-
Copy full SHA for 80352e6 - Browse repository at this point
Copy the full SHA 80352e6View commit details
Commits on Jul 3, 2024
-
⏪ add configuration files back in from developer branch
Henry committedJul 3, 2024 Configuration menu - View commit details
-
Copy full SHA for 488b4a4 - Browse repository at this point
Copy the full SHA 488b4a4View commit details -
Henry committed
Jul 3, 2024 Configuration menu - View commit details
-
Copy full SHA for 9b3a27e - Browse repository at this point
Copy the full SHA 9b3a27eView commit details -
🚧 see if this advances CI to the next step
Henry committedJul 3, 2024 Configuration menu - View commit details
-
Copy full SHA for 05d4c34 - Browse repository at this point
Copy the full SHA 05d4c34View commit details -
🔥 remove intermediate files of development
- saved in separate branch for archiving: https://github.com/LFT18/multiprocessing_bayes_MOVE/tree/archiv_intermediate_exp
Henry committedJul 3, 2024 Configuration menu - View commit details
-
Copy full SHA for ebb72ad - Browse repository at this point
Copy the full SHA ebb72adView commit details -
🚧 multiprocess only defined for bayes factors
Henry committedJul 3, 2024 Configuration menu - View commit details
-
Copy full SHA for efbfd5c - Browse repository at this point
Copy the full SHA efbfd5cView commit details -
🐛 remove non-existing, intermediate tasks (used for developing), no m…
…ultiprocessing for t-tests - document that t-test is not available for multiprocessing -> key is still needed in Schema - do not set key in tutorial config as it it not implemented for t-test
Henry committedJul 3, 2024 Configuration menu - View commit details
-
Copy full SHA for fbbeb19 - Browse repository at this point
Copy the full SHA fbbeb19View commit details -
🐛 also deactivate mutliprocessing for KS as it's not implemented
Henry committedJul 3, 2024 Configuration menu - View commit details
-
Copy full SHA for cb3ad30 - Browse repository at this point
Copy the full SHA cb3ad30View commit details -
🎨 fix flake8-bugbear issues except missing multiprocessing of t-test …
…and KS approach
Henry committedJul 3, 2024 Configuration menu - View commit details
-
Copy full SHA for 8c61d35 - Browse repository at this point
Copy the full SHA 8c61d35View commit details -
Henry committed
Jul 3, 2024 Configuration menu - View commit details
-
Copy full SHA for 5aa03ff - Browse repository at this point
Copy the full SHA 5aa03ffView commit details -
🐛 use perturb_continuous_data_extended from perturbations
(as defined on developer branch) - remove debug log statements here - the version in "identify_associations.py" had a hardcorded number of parameters (5): num_features = 5
Henry committedJul 3, 2024 Configuration menu - View commit details
-
Copy full SHA for 8b06298 - Browse repository at this point
Copy the full SHA 8b06298View commit details
Commits on Jul 4, 2024
-
🔥 comments and old configurations; format
Henry committedJul 4, 2024 Configuration menu - View commit details
-
Copy full SHA for 6cfd1f8 - Browse repository at this point
Copy the full SHA 6cfd1f8View commit details -
🔥 remove duplicated functionality
- use only one version in extra module
Henry committedJul 4, 2024 Configuration menu - View commit details
-
Copy full SHA for 8277891 - Browse repository at this point
Copy the full SHA 8277891View commit details -
✨ integrate multiprocessing into analyze_latent.py
- add test with multiprocessing activated - unify modules into one (with the option for both approaches)
Henry committedJul 4, 2024 Configuration menu - View commit details
-
Copy full SHA for 44802eb - Browse repository at this point
Copy the full SHA 44802ebView commit details -
✨ merge multiprocessing bayes factors into identify_associations
- add possibility to multiprocess to itdentify associations
Henry committedJul 4, 2024 Configuration menu - View commit details
-
Copy full SHA for f64d779 - Browse repository at this point
Copy the full SHA f64d779View commit details
Commits on Jul 5, 2024
-
🔥 remove old schema entries, increase run time
Henry committedJul 5, 2024 Configuration menu - View commit details
-
Copy full SHA for 6a17110 - Browse repository at this point
Copy the full SHA 6a17110View commit details -
:zip: do no save intermediate files for single-process bayes_approach
Henry committedJul 5, 2024 Configuration menu - View commit details
-
Copy full SHA for b8b4769 - Browse repository at this point
Copy the full SHA b8b4769View commit details -
Henry committed
Jul 5, 2024 Configuration menu - View commit details
-
Copy full SHA for 2927d3f - Browse repository at this point
Copy the full SHA 2927d3fView commit details -
Henry committed
Jul 5, 2024 Configuration menu - View commit details
-
Copy full SHA for 202eb74 - Browse repository at this point
Copy the full SHA 202eb74View commit details -
Henry committed
Jul 5, 2024 Configuration menu - View commit details
-
Copy full SHA for d6bc896 - Browse repository at this point
Copy the full SHA d6bc896View commit details -
🚧 move bayes_parallel to own module
- start rewriting _bayes_approach to contain more well defined steps (define separate functions for each step) - check that the results will match roughly
Henry committedJul 5, 2024 Configuration menu - View commit details
-
Copy full SHA for b99ce97 - Browse repository at this point
Copy the full SHA b99ce97View commit details -
Henry committed
Jul 5, 2024 Configuration menu - View commit details
-
Copy full SHA for 171c915 - Browse repository at this point
Copy the full SHA 171c915View commit details -
Henry committed
Jul 5, 2024 Configuration menu - View commit details
-
Copy full SHA for 95c9f40 - Browse repository at this point
Copy the full SHA 95c9f40View commit details -
🎨 start separating recurrent code into fcts
Henry committedJul 5, 2024 Configuration menu - View commit details
-
Copy full SHA for e556fae - Browse repository at this point
Copy the full SHA e556faeView commit details -
🎨 adapt to look more similar to single-core bayes factor fct
Henry committedJul 5, 2024 Configuration menu - View commit details
-
Copy full SHA for 1a2774d - Browse repository at this point
Copy the full SHA 1a2774dView commit details -
✨ add back masking of self-perturbed feat.
Henry committedJul 5, 2024 Configuration menu - View commit details
-
Copy full SHA for 680c164 - Browse repository at this point
Copy the full SHA 680c164View commit details
Commits on Jul 8, 2024
-
🎨 initiailize logger at the top of the module
Henry committedJul 8, 2024 Configuration menu - View commit details
-
Copy full SHA for 8f43c90 - Browse repository at this point
Copy the full SHA 8f43c90View commit details -
Configuration menu - View commit details
-
Copy full SHA for 6178c8f - Browse repository at this point
Copy the full SHA 6178c8fView commit details -
Configuration menu - View commit details
-
Copy full SHA for 60ed227 - Browse repository at this point
Copy the full SHA 60ed227View commit details -
Henry committed
Jul 8, 2024 Configuration menu - View commit details
-
Copy full SHA for f5da671 - Browse repository at this point
Copy the full SHA f5da671View commit details -
- before more than one feat was changed, and probably not the desired one. - out of index slice in numpy returns just an empty array! see: https://stackoverflow.com/questions/54613753/why-does-python-allow-out-of-range-slice-indexes-for-sequences
Henry committedJul 8, 2024 Configuration menu - View commit details
-
Copy full SHA for 7eae82d - Browse repository at this point
Copy the full SHA 7eae82dView commit details -
🐛 remove redefintion of nan_mask
Henry committedJul 8, 2024 Configuration menu - View commit details
-
Copy full SHA for 50a623e - Browse repository at this point
Copy the full SHA 50a623eView commit details -
🎨 only define logger once in module
Henry committedJul 8, 2024 Configuration menu - View commit details
-
Copy full SHA for 2df057b - Browse repository at this point
Copy the full SHA 2df057bView commit details -
🎨 align single process bayes and multiprocess bayes fct
- allows easier comparison of functionality
Henry committedJul 8, 2024 Configuration menu - View commit details
-
Copy full SHA for 2e87e12 - Browse repository at this point
Copy the full SHA 2e87e12View commit details -
🎨 just document in code that this cannot happen
- 🐛 also add missing imports
Henry committedJul 8, 2024 Configuration menu - View commit details
-
Copy full SHA for aa2e5d9 - Browse repository at this point
Copy the full SHA aa2e5d9View commit details -
⚡ improve CI speed, reduce stability (-> one refit only)
Henry committedJul 8, 2024 Configuration menu - View commit details
-
Copy full SHA for 4041fcb - Browse repository at this point
Copy the full SHA 4041fcbView commit details -
🐛 use default no. of epochs + t-test needs 4 refits
Henry committedJul 8, 2024 Configuration menu - View commit details
-
Copy full SHA for 2d004e0 - Browse repository at this point
Copy the full SHA 2d004e0View commit details
Commits on Jul 9, 2024
-
⚡ do not run t-test check (for now)
- see if results betw. single and multirun match.
Henry committedJul 9, 2024 Configuration menu - View commit details
-
Copy full SHA for 8d65528 - Browse repository at this point
Copy the full SHA 8d65528View commit details -
⚡ bump up bayes factor training
Henry committedJul 9, 2024 Configuration menu - View commit details
-
Copy full SHA for 1dd6788 - Browse repository at this point
Copy the full SHA 1dd6788View commit details -
🎨 train both refits with 100 epochs
Henry committedJul 9, 2024 Configuration menu - View commit details
-
Copy full SHA for dc9020e - Browse repository at this point
Copy the full SHA dc9020eView commit details -
- decide wheather to log2 transform - default: do not in order to allow negative features which are then standard normalized
Henry committedJul 9, 2024 Configuration menu - View commit details
-
Copy full SHA for 9cd2a7b - Browse repository at this point
Copy the full SHA 9cd2a7bView commit details -
Henry committed
Jul 9, 2024 Configuration menu - View commit details
-
Copy full SHA for a4911d7 - Browse repository at this point
Copy the full SHA a4911d7View commit details -
⚡ test multiprocess on continuous tutorial
Henry committedJul 9, 2024 Configuration menu - View commit details
-
Copy full SHA for e0421bd - Browse repository at this point
Copy the full SHA e0421bdView commit details -
Henry committed
Jul 9, 2024 Configuration menu - View commit details
-
Copy full SHA for c70d328 - Browse repository at this point
Copy the full SHA c70d328View commit details -
Configuration menu - View commit details
-
Copy full SHA for 1c72316 - Browse repository at this point
Copy the full SHA 1c72316View commit details -
🐛 fix minor bug (wrongly assigned feat)
Henry committedJul 9, 2024 Configuration menu - View commit details
-
Copy full SHA for 58f08e4 - Browse repository at this point
Copy the full SHA 58f08e4View commit details -
⚡ move masking code into main fct of module
Henry committedJul 9, 2024 Configuration menu - View commit details
-
Copy full SHA for f895237 - Browse repository at this point
Copy the full SHA f895237View commit details -
Henry committed
Jul 9, 2024 Configuration menu - View commit details
-
Copy full SHA for 5eb7954 - Browse repository at this point
Copy the full SHA 5eb7954View commit details -
- need to switch dataloader constructor for type of pertubation (cat or cont)
Henry committedJul 9, 2024 Configuration menu - View commit details
-
Copy full SHA for 8c4e53b - Browse repository at this point
Copy the full SHA 8c4e53bView commit details -
⚡ do not build dataloaders for multiprocessing
Henry committedJul 9, 2024 Configuration menu - View commit details
-
Copy full SHA for 49a93d0 - Browse repository at this point
Copy the full SHA 49a93d0View commit details
Commits on Jul 10, 2024
-
🚧 test t-test again, re-run pert. w/o model training
Henry committedJul 10, 2024 Configuration menu - View commit details
-
Copy full SHA for 709c674 - Browse repository at this point
Copy the full SHA 709c674View commit details -
✨ add categorical pert. to multiprocessing
Henry committedJul 10, 2024 Configuration menu - View commit details
-
Copy full SHA for 6e65cc6 - Browse repository at this point
Copy the full SHA 6e65cc6View commit details -
Henry committed
Jul 10, 2024 Configuration menu - View commit details
-
Copy full SHA for 4efbdd9 - Browse repository at this point
Copy the full SHA 4efbdd9View commit details -
Henry committed
Jul 10, 2024 Configuration menu - View commit details
-
Copy full SHA for dab767a - Browse repository at this point
Copy the full SHA dab767aView commit details
Commits on Jul 12, 2024
-
Henry committed
Jul 12, 2024 Configuration menu - View commit details
-
Copy full SHA for 980bbce - Browse repository at this point
Copy the full SHA 980bbceView commit details -
🎨 move shared key to base class
Henry committedJul 12, 2024 Configuration menu - View commit details
-
Copy full SHA for c26b2dd - Browse repository at this point
Copy the full SHA c26b2ddView commit details -
🔥 remove comments and code duplications
Henry committedJul 12, 2024 Configuration menu - View commit details
-
Copy full SHA for 05c1735 - Browse repository at this point
Copy the full SHA 05c1735View commit details -
🎨 update type hints, remove unused import
Henry committedJul 12, 2024 Configuration menu - View commit details
-
Copy full SHA for c5002cd - Browse repository at this point
Copy the full SHA c5002cdView commit details
Commits on Aug 12, 2024
-
Configuration menu - View commit details
-
Copy full SHA for fe8c48b - Browse repository at this point
Copy the full SHA fe8c48bView commit details