Currently we support crystal router only. This PR suggests to add pairwise and all_reduce.
Currently we support crystal router only. This PR suggests to add pairwise and all_reduce.