Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Libfabric transport layer support #76

Open
xendo opened this issue Jan 10, 2025 · 1 comment
Open

Libfabric transport layer support #76

xendo opened this issue Jan 10, 2025 · 1 comment

Comments

@xendo
Copy link

xendo commented Jan 10, 2025

In your roadmap i can see that you plan to add additional transport layers for the transfer engine. I was wondering if you also considered adding support for libfabric: https://github.com/ofiwg/libfabric . That would give you support for several providers at a single try.

Is there anything I should be aware of before trying to implement and contribute such support?

P.S.
I really enjoyed reading through your documentation, really high quality stuff

@alogfans
Copy link
Collaborator

As we have refactored the code recently, adding a new transport will be more easier. We appreicate the community to submit additional transports.

In my opinion, things to be aware before coding:

  • Current transfer API is one-sided. Though it is technically possible to extend it to support two-sided (send/recv) operations, we prefer to find approaches to make one-sided operations more efficient.
  • Most transport needs to manage metdata (e.g. segment info) by it self. You can refer to tcp transport at the beginning.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants