Replies: 2 comments
-
MVP related items tracked in #139 |
Beta Was this translation helpful? Give feedback.
0 replies
-
Moving with other items in a private discussion |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
As before we confirmed that for the beta we're going focus on server and API. Facilitating benchmarks. TEE and the rest. Moreover we'll expand the scope of our API implementation to translate our API to existing third party, closed source APIs such as Open AI.
We'll work at developing the router as a service and allow routing to third party services as well as our own private cloud.
We decided to have a motivational app: a flagship project which uses the routing service.
A key item is that we decided to reduce the priority of edge inference on handheld devices. We're still going to support it, but for the immediate future we won't invest as much in solving mobile-specific problems.
Also (and this is more a marketing and PR item than an engineering one) we want to make the API more prominent. We want to have the API as a main "product" of sorts, and have our SDK as a reference implementation.
Some of these decisions affect the MVP as well:
Beta Was this translation helpful? Give feedback.
All reactions