On-demand feature generation #106
-
Hello. Does Feathr support on-demand feature generation? From the docs and examples it is clear how batch and online queries work, but I couldn't find anything that enables on-demand generation of features (e.g., feature data comes not from online store but from API call). Apologies if I've missed this in the docs. |
Beta Was this translation helpful? Give feedback.
Replies: 1 comment 2 replies
-
It's not supported right now in the opne-source branch. But we do have this functionality inside LinkedIn and we will roll it out in a few months. If you have source data that is streamed into your data lake/warehouse, you can use streaming feature generation which will come in a few weeks. If you can elaborate a bit more on your use case, that will be better. Like the shape of your data, what's the API client to access those endpoints, do you need any kind of transformation on top of the raw data, what's the latency requirements? Thanks. |
Beta Was this translation helpful? Give feedback.
It's not supported right now in the opne-source branch. But we do have this functionality inside LinkedIn and we will roll it out in a few months.
If you have source data that is streamed into your data lake/warehouse, you can use streaming feature generation which will come in a few weeks.
If you can elaborate a bit more on your use case, that will be better. Like the shape of your data, what's the API client to access those endpoints, do you need any kind of transformation on top of the raw data, what's the latency requirements?
Thanks.