Changelog

0.41.0 (2024-10-26)

chore!: Update @elastic/eui and @emotion/react in Feast UI (#4597) (b9ddbf9)

Bug Fixes

Add --chdir to test_workflow.py (#4453) (6b2f026)
Add feast-operator files to semantic-release script (#4382) (8eceff2)
Add feast-operator Makefile to semantic-release script (#4424) (d18d01d)
Added Offline Store Arrow client errors handler (#4524) (7535b40)
Added Online Store REST client errors handler (#4488) (2118719)
Added Permission API docs (#4485) (2bd03fa)
Added support for multiple name patterns to Permissions (#4633) (f05e928)
Adding protobuf<5 as a required dependency due to snowflake limitations (#4537) (cecca83)
Avoid the python 3.9+ threadpool cleanup bug (#4627) (ba05893)
Bigquery dataset create table disposition (#4649) (58e03d1)
Changes template file path to relative path (#4624) (3e313b1)
Check for snowflake functions when setting up materialization engine (#4456) (c365b4e)
Correctly handle list values in _python_value_to_proto_value (#4608) (c0a1026)
Default to pandas mode if not specified in ODFV proto in database (#4420) (d235832)
Deleting data from feast_metadata when we delete project (#4550) (351a2d0)
Disable active_timer When registry_ttl_sec is 0 (#4499) (c94f32f)
Escape special characters in the Postgres password (#4394) (419ca5e)
FeastExtrasDependencyImportError when using SparkOfflineStore without S3 (#4594) (1ba94f7)
Fix Feast project name test (#4685) (9f41fd6)
Fix for SQL registry initialization fails #4543 (#4544) (4e2eacc)
Fix gitignore issue (#4674) (2807dfa)
Fix online pg import (#4581) (1f17caa)
Fix the mypy type check issue. (#4498) (7ecc615)
Fix vector store config (#4583) (11c00d4)
Fixes validator field access for 'project_id' in BigQuery offline Store (#4509) (9a0398e)
Fixing failure of protos during ODFV transformations for missing entities (#4667) (41aaeeb)
Fixing the master branch build failure. (#4563) (0192b2e)
Hao xu request source timestamp_field (#4495) (96344b2)
Ignore the type check as both functions calls are not belonging to Feast code. (#4500) (867f532)
Import grpc only for type checking in errors.py (#4533) (f308572)
Initial commit targetting grpc registry server (#4458) (484240c), closes #4465
Links to the RBAC documentation under Concepts and Components (#4430) (0a48f7b)
Locate feature_store.yaml from file (#4443) (20290ce)
Logger settings for feature servers and updated logger for permission flow (#4531) (50b8f23)
Move tslib from devDependencies to dependencies in Feast UI (#4525) (c5a4d90)
Null value compatibility for unit timestamp list value type (#4378) (8f264b6)
Patch FAISS online return signature (#4671) (0d45e95)
Quickstart documentation changes (#4618) (7ac0908)
Refactor auth_client_manager_factory.py in function get_auth_client_m… (#4505) (def8633)
Remote apply using offline store (#4559) (ac62a32)
Remove Feast UI TypeScript dependencies from peerDependencies and dependencies (#4554) (e781e16)
Remove unnecessary peer dependencies from Feast UI (#4577) (9ac7f4e)
Removed protobuf as a required dependency (#4535) (0fb76e9)
Removed the k8s dependency from required dependencies (#4519) (3073ea5)
Removed usage of pull_request_target as much as possible to prevent security concerns (#4549) (3198371)
Replaced ClusterRoles with local RoleBindings (#4625) (ca9fb9b)
Retire pytz library (#4406) (23c6c86)
Typos related to k8s (#4442) (dda0088)
Update java testcontainers to use Compose V2 (#4381) (9a33fce)
Update min versions for pyarrow and protobuf (#4646) (c7ddd4b)
Update react-router-dom to 6.3.0 and restrict its version in Feast UI (#4556) (4293608), closes #3794 /github.com/remix-run/react-router/blob/main/CHANGELOG.md#v630
Update the base image for feature-server. (#4576) (0390d8a)
Update the base image of materilization engine. (#4580) (f8592d8)
Updated README link (#4669) (35fbdc9)
Updating the documentation and adding tests for project length (#4628) (945b0fa)
Using get_type_hints instead of inspect signature for udf return annotation (#4391) (3a32e8a)
Using repo_config parameter in teardown to allow for feature-store-yaml overrides (#4413) (0baeeb5)
Validating permission to update an existing request on both the new and the old instance (#4449) (635a01b)

Features

Add boto3 session based auth for dynamodb online store for cross account access (#4606) (00eaf74)
Add cli list/describe for SavedDatasets, StreamFeatureViews, & … (#4487) (7b250e5)
Add connection_name field to Snowflake config (#4600) (10ce2aa)
Add health check service to registry server (#4421) (46655f0)
Add more repr methods (#4676) (e726c09)
Add registry methods for dealing with all FV types (#4435) (ac381b2)
Added Project object to Feast Objects (#4475) (4a6b663)
Added support for reading from Reader Endpoints for AWS Aurora use cases (#4494) (d793c77)
Adding documentation for On Demand Feature Transformations with writes (#4607) (8e0c1b5)
Adding mode='python' for get_historical_features on ODFVs (#4653) (c40d539)
Adding registry cache support for get_on_demand_feature_view (#4572) (354c059)
Adding SSL support for online server (#4677) (80a5b3c)
Adding write capability to online store to on demand feature views (#4585) (ef9e0bb), closes #4603
Allow feast snowflake to read in byte string for private-key authentication (#4384) (5215a21)
An action to test operator at PR time (#4635) (14c1000)
Create ADOPTERS.md (#4410) (721ec74)
Create initial structure of Feast Go Operator (#4596) (b5ab6c7)
Faiss and In memory store (#4464) (a1ff129)
Feast Security Model (aka RBAC) (#4380) (1771f66), closes #36
Instrument Feast using Prometheus and OpenTelemetry (#4366) (a571e08)
Intra server to server communication (#4433) (729c874)
Publish TypeScript types in Feast UI package (#4551) (334e5d7)
Refactoring code to get oidc end points from discovery URL. (#4429) (896360a)
Return entity key in the retrieval document api (#4511) (5f5caf0)
Update roadmap.md (#4445) (34238d2)
Update sqlite-vec package (#4389) (b734cb1)
Updated Feast model Inference Architecture (#4570) (8cd0dcf)
Updating docs to include model inference guidelines (#4416) (cebbe04)
Updating FeatureViewProjection and OnDemandFeatureView to add batch_source and entities (#4530) (0795496)
Upgrade React from 17.0.2 to 18.3.1 in Feast UI (#4620) (d6f3cb8)

Performance Improvements

Add init and cleanup of long lived resources (#4642) (47dc04d)
Added indexes to sql tables to optimize query execution (#4538) (9688790)
Default to async endpoints, use threadpool for sync (#4647) (c1f1912)
Implement dynamo write_batch_async (#4675) (ba4404c)
Make /push async (#4650) (61abf89)
Parallelize read calls by table and batch (#4619) (043eff1)

BREAKING CHANGES

Consuming apps that use @elastic/eui should update it to a compatible version. If you use @elastic/eui components that have been renamed or replaced with others, you'll need to update your code accordingly.

Signed-off-by: Harri Lehtola peruukki@hotmail.com

chore: Update Node version from 17 to 20 in UI unit tests

Node 17 is not an LTS (long-term support) version and apparently rejected by the latest versions of Elastic UI:

error @elastic/eui@95.12.0: The engine "node" is incompatible with this module. Expected version "16.x || 18.x || >=20.x". Got "17.9.1"

Let's try with the latest LTS version.

Signed-off-by: Harri Lehtola peruukki@hotmail.com

0.40.0 (2024-07-31)

Bug Fixes

Added missing type (#4315) (86af60a)
Avoid XSS attack from Jinjin2's Environment(). (#4355) (40270e7)
CGO Memory leak issue in GO Feature server (#4291) (43e198f)
Deprecated the datetime.utcfromtimestamp(). (#4306) (21deec8)
Fix SQLite import issue (#4294) (398ea3b)
Increment operator to v0.39.0 (#4368) (3ddb4fb)
Minor typo in the unit test. (#4296) (6c75e84)
OnDemandFeatureView type inference for array types (#4310) (c45ff72)
Remove redundant batching in PostgreSQLOnlineStore.online_write_batch and fix progress bar (#4331) (0d89d15)
Remove typo. (#4351) (92d17de)
Retire the datetime.utcnow(). (#4352) (a8bc696)
Update dask version to support pandas 1.x (#4326) (a639d61)
Update Feast object metadata in the registry (#4257) (8028ae0)
Using one single function call for utcnow(). (#4307) (98ff63c)

Features

Add async feature retrieval for Postgres Online Store (#4327) (cea52e9)
Add Async refresh to Sql Registry (#4251) (f569786)
Add SingleStore as an OnlineStore (#4285) (2c38946)
Add Tornike to maintainers.md (#4339) (8e8c1f2)
Bump psycopg2 to psycopg3 for all Postgres components (#4303) (9451d9c)
Entity key deserialization (#4284) (83fad15)
Ignore paths feast apply (#4276) (b4d54af)
Move get_online_features to OnlineStore interface (#4319) (7072fd0)
Port mssql contrib offline store to ibis (#4360) (7914cbd)

Reverts

Revert "fix: Avoid XSS attack from Jinjin2's Environment()." (#4357) (cdeab48), closes #4355

0.39.0 (2024-06-18)

Bug Fixes

Feast UI importlib change (#4248) (5d486b8)
Feature server no_feature_log argument error (#4255) (15524ce)
Feature UI Server image won't start in an OpenShift cluster (#4250) (4891f76)
Handles null values in data during GO Feature retrieval (#4274) (c491e57)
Make Java gRPC client use timeouts as expected (#4237) (f5a37c1)
Remove self assignment code line. (#4238) (e514f66)
Set default values for feature_store.serve() function (#4225) (fa74438)

Features

Add online_read_async for dynamodb (#4244) (b5ef384)
Add the ability to list objects by tags (#4246) (fbf92da)
Added deadline to gRPC Java client (#4217) (ff429c9)
Adding vector search for sqlite (#4176) (2478831)
Change get_online_features signature, move online retrieval functions to utils (#4278) (7287662)
Feature/adding remote online store (#4226) (9454d7c)
List all feature views (#4256) (36a574d)
Make RegistryServer writable (#4231) (79e1143)
Remote offline Store (#4262) (28a3d24)
Set optional full-scan for deletion (#4189) (b9cadd5)

0.38.0 (2024-05-24)

Bug Fixes

Add vector database doc (#4165) (37f36b6)
Change checkout action back to v3 from v5 which isn't released yet (#4147) (9523fff)
Change numpy version <1.25 dependency to <2 in setup.py (#4085) (2ba71ff), closes #4084
Changed the code the way mysql container is initialized. (#4140) (8b5698f), closes #4126
Correct nightly install command, move all installs to uv (#4164) (c86d594)
Default value is not set in Redis connection string using environment variable (#4136) (95acfb4), closes #3669
Get container host addresses from testcontainers (java) (#4125) (9184dde)
Get rid of empty string name_alias during feature view projection deserialization (#4116) (65056ce)
Helm chart feast-feature-server, improve Service template name (#4161) (dedc164)
Improve the code related to on-demand-featureview. (#4203) (d91d7e0)
Integration tests for async sdk method (#4201) (08c44ae)
Make sure schema is used when calling get_table_query_string method for Snowflake datasource (#4131) (c1579c7)
Make sure schema is used when generating from_expression for Snowflake (#4177) (5051da7)
Pass native input values to get_online_features from feature server (#4117) (60756cb)
Pass region to S3 client only if set (Java) (#4151) (b8087f7)
Pgvector patch (#4108) (ad45bb4)
Update doc (#4153) (e873636)
Update master-only benchmark bucket name due to credential update (#4183) (e88f1e3)
Updating the instructions for quickstart guide. (#4120) (0c30e96)
Upgrading the test container so that local tests works with updated d… (#4155) (93ddb11)

Features

Add a Kubernetes Operator for the Feast Feature Server (#4145) (4a696dc)
Add delta format to FileSource, add support for it in ibis/duckdb (#4123) (2b6f1d0)
Add materialization support to ibis/duckdb (#4173) (369ca98)
Add optional private key params to Snowflake config (#4205) (20f5419)
Add s3 remote storage export for duckdb (#4195) (6a04c48)
Adding DatastoreOnlineStore 'database' argument. (#4180) (e739745)
Adding get_online_features_async to feature store sdk (#4172) (311efc5)
Adding support for dictionary writes to online store (#4156) (abfac01)
Elasticsearch vector database (#4188) (bf99640)
Enable other distance metrics for Vector DB and Update docs (#4170) (ba9f4ef)
Feast/IKV datetime edgecase errors (#4211) (bdae562)
Feast/IKV documenation language changes (#4149) (690a621)
Feast/IKV online store contrib plugin integration (#4068) (f2b4eb9)
Feast/IKV online store documentation (#4146) (73601e4)
Feast/IKV upgrade client version (#4200) (0e42150)
Incorporate substrait ODFVs into ibis-based offline store queries (#4102) (c3a102f)
Isolate input-dependent calculations in get_online_features (#4041) (2a6edea)
Make arrow primary interchange for online ODFV execution (#4143) (3fdb716)
Move data source validation entrypoint to offline store (#4197) (a17725d)
Upgrading python version to 3.11, adding support for 3.11 as well. (#4159) (4b1634f), closes #4152 #4114

Reverts

Reverts "fix: Using version args to install the correct feast version" (#4112) (b66baa4), closes #3953

0.37.1 (2024-04-17)

Bug Fixes

Pgvector patch (#4108) (1a1f0b1)

Reverts

Reverts "fix: Using version args to install the correct feast version" (#4112) (d5ded69), closes #3953

0.37.0 (2024-04-17)

Bug Fixes

Pgvector patch (#4103) (5c4a9c5)
Remove top-level grpc import in cli (#4107) (4362b6c)

Features

Add tags to dynamodb config (#4100) (b08b8d5)

0.36.0 (2024-04-16)

Bug Fixes

Add eq, hash to SparkSource for correct comparison (#4028) (e703b40)
Add conn.commit() to Postgresonline_write_batch.online_write_batch (#3904) (7d75fc5)
Add missing init.py to embedded_go (#4051) (6bb4c73)
Add missing init files in infra utils (#4067) (54910a1)
Added registryPath parameter documentation in WebUI reference (#3983) (5e0af8f), closes #3974 #3974
Adding missing init files in materialization modules (#4052) (df05253)
Allow trancated timestamps when converting (#3861) (bdd7dfb)
Azure blob storage support in Java feature server (#2319) (#4014) (b9aabbd)
Bugfix for grabbing historical data from Snowflake with array type features. (#3964) (1cc94f2)
Bytewax materialization engine fails when loading feature_store.yaml (#3912) (987f0fd)
CI unittest warnings (#4006) (0441b8b)
Correct the returning class proto type of StreamFeatureView to StreamFeatureViewProto instead of FeatureViewProto. (#3843) (86d6221)
Create index only if not exists during MySQL online store update (#3905) (2f99a61)
Disable minio tests in workflows on master and nightly (#4072) (c06dda8)
Disable the Feast Usage feature by default. (#4090) (b5a7013)
Dump repo_config by alias (#4063) (e4bef67)
Extend SQL registry config with a sqlalchemy_config_kwargs key (#3997) (21931d5)
Feature Server image startup in OpenShift clusters (#4096) (9efb243)
Fix copy method for StreamFeatureView (#3951) (cf06704)
Fix for materializing entityless feature views in Snowflake (#3961) (1e64c77)
Fix type mapping spark (#4071) (3afa78e)
Fix typo as the cli does not support shortcut-f option. (#3954) (dd79dbb)
Get container host addresses from testcontainers (#3946) (2cf1a0f)
Handle ComplexFeastType to None comparison (#3876) (fa8492d)
Hashlib md5 errors in FIPS for python 3.9+ (#4019) (6d9156b)
Making the query_timeout variable as optional int because upstream is considered to be optional (#4092) (fd5b620)
Move gRPC dependencies to an extra (#3900) (f93c5fd)
Prevent spamming pull busybox from dockerhub (#3923) (7153cad)
Quickstart notebook example (#3976) (b023aa5)
Raise error when not able read of file source spark source (#4005) (34cabfb)
remove not use input parameter in spark source (#3980) (7c90882)
Remove parentheses in pull_latest_from_table_or_query (#4026) (dc4671e)
Remove proto-plus imports (#4044) (ad8f572)
Remove unnecessary dependency on mysqlclient (#3925) (f494f02)
Restore label check for all actions using pull_request_target (#3978) (591ba4e)
Revert mypy config (#3952) (6b8e96c)
Rewrite Spark materialization engine to use mapInPandas (#3936) (dbb59ba)
Run feature server w/o gunicorn on windows (#4024) (584e9b1)
SqlRegistry _apply_object update statement (#4042) (ef62def)
Substrait ODFVs for online (#4064) (26391b0)
Swap security label check on the PR title validation job to explicit permissions instead (#3987) (f604af9)
Transformation server doesn't generate files from proto (#3902) (d3a2a45)
Trino as an OfflineStore Access Denied when BasicAuthenticaion (#3898) (49d2988)
Trying to import pyspark lazily to avoid the dependency on the library (#4091) (a05cdbc)
Typo Correction in Feast UI Readme (#3939) (c16e5af)
Update actions/setup-python from v3 to v4 (#4003) (ee4c4f1)
Update typeguard version to >=4.0.0 (#3837) (dd96150)
Upgrade sqlalchemy from 1.x to 2.x regarding PVE-2022-51668. (#4065) (ec4c15c)
Use CopyFrom() instead of deepycopy() for creating a copy of protobuf object. (#3999) (5561b30)
Using version args to install the correct feast version (#3953) (b83a702)
Verify the existence of Registry tables in snowflake before calling CREATE sql command. Allow read-only user to call feast apply. (#3851) (9a3590e)

Features

Add duckdb offline store (#3981) (161547b)
Add Entity df in format of a Spark Dataframe instead of just pd.DataFrame or string for SparkOfflineStore (#3988) (43b2c28)
Add gRPC Registry Server (#3924) (373e624)
Add local tests for s3 registry using minio (#4029) (d82d1ec)
Add python bytes to array type conversion support proto (#3874) (8688acd)
Add python client for remote registry server (#3941) (42a7b81)
Add Substrait-based ODFV transformation (#3969) (9e58bd4)
Add support for arrays in snowflake (#3769) (8d6bec8)
Added delete_table to redis online store (#3857) (03dae13)
Adding support for Native Python feature transformations for ODFVs (#4045) (73bc853)
Bumping requirements (#4079) (1943056)
Decouple transformation types from ODFVs (#3949) (0a9fae8)
Dropping Python 3.8 from local integration tests and integration tests (#3994) (817995c)
Dropping python 3.8 requirements files from the project. (#4021) (f09c612)
Dropping the support for python 3.8 version from feast (#4010) (a0f7472)
Dropping unit tests for Python 3.8 (#3989) (60f24f9)
Enable Arrow-based columnar data transfers (#3996) (d8d7567)
Enable Vector database and retrieve_online_documents API (#4061) (ec19036)
Kubernetes materialization engine written based on bytewax (#4087) (7617bdb)
Lint with ruff (#4043) (7f1557b)
Make arrow primary interchange for offline ODFV execution (#4083) (9ed0a09)
Pandas v2 compatibility (#3957) (64459ad)
Pull duckdb from contribs, add to CI (#4059) (318a2b8)
Refactor ODFV schema inference (#4076) (c50a9ff)
Refactor registry caching logic into a separate class (#3943) (924f944)
Rename OnDemandTransformations to Transformations (#4038) (9b98eaf)
Revert updating dependencies so that feast can be run on 3.11. (#3968) (d3c68fb), closes #3958
Rewrite ibis point-in-time-join w/o feast abstractions (#4023) (3980e0c)
Support s3gov schema by snowflake offline store during materialization (#3891) (ea8ad17)
Update odfv test (#4054) (afd52b8)
Update pyproject.toml to use Python 3.9 as default (#4011) (277b891)
Update the Pydantic from v1 to v2 (#3948) (ec11a7c)
Updating dependencies so that feast can be run on 3.11. (#3958) (59639db)
Updating protos to separate transformation (#4018) (c58ef74)

Reverts

Reverting bumping requirements (#4081) (1ba65b4), closes #4079
Verify the existence of Registry tables in snowflake… (#3907) (c0d358a), closes #3851

0.35.0 (2024-01-13)

Bug Fixes

Add async refresh to prevent synchronous refresh in main thread (#3812) (9583ed6)
Adopt connection pooling for HBase (#3793) (b3852bf)
Bytewax engine create configmap from object (#3821) (25e9775)
Fix warnings from deprecated paths and update default log level (#3757) (68a8737)
improve parsing bytewax job status (5983f40)
make bytewax settings unexposed (ae1bb8b)
Make generated temp table name escaped (#3797) (175d796)
Pin numpy version to avoid spammy deprecation messages (774ed33)
Redundant feature materialization and premature incremental materialization timestamp updates (#3789) (417b16b), closes #6 #7
Resolve hbase hotspot issue when materializing (#3790) (7376db8)
Set keepalives_idle None by default (#3756) (8717e9b)
Set upper bound for bigquery client due to its breaking changes (2151c39)
UI project cannot handle fallback routes (#3766) (96ece0f)
update dependencies versions due to conflicts (5dc0b24)
Update jackson and remove unnecessary logging (#3809) (018d0ea)
upgrade the pyarrow to latest v14.0.1 for CVE-2023-47248. (052182b)

Features

Add get online feature rpc to gprc server (#3815) (01db8cc)
Add materialize and materialize-incremental rest endpoints (#3761) (fa600fe), closes #3760
add redis sentinel support (3387a15)
add redis sentinel support (4337c89)
add redis sentinel support format lint (aad8718)
Add support for table_create_disposition in bigquery job for offline store (#3762) (6a728fe)
Add support for in_cluster config and additional labels for bytewax materialization (#3754) (2192e65)
Apply cache to load proto registry for performance (#3702) (709c709)
Make bytewax job write as mini-batches (#3777) (9b0e5ce)
Optimize bytewax pod resource with zero-copy (9cf9d96)
Support GCS filesystem for bytewax engine (#3774) (fb6b807)

0.34.0 (2023-09-07)

Bug Fixes

Add NUMERIC to bq_to_feast type map (#3719) (6474b4b)
Fix python unit tests (#3734) (e81684d)
Handle unknown postgres source types gracefully (#3634) (d7041f4)
Pin protobuf version to avoid seg fault on some machines (028cc20)
Remove unwanted excessive splitting of gcs path, so expected gcs parquet paths are returned from BigQueryRetrievalJob.to_remote_storage() (#3730) (f2c5988)
Run store.plan() only when need it. (#3708) (7bc7c47)
Saved datasets no longer break CLI registry-dump command (#3717) (f28ccc2)
Update py3.8 ci requirements for cython 3.0 release (#3735) (1695c13)

Features

Enhance customization of Trino connections when using Trino-based Offline Stores (#3699) (ed7535e)
Implement gRPC server to ingest streaming features (#3687) (a3fcd1f)

0.33.0 (2023-08-14)

Bug Fixes

Add aws-sts dependency in java sdk so that S3 client acquires IRSA role (#3696) (c75a01f)
Redshift push ignores schema (#3671) (76270f6)

Features

Add possibility to save dataset as table, when spark config has remote warehouse info (#3645) (22c109b)

0.32.0 (2023-07-17)

Bug Fixes

Added generic Feature store Creation for CLI (#3618) (bf740d2)
Broken non-root path with projects-list.json (#3665) (4861af0)
Clean up snowflake to_spark_df() (#3607) (e8e643e)
Entityless fv breaks with KeyError: __dummy applying feature_store.plan() on python (#3640) (ef4ef32)
Fix scan datasize to 0 for inference schema (#3628) (c3dd74e)
Fix timestamp consistency in push api (#3614) (9b227d7)
For SQL registry, increase max data_source_name length to 255 (#3630) (478caec)
Implements connection pool for postgres online store (#3633) (059509a)
Manage redis pipe's context (#3655) (48e0971)
Missing Catalog argument in athena connector (#3661) (f6d3caf)
Optimize bytes processed when retrieving entity df schema to 0 (#3680) (1c01035)

Features

Add gunicorn for serve with multiprocess (#3636) (4de7faf)
Use string as a substitute for unregistered types during schema inference (#3646) (c474ccd)

0.31.0 (2023-04-21)

Bug Fixes

Add Stream Feature Views to helper that collect Feature View names (#3582) (7854f63)
Add StreamFeatureViewSpec to FeastObjectSpecProto convenience type (#3550) (3cefd6c)
Batch Snowflake materialization queries to obey Snowpark 100 fea… (#3406) (f9862b5)
Bytewax materializer security context (#3573) (6794338)
cI: Install coreutils in mac github workers for smoke test (#3563) (e7421c1)
Fix bug with no SqlRegistryConfig class (#3586) (6dc1368)
Fix Snowflake template (#3584) (6c09c39)
Make snowflake to remote tables temporary (#3588) (ad48146)
Remove snowflake source warehouse tech debt (#3422) (7da0580)
Snowflake remote storage (#3574) (f8d3890)
Support param timeout when persisting (#3593) (01a98f0)
Use pyarrow in a way that works across versions (#3562) (1289f3f)
Wrap the bigquery table name with backtick. (#3577) (09f0e7e)

Features

Add AWS Redshift Serverless support (#3595) (58ce148)
Add Hazelcast as an online store (#3523) (b05d50b)
Cache Bigtable client (#3602) (b27472f)
Relax aws extras requirements (#3585) (7e77382)
Show bigquery datasource table and query on UI (#3600) (58d63f7)
Update snowflake offline store job output formats -- added arrow (#3589) (be3e349)

0.30.0 (2023-03-24)

Bug Fixes

Add description attribute to the Field.from_proto method (#3469) (473f8d9)
Add filesystem kwargs when read prev_table on FileRetrievalJob (… (#3491) (dca4745), closes #3490
Bytewax image pull secret config (#3547) (d2d13b1)
Clean up Rockset Online Store for use (#3549) (a76c6d0)
Feature view entities from_proto type (#3524) (57bbb61)
Fix missing requests requirement after GCP requirement removed. Make BigQuerySource not require gcp extra (2c85421)
Fix SQL Registry cache miss (#3482) (3249b97)
Fixed path inside quickstart notebook (#3456) (66edc32)
Improve BQ point-in-time joining scalability (#3429) (ff66784)
Pin typeguard to 2.13.3 which is what we are currently using. (#3542) (61f6fb0)
Protobuf lower bound to 3.20 to alert that Feast is incompatible with tensorflow (#3476) (9ca59e3)
Spark kafka processor sorting (#3479) (f2cbf43)
UI working behind base url (#3514) (9a3fd98)
Update go dependencies (#3512) (bada97c)

Features

Add Rockset as an OnlineStore (#3405) (fd91cda)
Add Snowflake Registry (#3363) (ec1e61d)
Added SnowflakeConnection caching (#3531) (f9f8df2)
Adding query timeout to to_df and to_arrow retrieval methods (#3505) (bab6644)
adds k8s config options to Bytewax materialization engine (#3518) (1883f55)

0.29.0 (2023-01-31)

Bug Fixes

Add check for bool type in addition to sample (#3452) (1c7c491)
Buggy SQL for postgres source (#3424) (1ea100e)
Ensure no duplicates in fv.schema (#3460) (08ffa8d)
Fix delete sfv twice issue (#3466) (dfd5eae)
Stream feature view UI shows transformation issue (#3464) (1ef5137)
Update registry.refresh to have a default arg (#3450) (2f7c4ed)
Updating the batch field so that you can query create and event date. (#3411) (01ab462), closes #3401

Features

Add data source search (#3449) (fbbb293)
Adding list_validation_references for default and sql registry (#3436) (21dd253)
Make UI accessible behind proxy (#3428) (753d8db)

0.28.0 (2023-01-03)

Bug Fixes

Apply billing project when infer schema (#3417) (4f9ad7e)
Assertion condition when value is 0 (#3401) (98a24a3)
Enable registry caching in SQL Registry (#3395) (2e57376)
Fix bug where SQL registry was incorrectly writing infra config around online stores (#3394) (6bcf77c)
Get all columns with describe table method from RedshiftData-api (#3377) (fd97254)
ODFV able to handle boolean pandas type (#3384) (8f242e6)
Remove PySpark dependency from Snowflake Offline Store (#3388) (7b160c7)
Specifies timeout in exception polling (#3398) (c0ca7e4)
Update import logic to remove pyspark dependency from Snowflake Offline Store (#3397) (cf073e6)

Features

Add template for Github Codespaces (#3421) (41c0537)
Adds description attribute for features/fields (#3425) (26f4881)
Snowflake skip materialization if no table change (#3404) (0ab3942)

0.27.0 (2022-12-05)

Bug Fixes

Changing Snowflake template code to avoid query not implemented … (#3319) (1590d6b)
Dask zero division error if parquet dataset has only one partition (#3236) (69e4a7d)
Enable Spark materialization on Yarn (#3370) (0c20a4e)
Ensure that Snowflake accounts for number columns that overspecify precision (#3306) (0ad0ace)
Fix memory leak from usage.py not properly cleaning up call stack (#3371) (a0c6fde)
Fix workflow to contain env vars (#3379) (548bed9)
Update bytewax materialization (#3368) (4ebe00f)
Update the version counts (#3378) (8112db5)
Updated AWS Athena template (#3322) (5956981)
Wrong UI data source type display (#3276) (8f28062)

Features

Cassandra online store, concurrency in bulk write operations (#3367) (eaf354c)
Cassandra online store, concurrent fetching for multiple entities (#3356) (00fa21f)
Get Snowflake Query Output As Pyspark Dataframe (#2504) (#3358) (2f18957)

0.26.0 (2022-10-06)

Bug Fixes

Add X-Trino-Extra-Credential header and remove user override (#3246) (164e666)
Add postgres to the feature server Dockerfile to fix helm chart flow (#3261) (6f6cbb7)
Add stream feature view in the Web UI (#3257) (1f70b3a)
Build dockerfile correctly (#3239) (a2dc0d0)
Configuration to stop coercion of tz for entity_df (#3255) (97b7ab9)
Enable users to upgrade a batch source into a push source (#3213) (1b312fb)
Fix docker image for feature-server (#3272) (eff01d1)
Fix Feast UI release process to update the feast-ui package (#3267) (a9d48d0)
Return 422 on bad push source name (#3214) (b851e01)
Stream feature view meta undefined created_timestamp issue (#3266) (12e1a8f)
Stream feature view not shown in the UI (#3251) (e713dda)
Udf in stream feature view UI shows pickled data (#3268) (0728117)
Update snowflake materialization messages (#3230) (a63d440)
Updated quickstart notebook to patch an incorrect reference to an outdated featureview name (#3271) (b9b9c54)
Use configured user in env var instead of "user" for Trino (#3254) (532d8a1)

Features

Add mysql as online store (#3190) (cb8db84)
Add possibility to define feature_store.yaml path with env variable (#3231) (95fdb19)
Add request_timeout setting for cassandra online store adapter (#3256) (da20757)
Add tag description in Field in the Feast UI (#3258) (086f279)
Adding billing_project_id in BigQueryOfflineStoreConfig (#3253) (f80f05f)
BigTable online store (#3140) (6bc91c2), closes /github.com/spulec/moto/blob/master/CHANGELOG.md#400
Filter subset features in postgres #3174 (#3203) (b48d36b)

0.25.0 (2022-09-20)

Bug Fixes

Broken Feature Service Link (#3227) (e117082)
Feature-server image is missing mysql dependency for mysql registry (#3223) (ae37b20)
Fix handling of TTL in Go server (#3232) (f020630)
Fix materialization when running on Spark cluster. (#3166) (175fd25)
Fix push API to respect feature view's already inferred entity types (#3172) (7c50ab5)
Fix release workflow (#3144) (20a9dd9)
Fix Shopify timestamp bug and add warnings to help with debugging entity registration (#3191) (de75971)
Handle complex Spark data types in SparkSource (#3154) (5ddb83b)
Local staging location provision (#3195) (cdf0faf)
Remove bad snowflake offline store method (#3204) (dfdd0ca)
Remove opening file object when validating S3 parquet source (#3217) (a906018)
Snowflake config file search error (#3193) (189afb9)
Update Snowflake Online docs (#3206) (7bc1dff)

Features

Add to_remote_storage functionality to SparkOfflineStore (#3175) (2107ce2)
Add ability to give boto extra args for registry config (#3219) (fbc6a2c)
Add health endpoint to py server (#3202) (43222f2)
Add snowflake support for date & number with scale (#3148) (50e8755)
Add tag kwarg to set Snowflake online store table path (#3176) (39aeea3)
Add workgroup to athena offline store config (#3139) (a752211)
Implement spark materialization engine (#3184) (a59c33a)

0.24.0 (2022-08-25)

Bug Fixes

Check if on_demand_feature_views is an empty list rather than None for snowflake provider (#3046) (9b05e65)
FeatureStore.apply applies BatchFeatureView correctly (#3098) (41be511)
Fix Feast Java inconsistency with int64 serialization vs python (#3031) (4bba787)
Fix feature service inference logic (#3089) (4310ed7)
Fix field mapping logic during feature inference (#3067) (cdfa761)
Fix incorrect on demand feature view diffing and improve Java tests (#3074) (0702310)
Fix Java helm charts to work with refactored logic. Fix FTS image (#3105) (2b493e0)
Fix on demand feature view output in feast plan + Web UI crash (#3057) (bfae6ac)
Fix release workflow to release 0.24.0 (#3138) (a69aaae)
Fix Spark offline store type conversion to arrow (#3071) (b26566d)
Fixing Web UI, which fails for the SQL registry (#3028) (64603b6)
Force Snowflake Session to Timezone UTC (#3083) (9f221e6)
Make infer dummy entity join key idempotent (#3115) (1f5b1e0)
More explicit error messages (#2708) (e4d7afd)
Parse inline data sources (#3036) (c7ba370)
Prevent overwriting existing file during persist (#3088) (69af21f)
Register BatchFeatureView in feature repos correctly (#3092) (b8e39ea)
Return an empty infra object from sql registry when it doesn't exist (#3022) (8ba87d1)
Teardown tables for Snowflake Materialization testing (#3106) (0a0c974)
UI error when saved dataset is present in registry. (#3124) (83cf753)
Update sql.py (#3096) (2646a86)
Updated snowflake template (#3130) (f0594e1)

Features

Add authentication option for snowflake connector (#3039) (74c75f1)
Add Cassandra/AstraDB online store contribution (#2873) (feb6cb8)
Add Snowflake materialization engine (#2948) (f3b522b)
Adding saved dataset capabilities for Postgres (#3070) (d3253c3)
Allow passing repo config path via flag (#3077) (0d2d951)
Contrib azure provider with synapse/mssql offline store and Azure registry store (#3072) (9f7e557)
Custom Docker image for Bytewax batch materialization (#3099) (cdd1b07)
Feast AWS Athena offline store (again) (#3044) (989ce08)
Implement spark offline store offline_write_batch method (#3076) (5b0cc87)
Initial Bytewax materialization engine (#2974) (55c61f9)
Refactor feature server helm charts to allow passing feature_store.yaml in environment variables (#3113) (85ee789)

0.23.0 (2022-08-02)

Bug Fixes

Add dummy alias to pull_all_from_table_or_query (#2956) (5e45228)
Bump version of Guava to mitigate cve (#2896) (51df8be)
Change numpy version on setup.py and upgrade it to resolve dependabot warning (#2887) (80ea7a9)
Change the feature store plan method to public modifier (#2904) (0ec7d1a)
Deprecate 3.7 wheels and fix verification workflow (#2934) (040c910)
Do not allow same column to be reused in data sources (#2965) (661c053)
Fix build wheels workflow to install apache-arrow correctly (#2932) (bdeb4ae)
Fix file offline store logic for feature views without ttl (#2971) (26f6b69)
Fix grpc and update protobuf (#2894) (86e9efd)
Fix night ci syntax error and update readme (#2935) (b917540)
Fix nightly ci again (#2939) (1603c9e)
Fix the go build and use CgoArrowAllocator to prevent incorrect garbage collection (#2919) (130746e)
Fix typo in CONTRIBUTING.md (#2955) (8534f69)
Fixing broken links to feast documentation on java readme and contribution (#2892) (d044588)
Fixing Spark min / max entity df event timestamps range return order (#2735) (ac55ce2)
Move gcp back to 1.47.0 since grpcio-tools 1.48.0 got yanked from pypi (#2990) (fc447eb)
Refactor testing and sort out unit and integration tests (#2975) (2680f7b)
Remove hard-coded integration test setup for AWS & GCP (#2970) (e4507ac)
Resolve small typo in README file (#2930) (16ae902)
Revert "feat: Add snowflake online store (#2902)" (#2909) (38fd001)
Snowflake_online_read fix (#2988) (651ce34)
Spark source support table with pattern "db.table" (#2606) (3ce5139), closes #2605
Switch mysql log string to use regex (#2976) (5edf4b0)
Update gopy to point to fork to resolve github annotation errors. (#2940) (ba2dcf1)
Version entity serialization mechanism and fix issue with int64 vals (#2944) (d0d27a3)

Features

Add an experimental lambda-based materialization engine (#2923) (6f79069)
Add column reordering to write_to_offline_store (#2876) (8abc2ef)
Add custom JSON table tab w/ formatting (#2851) (0159f38)
Add CustomSourceOptions to SavedDatasetStorage (#2958) (23c09c8)
Add Go option to feast serve command (#2966) (a36a695)
Add interfaces for batch materialization engine (#2901) (38b28ca)
Add pages for individual Features to the Feast UI (#2850) (9b97fca)
Add snowflake online store (#2902) (f758f9e), closes #2903
Add Snowflake online store (again) (#2922) (2ef71fc), closes #2903
Add to_remote_storage method to RetrievalJob (#2916) (109ee9c)
Support retrieval from multiple feature views with different join keys (#2835) (056cfa1)

0.22.0 (2022-06-29)

Bug Fixes

Add columns for user metadata in the tables (#2760) (269055e)
Add project columns in the SQL Registry (#2784) (336fdd1)
Add S3FS dependency (which Dask depends on for S3 files) (#2701) (5d6fa94)
Bugfixes for how registry is loaded (#2768) (ecb8b2a)
Conversion of null timestamp from proto to python (#2814) (cb23648)
Correct feature statuses during feature logging test (#2709) (cebf609)
Correctly generate projects-list.json when calling feast ui and using postgres as a source (#2845) (bee8076)
Dynamodb drops missing entities when batching (#2802) (a2e9209)
Enable faulthandler and disable flaky tests (#2815) (4934d84)
Explicitly translate errors when instantiating the go fs (#2842) (7a2c4cd)
Fix broken roadmap links (#2690) (b3ba8aa)
Fix bugs in applying stream feature view and retrieving online features (#2754) (d024e5e)
Fix Feast UI failure with new way of specifying entities (#2773) (0d1ac01)
Fix feature view getitem for feature services (#2769) (88cc47d)
Fix issue when user specifies a port for feast ui (#2692) (1c621fe)
Fix macos wheel version for 310 and also checkout edited go files (#2890) (bdf170f)
Fix on demand feature view crash from inference when it uses df.apply (#2713) (c5539fd)
Fix SparkKafkaProcessor query_timeout parameter (#2789) (a8d282d)
Fix workflow syntax error (#2869) (fae45a1)
Fixed custom S3 endpoint read fail (#2786) (6fec431)
Go install gopy instead using go mod tidy (#2863) (2f2b519)
Hydrate infra object in the sql registry proto() method (#2782) (452dcd3)
Implement apply_materialization and infra methods in sql registry (#2775) (4ed107c)
Minor refactor to format exception message (#2764) (da763c6)
Prefer installing gopy from feast's fork as opposed to upstream (#2839) (34c997d)
Python server is not correctly starting in integration tests (#2706) (7583a0b)
Random port allocation for python server in tests (#2710) (dee8090)
Refactor test to reuse LocalRegistryFile (#2763) (4339c0a)
Revert "chore(release): release 0.22.0" (#2852) (e6a4636)
Stop running go mod tidy in setup.py (#2877) (676ecbb), closes /github.com/pypa/cibuildwheel/issues/189#issuecomment-549933912
Support push sources in stream feature views (#2704) (0d60eaa)
Sync publish and build_wheels workflow to fix verify wheel error. (#2871) (b0f050a)
Update roadmap with stream feature view rfc (#2824) (fc8f890)
Update udf tests and add base functions to streaming fcos and fix some nonetype errors (#2776) (331a214)

Features

Add feast repo-upgrade for automated repo upgrades (#2733) (a3304d4)
Add file write_to_offline_store functionality (#2808) (c0e2ad7)
Add http endpoint to the Go feature server (#2658) (3347a57)
Add simple TLS support in Go RedisOnlineStore (#2860) (521488d)
Add StreamProcessor and SparkKafkaProcessor as contrib (#2777) (83ab682)
Added Spark support for Delta and Avro (#2757) (7d16516)
CLI interface for validation of logged features (#2718) (c8b11b3)
Enable stream feature view materialization (#2798) (a06700d)
Enable stream feature view materialization (#2807) (7d57724)
Implement offline_write_batch for BigQuery and Snowflake (#2840) (97444e4)
Offline push endpoint for pushing to offline stores (#2837) (a88cd30)
Push to Redshift batch source offline store directly (#2819) (5748a8b)
Scaffold for unified push api (#2796) (1bd0930)
SQLAlchemy Registry Support (#2734) (b3fe39c)
Stream Feature View FCOS (#2750) (0cf3c92)
Update stream fcos to have watermark and sliding interval (#2765) (3256952)
Validating logged features via Python SDK (#2640) (2874fc5)

Reverts

Revert "chore(release): release 0.22.0" (#2891) (e5abf58), closes #2891
Revert "chore(release): release 0.22.0" (#2870) (ffb0892), closes #2870
Revert "Create main.yml" (#2867) (47922a4), closes #2867

0.21.0 (2022-05-13)

Bug Fixes

Addresses ZeroDivisionError when materializing file source with same timestamps (#2551) (1e398d9)
Asynchronously refresh registry for the feast ui command (#2672) (1b09ca2)
Build platform specific python packages with ci-build-wheel (#2555) (b10a4cf)
Delete data sources from registry when using the diffing logic (#2669) (fc00ca8)
Enforce kw args featureservice (#2575) (160d7b7)
Enforce kw args in datasources (#2567) (0b7ec53)
Feature logging to Redshift is broken (#2655) (479cd51)
Feature service to templates (#2649) (1e02066)
Feature with timestamp type is incorrectly interpreted by Go FS (#2588) (e3d9588)
Fix __hash__ methods (#2556) (ebb7dfe)
Fix AWS bootstrap template (#2604) (c94a69c)
Fix broken proto conversion methods for data sources (#2603) (00ed65a)
Fix case where on demand feature view tab is broken if no custom tabs are passed. (#2682) (01d3568)
Fix DynamoDB fetches when there are entities that are not found (#2573) (7076fe0)
Fix Feast UI parser to work with new APIs (#2668) (8d76751)
Fix java server after odfv update (#2602) (0ca6297)
Fix materialization with ttl=0 bug (#2666) (ab78702)
Fix push sources and add docs / tests pushing via the python feature server (#2561) (e8e418e)
Fixed data mapping errors for Snowflake (#2558) (53c2ce2)
Forcing ODFV udfs to be main module and fixing false positive duplicate data source warning (#2677) (2ce33cd)
Include the ui/build directory, and remove package data (#2681) (0384f5f)
Infer features for feature services when they depend on feature views without schemas (#2653) (87c194c)
Pin dependencies to nearest major version (#2647) (bb72b7c)
Pin pip<22.1 to get around breaking change in pip==22.1 (#2678) (d3e01bc)
Punt deprecation warnings and clean up some warnings. (#2670) (f775d2e)
Reject undefined features when using get_historical_features or get_online_features (#2665) (36849fb)
Remove ci extra from the feature transformation server dockerfile (#2618) (25613b4)
Remove incorrect call to logging.basicConfig (#2676) (8cbf51c)
Small typo in CLI (#2578) (f372981)
Switch from join_key to join_keys in tests and docs (#2580) (d66c931)
Teardown trino container correctly after tests (#2562) (72f1558)
Update build_go_protos to use a consistent python path (#2550) (f136f8c)
Update data source timestamp inference error message to make sense (#2636) (3eaf6b7)
Update field api to add tag parameter corresponding to labels in Feature. (#2610) (689d20b)
Update java integration tests and add more logging (#2637) (10e23b4)
Update on demand feature view api (#2587) (38cd7f9)
Update RedisCluster to use redis-py official implementation (#2554) (ce5606f)
Use cwd when getting module path (#2577) (b550e59)
Use ParquetDataset for Schema Inference (#2686) (4f85e3e)
Use timestamp type when converting unixtimestamp feature type to arrow (#2593) (c439611)

Features

Add hbase online store support in feast (#2590) (c9eda79)
Adding SSL options for Postgres (#2644) (0e809c2)
Allow Feast UI to be spun up with CLI command: feast ui (#2667) (44ca9f5)
Allow to pass secrets and environment variables to transformation service (#2632) (ffa33ad)
CLI command 'feast serve' should start go-based server if flag is enabled (#2617) (f3ff812)
Create stream and batch feature view abstractions (#2559) (d1f76e5)
Postgres supported as Registry, Online store, and Offline store (#2401) (ed2f979)
Support entity fields in feature view schema parameter by dropping them (#2568) (c8fcc35)
Write logged features to an offline store (Python API) (#2574) (134dc5f)
Write logged features to Offline Store (Go - Python integration) (#2621) (ccad832)

Reverts

Revert "chore: Deprecate value type (#2611)" (#2643) (4fbdfb1), closes #2611 #2643

0.20.0 (2022-04-14)

Bug Fixes

Add inlined data sources to the top level registry (#2456) (356788a)
Add new value types to types.ts for web ui (#2463) (ad5694e)
Add PushSource proto and Python class (#2428) (9a4bd63)
Add spark to lambda dockerfile (#2480) (514666f)
Added private_key auth for Snowflake (#2508) (c42c9b0)
Added Redshift and Spark typecheck to data_source event_timestamp_col inference (#2389) (04dea73)
Building of go extension fails (#2448) (7d1efd5)
Bump the number of versions bumps expected to 27 (#2549) (ecc9938)
Create init files for the proto-generated python dirs (#2410) (e17028d)
Don't prevent apply from running given duplicate empty names in data sources. Also fix repeated apply of Spark data source. (#2415) (b95f441)
Dynamodb deduplicate batch write request by partition keys (#2515) (70d4a13)
Ensure that init files exist in proto dirs (#2433) (9b94f7b)
Fix DataSource constructor to unbreak custom data sources (#2492) (712653e)
Fix default feast apply path without any extras (#2373) (6ba7fc7)
Fix definitions.py with new definition (#2541) (eefc34a)
Fix entity row to use join key instead of name (#2521) (c22fa2c)
Fix Java Master (#2499) (e083458)
Fix registry proto (#2435) (ea6a9b2)
Fix some inconsistencies in the docs and comments in the code (#2444) (ad008bf)
Fix spark docs (#2382) (d4a606a)
Fix Spark template to work correctly on feast init -t spark (#2393) (ae133fd)
Fix the feature repo fixture used by java tests (#2469) (32e925e)
Fix unhashable Snowflake and Redshift sources (cd8f1c9)
Fixed bug in passing config file params to snowflake python connector (#2503) (34f2b59)
Fixing Spark template to include source name (#2381) (a985f1d)
Make name a keyword arg for the Entity class (#2467) (43847de)
Making a name for data sources not a breaking change (#2379) (71d7ae2)
Minor link fix in CONTRIBUTING.md (#2481) (2917e27)
Preserve ordering of features in _get_column_names (#2457) (495b435)
Relax click python requirement to >=7 (#2450) (f202f92)
Remove date partition column field from datasources that don't s… (#2478) (ce35835)
Remove docker step from unit test workflow (#2535) (6f22f22)
Remove spark from the AWS Lambda dockerfile (#2498) (6abae16)
Request data api update (#2488) (0c9e5b7)
Schema update (#2509) (cf7bbc2)
Simplify DataSource.from_proto logic (#2424) (6bda4d2)
Snowflake api update (#2487) (1181a9e)
Support passing batch source to streaming sources for backfills (#2523) (90db1d1)
Timestamp update (#2486) (bf23111)
Typos in Feast UI error message (#2432) (e14369d)
Update feature view APIs to prefer keyword args (#2472) (7c19cf7)
Update file api (#2470) (83a11c6)
Update Makefile to cd into python dir before running commands (#2437) (ca32155)
Update redshift api (#2479) (4fa73a9)
Update some fields optional in UI parser (#2380) (cff7ac3)
Use a single version of jackson libraries and upgrade to 2.12.6.1 (#2473) (5be1cc6)
Use dateutil parser to parse materialization times (#2464) (6c55e49)
Use the correct dockerhub image tag when building feature servers (#2372) (0d62c1d)

Features

Add /write-to-online-store method to the python feature server (#2423) (d2fb048)
Add description, tags, owner fields to all feature view classes (#2440) (ed5e928)
Add DQM Logging on GRPC Server with FileLogStorage for Testing (#2403) (57a97d8)
Add Feast types in preparation for changing type system (#2475) (4864252)
Add Field class (#2500) (1279612)
Add support for DynamoDB online_read in batches (#2371) (702ec49)
Add Support for DynamodbOnlineStoreConfig endpoint_url parameter (#2485) (7b863d1)
Add templating for dynamodb table name (#2394) (f591088)
Allow local feature server to use Go feature server if enabled (#2538) (a2ef375)
Allow using entity's join_key in get_online_features (#2420) (068c765)
Data Source Api Update (#2468) (6b96b21)
Go server (#2339) (d12e7ef), closes #2354 #2361 #2332 #2356 #2363 #2349 #2355 #2336 #2361 #2363 #2344 #2354 #2347 #2350 #2356 #2355 #2349 #2352 #2341 #2336 #2373 #2315 #2372 #2332 #2349 #2336 #2361 #2363 #2344 #2354 #2347 #2350 #2356 #2355 #2349 #2352 #2341 #2336 #2373 #2379 #2380 #2382 #2364 #2366 #2386
Graduate write_to_online_store out of experimental status (#2426) (e7dd4b7)
Make feast PEP 561 compliant (#2405) (3c41f94), closes #2420 #2418 #2425 #2426 #2427 #2431 #2433 #2420 #2418 #2425 #2426 #2427 #2431 #2433
Makefile for contrib for Issue #2364 (#2366) (a02325b)
Support on demand feature views in go feature server (#2494) (6edd274)
Switch from Feature to Field (#2514) (6a03bed)
Use a daemon thread to monitor the go feature server exclusively (#2391) (0bb5e8c)

0.19.0 (2022-03-05)

Bug Fixes

Added additional value types to UI parser and removed references to registry-bq.json (#2361) (d202d51)
Fix Redshift bug that stops waiting on statements after 5 minutes (#2363) (74f887f)
Method _should_use_plan only returns true for local sqlite provider (#2344) (fdb5f21)
Remove redis service to prevent more conflicts and add redis node to master_only (#2354) (993616f)
Rollback Redis-py to Redis-py-cluster (#2347) (1ba86fb)
Update github workflow to prevent redis from overlapping ports. (#2350) (c2a6c6c)

Features

Add owner field to Entity and rename labels to tags (412d625)
Allow all snowflake python connector connection methods to be available to Feast (#2356) (ec7385c)
Allowing password based authentication and SSL for Redis in Java feature server (0af8adb)
Event timestamps response (#2355) (5481caf)
Feast Spark Offline Store (#2349) (98b8d8d)
Initial merge of Web UI logic (#2352) (ce3bc59)
Key ttl setting for redis online store (#2341) (236a108)
Metadata changes & making data sources top level objects to power Feast UI (#2336) (43da230)

v0.18.1 (2022-02-15)

Full Changelog

Bug Fixes

ODFVs raise a PerformanceWarning for very large sets of features #2293
Don't require snowflake to always be installed #2309 (judahrand)
podAnnotations Values in the feature-server chart #2304 (tpvasconcelos)
Fixing the Java helm charts and adding a demo tutorial on how to use them #2298 (adchia)
avoid using transactions on OSS Redis #2296 (DvirDukhan)
Include infra objects in registry dump and fix Infra's from_proto #2295 (adchia)
Expose snowflake credentials for unit testing #2288 (sfc-gh-madkins)
Fix flaky tests (test_online_store_cleanup & test_feature_get_online_features_types_match) #2276 (pyalex)

Merged Pull Requests

Remove old flag warning with the python feature server #2300 (adchia)
Use an OFFLINE schema for Snowflake offline store tests #2291 (sfc-gh-madkins)
fix typos in markdown files #2289 (charliec443)
Add -SNAPSHOT suffix to pom.xml version #2286 (tsotnet)
Update CONTRIBUTING.md #2282 (adchia)

v0.18.0 (2022-02-05)

Full Changelog

Features

Tutorial on validation of historical features #2277 (pyalex)
Feast plan clean up #2256 (felixwang9817)
Return UNIX\_TIMESTAMP as Python datetime #2244 (judahrand)
Validating historical features against reference dataset with "great expectations" profiler #2243 (pyalex)
Implement feature_store._apply_diffs to handle registry and infra diffs #2238 (felixwang9817)
Compare Python objects instead of proto objects #2227 (felixwang9817)
Modify feature_store.plan to produce an InfraDiff #2211 (felixwang9817)
Implement diff_infra_protos method for feast plan #2204 (felixwang9817)
Persisting results of historical retrieval #2197 (pyalex)
Merge feast-snowflake plugin into main repo with documentation #2193 (sfc-gh-madkins)
Add InfraDiff class for feast plan #2190 (felixwang9817)
Use FeatureViewProjection instead of FeatureView in ODFV #2186 (judahrand)

Bug Fixes

Set created\_timestamp and last\_updated\_timestamp fields #2266 (judahrand)
Use datetime.utcnow\(\) to avoid timezone issues #2265 (judahrand)
Fix Redis key serialization in java feature server #2264 (pyalex)
modify registry.db s3 object initialization to work in S3 subdirectory with Java Feast Server #2259 (NalinGHub)
Add snowflake environment variables to allow testing on snowflake infra #2258 (sfc-gh-madkins)
Correct inconsistent dependency #2255 (judahrand)
Fix for historical field mappings #2252 (michelle-rascati-sp)
Add backticks to left_table_query_string #2250 (dmille)
Fix inference of BigQuery ARRAY types. #2245 (judahrand)
Fix Redshift data creator #2242 (felixwang9817)
Delete entity key from Redis only when all attached feature views are gone #2240 (pyalex)
Tests for transformation service integration in java feature server #2236 (pyalex)
Feature server helm chart produces invalid YAML #2234 (pyalex)
Docker build fails for java feature server #2230 (pyalex)
Fix ValueType.UNIX_TIMESTAMP conversions #2219 (judahrand)
Add on demand feature views deletion #2203 (corentinmarek)
Compare only specs in integration tests #2200 (felixwang9817)
Bump log4j-core from 2.17.0 to 2.17.1 in /java #2189 (dependabot[bot])
Support multiple application properties files (incl from classpath) #2187 (pyalex)
Avoid requesting features from OnlineStore twice #2185 (judahrand)
Speed up Datastore deletes by batch deletions with multithreading #2182 (ptoman-pa)
Fixes large payload runtime exception in Datastore (issue 1633) #2181 (ptoman-pa)

Merged Pull Requests

Add link to community plugin for Spark offline store #2279 (adchia)
Fix broken links on documentation #2278 (adchia)
Publish alternative python package with FEAST_USAGE=False by default #2275 (pyalex)
Unify all helm charts versions #2274 (pyalex)
Fix / update helm chart workflows to push the feast python server #2273 (adchia)
Update Feast Serving documentation with ways to run and debug locally #2272 (adchia)
Fix Snowflake docs #2270 (felixwang9817)
Update local-feature-server.md #2269 (tsotnet)
Update docs to include Snowflake/DQM and removing unused docs from old versions of Feast #2268 (adchia)
Graduate Python feature server #2263 (felixwang9817)
Fix benchmark tests at HEAD by passing in Snowflake secrets #2262 (adchia)
Refactor pa\_to\_feast\_value\_type #2246 (judahrand)
Allow using pandas.StringDtype to support on-demand features with STRING type #2229 (pyalex)
Bump jackson-databind from 2.10.1 to 2.10.5.1 in /java/common #2228 (dependabot[bot])
Split apply total parse repo #2226 (mickey-liu)
Publish renamed java packages to maven central (via Sonatype) #2225 (pyalex)
Make online store nullable #2224 (mirayyuce)
Optimize \_populate\_result\_rows\_from\_feature\_view #2223 (judahrand)
Update to newer redis-py #2221 (judahrand)
Adding a local feature server test #2217 (adchia)
replace GetOnlineFeaturesResponse with GetOnlineFeaturesResponseV2 in… #2214 (tsotnet)
Updates to click==8.* #2210 (diogommartins)
Bump protobuf-java from 3.12.2 to 3.16.1 in /java #2208 (dependabot[bot])
Add default priority for bug reports #2207 (adchia)
Modify issue templates to automatically attach labels #2205 (adchia)
Python FeatureServer optimization #2202 (judahrand)
Refactor all importer logic to belong in feast.importer #2199 (felixwang9817)
Refactor OnlineResponse.to\_dict\(\) #2196 (judahrand)
[Java feature server] Converge ServingService API to make Python and Java feature servers consistent #2166 (pyalex)
Add a unit test for the tag_proto_objects method #2163 (achals)

v0.17.0 (2021-12-31)

Full Changelog

Features

Add feast-python-server helm chart #2177 (michelle-rascati-sp)
Add SqliteTable as an InfraObject #2157 (felixwang9817)
Compute property-level diffs for repo objects #2156 (achals)
Add a feast plan command, and have CLI output differentiates between created, deleted and unchanged objects #2147 (achals)
Refactor tag methods to infer created, deleted, and kept repo objects #2142 (achals)
Add DatastoreTable infra object #2140 (felixwang9817)
Dynamodb infra object #2131 (felixwang9817)
Add Infra and InfraObjects classes #2125 (felixwang9817)
Pre compute the timestamp range for feature views #2103 (judahrand)

Bug Fixes

Fix issues with java docker building #2178 (achals)
unpin boto dependency in setup #2168 (fengyu05)
Fix issue with numpy datetimes in feast_value_type_to_pandas_type #2167 (achals)
Fix BYTES and BYTES_LIST type conversion #2158 (judahrand)
Use correct name when deleting dynamo table #2154 (pyalex)
Bump log4j-core from 2.15.0 to 2.16.0 in /java #2146 (dependabot[bot])
Bump log4j-api from 2.15.0 to 2.16.0 in /java #2145 (dependabot[bot])
Respect full_feature_names for ODFVs #2144 (judahrand)
Cache dynamodb client and resource in DynamoDB online store implement… #2138 (felixwang9817)
Bump log4j-api from 2.13.2 to 2.15.0 in /java #2133 (dependabot[bot])
Fix release workflow to use the new GCP action #2132 (adchia)
Remove spring-boot from the feast serving application #2127 (achals)
Fix Makefile to properly create the ECR_VERSION #2123 (adchia)

Closes Issues

In GH workflow docker images are being built but not published #2152
Any plan to make Feast 0.10+ support docker #2148
ODFVs don't respect full_feature_names #2143
Release workflow does not work #2136
Redis Online Store - Truncate and Load #2129

Merged Pull Requests

Update roadmap to include Snowflake + Trino. Also fix docs + update FAQ #2175 (adchia)
Convert python values into proto values in bulk #2172 (pyalex)
Push docker image after build in GH workflow #2171 (pyalex)
Improve serialization performance #2165 (judahrand)
Improve online deserialization latency #2164 (judahrand)
Add a unit test for the tag_proto_objects method #2163 (achals)
Bump log4j-core from 2.16.0 to 2.17.0 in /java #2161 (dependabot[bot])
[Java Feature Server] Use hgetall in redis connector when number of retrieved fields is big enough #2159 (pyalex)
Do not run benchmarks on pull requests #2155 (felixwang9817)
Ensure that universal CLI test tears down infrastructure #2151 (felixwang9817)
Remove underscores from ECR docker versions #2139 (achals)
Run PR integration tests only on python 3.7 #2137 (achals)
Update changelog for 0.16.1 and update helm charts #2135 (adchia)
Bump log4j-core from 2.13.2 to 2.15.0 in /java #2134 (dependabot[bot])
Updating lambda docker image to feature-server-python-aws #2130 (adchia)
Fix README to reflect new integration test suites #2124 (adchia)
Change the feast serve endpoint to be sync rather than async. #2119 (nossrannug)
Remove argument feature_refs #2115 (judahrand)
Fix leaking dynamodb tables in integration tests #2104 (pyalex)
Remove untested and undocumented interfaces #2084 (judahrand)
Update creating-a-custom-provider.md #2070 (ChaitanyaKN)

v0.16.1 (2021-12-10)

Full Changelog

Bug Fixes

Bump log4j-api from 2.13.2 to 2.15.0 in /java #2133 (dependabot[bot])
Fix release workflow to use the new GCP action #2132 (adchia)
Fix Makefile to properly create the ECR_VERSION #2123 (adchia)

Merged Pull Requests

Updating lambda docker image to feature-server-python-aws #2130 (adchia)
Fix README to reflect new integration test suites #2124 (adchia)
Remove argument feature_refs #2115 (judahrand)

v0.16.0 (2021-12-08)

Full Changelog

Features

Install redis extra in AWS Lambda feature server & add hiredis depend… #2057 (tsotnet)
Support of GC and S3 storages for registry in Java Feature Server #2043 (pyalex)
Adding stream ingestion alpha documentation #2005 (adchia)

Bug Fixes

requested_features are not passed to online_read() from passthrough_provider #2106
feast apply broken with 0.15.* if the registry already exists #2086
Inconsistent logic with on_demand_feature_views #2072
Fix release workflow to pass the python version and docker build targets #2122 (adchia)
requested_features is passed to online_read from passthrough_provider #2107 (aurobindoc)
Don't materialize FeatureViews where online is False #2101 (judahrand)
Have apply_total use the repo_config that's passed in as a parameter (makes it more compatible with custom wrapper code) #2099 (mavysavydav)
Do not attempt to compute ODFVs when there are no ODFVs #2090 (felixwang9817)
Duplicate feast apply bug #2087 (felixwang9817)
Add --host as an option for feast serve #2078 (nossrannug)
Fix feature server docker image tag generation in pr integration tests #2077 (tsotnet)
Fix ECR Image build on master branch #2076 (tsotnet)
Optimize memory usage during materialization #2073 (judahrand)
Fix unexpected feature view deletion when applying edited odfv #2054 (ArrichM)
Properly exclude entities from feature inference #2048 (mavysavydav)
Don't allow FeatureStore.apply with commit=False #2047 (nossrannug)
Fix bug causing OnDemandFeatureView.infer_features() to fail when the… #2046 (ArrichM)
Add missing comma in setup.py #2031 (achals)
Correct cleanup after usage e2e tests #2015 (pyalex)
Change Environment timestamps to be in UTC #2007 (felixwang9817)
get_online_features on demand transform bug fixes + local integration test mode #2004 (adchia)
Always pass full and partial feature names to ODFV #2003 (judahrand)
ODFV UDFs should handle list types #2002 (Agent007)
Update bq_to_feast_value_type with BOOLEAN type as a legacy sql data type #1996 (mavysavydav)
Fix bug where using some Pandas dtypes in the output of an ODFV fails #1994 (judahrand)
Fix duplicate update infra #1990 (felixwang9817)
Improve performance of _convert_arrow_to_proto #1984 (nossrannug)

Merged Pull Requests

Add changelog for v0.16.0 #2120 (adchia)
Update FAQ #2118 (felixwang9817)
Move helm chart back to main repo #2113 (pyalex)
Set package long description encoding to UTF-8 #2111 (danilopeixoto)
Update release workflow to include new docker images #2108 (adchia)
Use the maintainers group in Codeowners instead of individuals #2102 (achals)
Remove tfx schema from ValueType #2098 (pyalex)
Add data source implementations to RTD docs #2097 (felixwang9817)
Updated feature view documentation to include blurb about feature inferencing #2096 (mavysavydav)
Fix integration test that is unstable due to incorrect materialization boundaries #2095 (pyalex)
Broaden google-cloud-core dependency #2094 (ptoman-pa)
Use pip-tools to lock versions of dependent packages #2093 (ysk24ok)
Fix typo in feature retrieval doc #2092 (olivierlabreche)
Fix typo in FeatureView example (doc) #2091 (olivierlabreche)
Use request.addfinalizer instead of the yield based approach in integ tests #2089 (achals)
Odfv logic #2088 (felixwang9817)
Refactor _convert_arrow_to_proto #2085 (judahrand)
Add github run id into the integration test projects for debugging #2069 (achals)
Fixing broken entity key link in quickstart #2068 (adchia)
Fix java_release workflow by removing step without users/with #2067 (achals)
Allow using cached registry when writing to the online store #2066 (achals)
Raise import error when repo configs module cannot be imported #2065 (felixwang9817)
Remove refs to tensorflow_metadata #2063 (achals)
Add detailed error messages for test_univerisal_e2e failures #2062 (achals)
Remove unused protos & deprecated java modules #2061 (pyalex)
Asynchronously refresh registry in transformation service #2060 (pyalex)
Fix GH workflow for docker build of java parts #2059 (pyalex)
Dedicated workflow for java PRs #2050 (pyalex)
Run java integration test with real google cloud and aws #2049 (pyalex)
Fixing typo enabling on_demand_transforms #2044 (ArrichM)
Make feast registry-dump print the whole registry as one json #2040 (nossrannug)
Remove tensorflow-metadata folders #2038 (casassg)
Update CHANGELOG for Feast v0.15.1 #2034 (felixwang9817)
Remove unsupported java parts #2029 (pyalex)
Fix checked out branch for PR docker image build workflow #2018 (tsotnet)
Extend "feast in production" page with description of java feature server #2017 (pyalex)
Remove duplicates in setup.py and run rudimentary verifications #2016 (achals)
Upload feature server docker image to ECR on approved PRs #2014 (tsotnet)
GitBook: [#1] Plugin standards documentation #2011 (felixwang9817)
Add changelog for v0.15.0 #2006 (adchia)
Add integration tests for AWS Lambda feature server #2001 (tsotnet)

v0.15.1 (2021-11-13)

Full Changelog

Bug Fixes

Add missing comma in setup.py #2031 (achals)
Correct cleanup after usage e2e tests #2015 (pyalex)
Change Environment timestamps to be in UTC #2007 (felixwang9817)
ODFV UDFs should handle list types #2002 (Agent007)

Merged Pull Requests

Remove unsupported java parts #2029 (pyalex)
Fix checked out branch for PR docker image build workflow #2018 (tsotnet)
Remove duplicates in setup.py and run rudimentary verifications #2016 (achals)
Upload feature server docker image to ECR on approved PRs #2014 (tsotnet)
Add integration tests for AWS Lambda feature server #2001 (tsotnet)
Moving Feast Java back into main repo under java/ package #1997 (adchia)

v0.15.0 (2021-11-08)

Full Changelog

Features

Adding stream ingestion alpha documentation #2005 (adchia)
Feature transformation server docker image #1972 (felixwang9817)
eventtime check before writing features, use pipelines, ttl #1961 (vas28r13)
Plugin repo universal tests #1946 (felixwang9817)
direct data ingestion into Online store #1939 (vas28r13)
Add an interface for TransformationService and a basic implementation #1932 (achals)
Allows registering of features in request data as RequestFeatureView. Refactors common logic into a BaseFeatureView class #1931 (adchia)
Add final_output_feature_names in Query context to avoid SELECT * EXCEPT #1911 (MattDelac)
Add Dockerfile for GCP CloudRun FeatureServer #1887 (judahrand)

Bug Fixes

feast=0.14.0 query_generator() unecessary used twice #1978
get_online_features on demand transform bug fixes + local integration test mode #2004 (adchia)
Always pass full and partial feature names to ODFV #2003 (judahrand)
Update bq_to_feast_value_type with BOOLEAN type as a legacy sql data type #1996 (mavysavydav)
Fix bug where using some Pandas dtypes in the output of an ODFV fails #1994 (judahrand)
Fix duplicate update infra #1990 (felixwang9817)
Improve performance of _convert_arrow_to_proto #1984 (nossrannug)
Fix duplicate upload entity #1981 (achals)
fix redis cluster materialization #1968 (qooba)
Allow plugin repos to actually overwrite repo configs #1966 (felixwang9817)
Delete keys from Redis when tearing down online store #1965 (achals)
Fix issues with lint test and upgrade pip version #1964 (felixwang9817)
Move IntegrationTestRepoConfig class to another module #1962 (felixwang9817)
Solve package conflict in [gcp] and [ci] #1955 (ysk24ok)
Remove some paths from unit test cache #1944 (achals)
Fix bug in feast alpha enable CLI command #1940 (felixwang9817)
Fix conditional statements for if OnDemandFVs exist #1937 (codyjlin)
Fix __getitem__ return value for feature view and on-demand feature view #1936 (mavysavydav)
Corrected setup.py BigQuery version that's needed for a contributor's merged PR 1844 #1934 (mavysavydav)

Merged Pull Requests

Fix protobuf version conflict in [gcp] and [ci] packages #1992 (ysk24ok)
Improve aws lambda deployment (logging, idempotency, etc) #1985 (tsotnet)
Extend context for usage statistics collection & add latencies for performance analysis #1983 (pyalex)
Update CHANGELOG for Feast v0.14.1 #1982 (felixwang9817)
Document AWS Lambda permissions #1970 (tsotnet)
Update online store helper docstring #1957 (amommendes)
Add public docs for entity aliasing #1951 (codyjlin)
Updating roadmap + hero image #1950 (adchia)
Add David and Matt as approvers as well #1943 (achals)
Add David and Matt as reviewers, and add actions for issue/PR assignment #1942 (achals)
Simplify BigQuery load jobs #1935 (judahrand)

v0.14.1 (2021-10-28)

Full Changelog

Bug Fixes

Fix duplicate upload entity #1981 (achals)
Fix bug in feast alpha enable CLI command #1940 (felixwang9817)
Fix conditional statements for if OnDemandFVs exist #1937 (codyjlin)
Fix __getitem__ return value for feature view and on-demand feature view #1936 (mavysavydav)
Corrected setup.py BigQuery version that's needed for a contributor's merged PR 1844 #1934 (mavysavydav)

Merged Pull Requests

Updating roadmap + hero image #1950 (adchia)
Simplify BigQuery load jobs #1935 (judahrand)

v0.14.0 (2021-10-08)

Full Changelog

Features

Changed FVProjection 'name_to_use' field to 'name_alias' and changed '.set_projection' in FeatureView to ".with_projection". Also adjustments for some edge cases #1929 (mavysavydav)
Make serverless alpha feature #1928 (felixwang9817)
Feast endpoint #1927 (felixwang9817)
Add location to BigQueryOfflineStoreConfig #1921 (loftiskg)
Create & teardown Lambda & API Gateway resources for serverless feature server #1900 (tsotnet)
Hide FeatureViewProjections from user interface & have FeatureViews carry FVProjections that carries the modified info of the FeatureView #1899 (mavysavydav)
Upload docker image to ECR during feast apply #1877 (felixwang9817)
Added .with_name method in FeatureView/OnDemandFeatureView classes for name aliasing. FeatureViewProjection will hold this information #1872 (mavysavydav)

Bug Fixes

Update makefile to use pip installed dependencies #1920 (loftiskg)
Delete tables #1916 (felixwang9817)
Set a 5 minute limit for redshift statement execution #1915 (achals)
Use set when parsing repos to prevent duplicates #1913 (achals)
resolve environment variables in repo config #1909 (samuel100)
Respect specified ValueTypes for features during materialization #1906 (Agent007)
Fix issue with feature views being detected as duplicated when imported #1905 (achals)
Use contextvars to maintain a call stack during the usage calls #1882 (achals)

Merged Pull Requests

Update concepts/README.md #1926 (ysk24ok)
Add CI for feature server Docker image #1925 (felixwang9817)
cache provider in feature store instance #1924 (DvirDukhan)
Refactor logging and error messages in serverless #1923 (felixwang9817)
Add a caching step to our github actions #1919 (achals)
Add provider, offline store, online store, registry to RTD #1918 (felixwang9817)
Cleanup tests #1901 (felixwang9817)

v0.13.0 (2021-09-22)

Full Changelog

Breaking Changes

Enforce case-insensitively unique feature view names #1835 (codyjlin)
Add init to Provider contract #1796 (woop)

Features

Add on demand feature view experimental docs #1880 (adchia)
Adding telemetry for on demand feature views and making existing usage calls async #1873 (adchia)
Read registry & config from env variables in AWS Lambda feature server #1870 (tsotnet)
Add feature server configuration for AWS lambda #1865 (felixwang9817)
Add MVP support for on demand transforms for AWS to_s3 and to_redshift #1856 (adchia)
Add MVP support for on demand transforms for bigquery #1855 (adchia)
Add arrow support for on demand feature views #1853 (adchia)
Support adding request data in on demand transforms #1851 (adchia)
Support on demand feature views in feature services #1849 (achals)
Infer features for on demand feature views, support multiple output features #1845 (achals)
Add Registry and CLI operations for on demand feature views #1828 (achals)
Implementing initial on demand transforms for historical retrieval to_df #1824 (adchia)
Registry store plugin #1812 (DvirDukhan)
Enable entityless featureviews #1804 (codyjlin)
Initial scaffolding for on demand feature view #1803 (adchia)
Add s3 support (with custom endpoints) #1789 (woop)
Local feature server implementation (HTTP endpoint) #1780 (tsotnet)

Bug Fixes

Fixing odfv cli group description #1890 (adchia)
Fix list feature format for BigQuery offline datasources. #1889 (judahrand)
Add dill to main dependencies #1886 (judahrand)
Fix pytest_collection_modifyitems to select benchmark tests only #1874 (achals)
Add support for multiple entities in Redshift #1850 (felixwang9817)
Move apply(dummy_entity) to apply time to ensure it persists in FeatureStore #1848 (codyjlin)
Add schema parameter to RedshiftSource #1847 (felixwang9817)
Pass bigquery job object to get_job #1844 (LarsKlingen)
Simplify _python_value_to_proto_value by looking up values in a dict #1837 (achals)
Update historical retrieval integration test for on demand feature views #1836 (achals)
Fix flaky connection to redshift data API #1834 (achals)
Init registry during create_test_environment #1829 (achals)
Randomly generating new BQ dataset for offline_online_store_consistency test #1818 (adchia)
Ensure docstring tests always teardown #1817 (felixwang9817)
Use get_multi instead of get for datastore reads #1814 (achals)
Fix Redshift query for external tables #1810 (woop)
Use a random dataset and table name for simple_bq_source #1801 (achals)
Refactor Environment class and DataSourceCreator API, and use fixtures for datasets and data sources #1790 (achals)
Fix get_online_features telemetry to only log every 10000 times #1786 (felixwang9817)
Add a description field the Feature Service class and proto #1771 (achals)
Validate project name upon feast.apply #1766 (tedhtchang)
Fix BQ historical retrieval with rows that got backfilled #1744 (MattDelac)
Handle case where_LIST type is empty #1703 (judahrand)

Merged Pull Requests

Add ValueType.NULL #1893 (judahrand)
Adding more details to the CONTRIBUTING.md #1888 (adchia)
Parse BQ DATETIME and TIMESTAMP #1885 (judahrand)
Add durations to list the slowest tests #1881 (achals)
Upload benchmark information to S3 after integration test runs #1878 (achals)
Refactor providers to remove duplicate implementations #1876 (achals)
Add Felix & Danny to code owners file #1869 (tsotnet)
Initial docker image for aws lambda feature server #1866 (tsotnet)
Add flags file to include experimental flags and test/usage flags #1864 (adchia)
Hookup pytest-benchmark to online retreival #1858 (achals)
Add feature server docs & small changes in local server #1852 (tsotnet)
Add roadmap to README.md #1843 (woop)
Enable the types test to run on all compatible environments #1840 (adchia)
Update reviewers/approvers to include Danny/Felix #1833 (adchia)
Fix wrong links in README #1832 (baineng)
Remove older offline/online consistency tests #1831 (achals)
Replace individual cli tests with parametrized tests #1830 (achals)
Reducing wait interval for BQ integration tests #1827 (adchia)
Reducing size of universal repo to decrease integration test time #1826 (adchia)
Refactor the datastore online_read method to be slightly more efficient #1819 (achals)
Remove old doc #1815 (achals)
Rename telemetry to usage #1800 (felixwang9817)
Updating quickstart colab to explain more concepts and highlight value prop of Feast #1799 (adchia)
Fix Azure Terraform installation. #1793 (mmurdoch)
Disable integration test reruns to identify flaky tests #1787 (achals)
Rerun failed python integration tests #1785 (achals)
Add Redis to the universal integration tests #1784 (achals)
Add online feature retrieval integration test using the universal repo #1783 (achals)
Fix wrong description in README.md #1779 (WingCode)
Clean up docstring tests #1778 (felixwang9817)
Add offline retrival integration tests using the universal repo #1769 (achals)
Adding initial type support related tests for BQ #1768 (adchia)
Add release-patch script #1554 (jklegar)

v0.12.1 (2021-08-20)

Full Changelog

Bug Fixes

Fix get_online_features telemetry to only log every 10000 times #1786 (felixwang9817)

v0.12.0 (2021-08-05)

Full Changelog

Breaking Changes

Set default feature naming to not include feature view name. Add option to include feature view name in feature naming. #1641 (Mwad22)

Features

AWS Template improvements (input prompt for configs, default to Redshift) #1731 (tsotnet)
Clean up uploaded entities in Redshift offline store #1730 (tsotnet)
Implement Redshift historical retrieval #1720 (tsotnet)
Add custom data sources #1713 (achals)
Added --skip-source-validation flag to feast apply #1702 (mavysavydav)
Allow specifying FeatureServices in FeatureStore methods #1691 (achals)
Implement materialization for RedshiftOfflineStore & RedshiftRetrievalJob #1680 (tsotnet)
Add FeatureService proto definition #1676 (achals)
Add RedshiftDataSource #1669 (tsotnet)
Add streaming sources to the FeatureView API #1664 (achals)
Add to_table() to RetrievalJob object #1663 (MattDelac)
Provide the user with more options for setting the to_bigquery config #1661 (codyjlin)

Bug Fixes

Fix feast apply bugs #1754 (tsotnet)
Teardown integration tests resources for aws #1740 (achals)
Fix GCS version #1732 (potatochip)
Fix unit test warnings related to file_url #1726 (tedhtchang)
Refactor data source classes to fix import issues #1723 (achals)
Append ns time and random integer to redshift test tables #1716 (achals)
Add randomness to bigquery table name #1711 (felixwang9817)
Fix dry_run bug that was making to_bigquery hang indefinitely #1706 (codyjlin)
Stringify WhichOneof to make mypy happy #1705 (achals)
Update redis options parsing #1704 (DvirDukhan)
Cancel BigQuery job if block_until_done call times out or is interrupted #1699 (codyjlin)
Teardown infrastructure after integration tests #1697 (achals)
Fix unit tests that got broken by Pandas 1.3.0 release #1683 (tsotnet)
Remove default list from the FeatureView constructor #1679 (achals)
BQ exception should be raised first before we check the timedout #1675 (MattDelac)
Allow strings for online/offline store instead of dicts #1673 (achals)
Cancel BigQuery job if timeout hits #1672 (MattDelac)
Make sure FeatureViews with same name can not be applied at the same … #1651 (tedhtchang)

Merged Pull Requests

Add AWS docs in summary.md #1761 (tsotnet)
Document permissions for AWS (DynamoDB & Redshift) #1753 (tsotnet)
Adding small note for project naming convention #1752 (codyjlin)
Fix warning in FeatureView.from_proto #1751 (tsotnet)
Add Feature Service to the concepts group #1750 (achals)
Docstring tests #1749 (felixwang9817)
Document how pandas deals with missing values #1748 (achals)
Restore feature refs #1746 (felixwang9817)
Updating CLI apply to use FeatureStore #1745 (adchia)
Delete old code #1743 (felixwang9817)
Bump dependency on pyyaml #1742 (achals)
Docstrings #1739 (felixwang9817)
Add the foundation of the universal feature repo and a test that uses it #1734 (achals)
Add AWS documentation (DynamoDB, Redshift) #1733 (tsotnet)
Change internal references from input to batch_source #1729 (felixwang9817)
Refactor tests into new directory layout #1725 (achals)
Registry teardown #1718 (felixwang9817)
Redirect telemetry to usage #1717 (felixwang9817)
Link to offline and online store specs in docs summary #1715 (achals)
Avoid skewed join between entity_df & feature views #1712 (MattDelac)
Remove type comments #1710 (achals)
Increase efficiency of Registry updates #1698 (felixwang9817)
Parallelize integration tests #1684 (tsotnet)
Remove debug logging #1678 (charliec443)
Docs: Fix Feature References example #1674 (GregKuhlmann)
Rename to_table to to_arrow #1671 (MattDelac)
Small reference documentation update #1668 (nels)
Grouped inferencing statements together in apply methods for easier readability #1667 (mavysavydav)
Infer min and max timestamps from entity_df to limit data read from BQ source #1665 (Mwad22)
Rename telemetry to usage #1660 (tsotnet)
Update charts README #1659 (szalai1)

v0.11.0 (2021-06-24)

Full Changelog

Features

Allow BigQuery project to be configured #1656 (MattDelac)
Add to_bigquery function to BigQueryRetrievalJob #1634 (vtao2)
Add AWS authentication using github actions #1629 (tsotnet)
Introduce an OnlineStore interface #1628 (achals)
Add to_df to convert get_online_feature response to pandas dataframe #1623 (tedhtchang)
Add datastore namespace option in configs #1581 (tsotnet)
Add offline_store config #1552 (tsotnet)
Entity value_type inference for Feature Repo registration #1538 (mavysavydav)
Inferencing of Features in FeatureView and timestamp column of DataSource #1523 (mavysavydav)
Add Unix Timestamp value type #1520 (MattDelac)
Add support for Redis and Redis Cluster #1511 (qooba)
Add path option to cli #1509 (tedhtchang)

Bug Fixes

Schema Inferencing should happen at apply time #1646 (mavysavydav)
Don't use .result() in BigQueryOfflineStore, since it still leads to OOM #1642 (tsotnet)
Don't load entire bigquery query results in memory #1638 (tsotnet)
Remove file loader & its test #1632 (tsotnet)
Provide descriptive error on invalid table reference #1627 (codyjlin)
Fix ttl duration when ttl is None #1624 (MattDelac)
Fix race condition in historical e2e tests #1620 (woop)
Add validations when materializing from file sources #1615 (achals)
Add entity column validations when getting historical features from bigquery #1614 (achals)
Allow telemetry configuration to fail gracefully #1612 (achals)
Update type conversion from pandas to timestamp to support various the timestamp types #1603 (achals)
Add current directory in sys path for CLI commands that might depend on custom providers #1594 (MattDelac)
Fix contention issue #1582 (woop)
Ensure that only None types fail predicate #1580 (woop)
Don't create bigquery dataset if it already exists #1569 (tsotnet)
Don't lose materialization interval tracking when re-applying feature views #1559 (jklegar)
Validate project and repo names for apply and init commands #1558 (tedhtchang)
Bump supported Python version to 3.7 #1504 (tsotnet)

Merged Pull Requests

Rename telemetry to usage #1660 (tsotnet)
Refactor OfflineStoreConfig classes into their owning modules #1657 (achals)
Run python unit tests in parallel #1652 (achals)
Refactor OnlineStoreConfig classes into owning modules #1649 (achals)
Fix table_refs in BigQuerySource definitions #1644 (tsotnet)
Make test historical retrieval longer #1630 (MattDelac)
Fix failing historical retrieval assertion #1622 (woop)
Add a specific error for missing columns during materialization #1619 (achals)
Use drop_duplicates() instead of groupby (about 1.5~2x faster) #1617 (rightx2)
Optimize historical retrieval with BigQuery offline store #1602 (MattDelac)
Use CONCAT() instead of ROW_NUMBER() #1601 (MattDelac)
Minor doc fix in the code snippet: Fix to reference the right instance for the retrieved job instance object #1599 (dmatrix)
Repo and project names should not start with an underscore #1597 (tedhtchang)
Append nanoseconds to dataset name in test_historical_retrival to prevent tests stomping over each other #1593 (achals)
Make start and end timestamps tz aware in the CLI #1590 (achals)
Bump fastavro version #1585 (kevinhu)
Change OfflineStore class description #1571 (tedhtchang)
Fix Sphinx documentation building #1563 (woop)
Add test coverage and remove MacOS integration tests #1562 (woop)
Improve GCP exception handling #1561 (woop)
Update default cli no option help message #1550 (tedhtchang)
Add opt-out exception logging telemetry #1535 (jklegar)
Add instruction for install Feast on IKS and OpenShift using Kustomize #1534 (tedhtchang)
BigQuery type to Feast type conversion chart update #1530 (mavysavydav)
remove unnecessay path join in setup.py #1529 (shihabuddinbuet)
Add roadmap to documentation #1528 (woop)
Add test matrix for different Python versions #1526 (woop)
Update broken urls in the github pr template file #1521 (tedhtchang)
Add a fixed timestamp to quickstart data #1513 (jklegar)
Make gcp imports optional #1512 (jklegar)
Fix documentation inconsistency #1510 (jongillham)
Upgrade grpcio version in python SDK #1508 (szalai1)
pre-commit command typo fix in CONTRIBUTING.md #1506 (mavysavydav)
Add optional telemetry to other CLI commands #1505 (jklegar)

v0.10.8 (2021-06-17)

Full Changelog

Features

Add to_bigquery() function to BigQueryRetrievalJob #1634 (vtao2)

Bug Fixes

Don't use .result() in BigQueryOfflineStore, since it still leads to OOM #1642 (tsotnet)
Don't load entire bigquery query results in memory #1638 (tsotnet)
Add entity column validations when getting historical features from bigquery #1614 (achals)

Merged Pull Requests

Make test historical retrieval longer #1630 (MattDelac)
Fix failing historical retrieval assertion #1622 (woop)
Optimize historical retrieval with BigQuery offline store #1602 (MattDelac)

v0.10.7 (2021-06-07)

Full Changelog

Bug Fixes

Fix race condition in historical e2e tests #1620 (woop)

Merged Pull Requests

Use drop_duplicates() instead of groupby (about 1.5~2x faster) #1617 (rightx2)
Use CONCAT() instead of ROW_NUMBER() #1601 (MattDelac)
Minor doc fix in the code snippet: Fix to reference the right instance for the retrieved job instance object #1599 (dmatrix)
Append nanoseconds to dataset name in test_historical_retrival to prevent tests stomping over each other #1593 (achals)
Make start and end timestamps tz aware in the CLI #1590 (achals)

v0.10.6 (2021-05-27)

Full Changelog

Features

Add datastore namespace option in configs #1581 (tsotnet)

Bug Fixes

Fix contention issue #1582 (woop)
Ensure that only None types fail predicate #1580 (woop)
Don't create bigquery dataset if it already exists #1569 (tsotnet)

Merged Pull Requests

Change OfflineStore class description #1571 (tedhtchang)

v0.10.5 (2021-05-19)

Full Changelog

Features

Add offline_store config #1552 (tsotnet)

Bug Fixes

Validate project and repo names for apply and init commands #1558 (tedhtchang)

Merged Pull Requests

Fix Sphinx documentation building #1563 (woop)
Add test coverage and remove MacOS integration tests #1562 (woop)
Improve GCP exception handling #1561 (woop)
Update default cli no option help message #1550 (tedhtchang)
Add opt-out exception logging telemetry #1535 (jklegar)
Add instruction for install Feast on IKS and OpenShift using Kustomize #1534 (tedhtchang)

v0.10.4 (2021-05-12)

Full Changelog

Features

Inferencing of Features in FeatureView and timestamp column of DataSource #1523 (mavysavydav)
Add Unix Timestamp value type #1520 (MattDelac)
Fix materialize for None #1481 (qooba)

Merged Pull Requests

BigQuery type to Feast type conversion chart update #1530 (mavysavydav)
remove unnecessay path join in setup.py #1529 (shihabuddinbuet)
Add roadmap to documentation #1528 (woop)
Add test matrix for different Python versions #1526 (woop)
Update broken urls in the github pr template file #1521 (tedhtchang)
Upgrade grpcio version in python SDK #1508 (szalai1)
Better logging for materialize command #1499 (jklegar)

v0.10.3 (2021-04-21)

Full Changelog

Features

Add support for third party providers #1501 (tsotnet)
Infer entity dataframe event timestamp column #1495 (jklegar)
Allow Feast apply to import files recursively (and add .feastignore) #1482 (tsotnet)

Bug Fixes

Bump supported Python version to 3.7 #1504 (tsotnet)
Fix bug in allowing empty repositories to be applied to a GCS registry #1488 (woop)

Merged Pull Requests

Add a fixed timestamp to quickstart data #1513 (jklegar)
Make gcp imports optional #1512 (jklegar)
Fix documentation inconsistency #1510 (jongillham)
pre-commit command typo fix in CONTRIBUTING.md #1506 (mavysavydav)
Add optional telemetry to other CLI commands #1505 (jklegar)
Pass entities information to Provider #1498 (MattDelac)
Update broken urls in contributing.md #1489 (tedhtchang)
Python docs formatting fixes #1473 (jklegar)

v0.10.2 (2021-04-21)

Full Changelog

Bug Fixes

Fix bug in allowing empty repositories to be applied to a GCS registry #1488 (woop)

v0.10.1 (2021-04-21)

Full Changelog

Bug Fixes

Fix time zone issue with get_historical_features #1475 (tsotnet)

Merged Pull Requests

Improve exception handling, logging, and validation #1477 (woop)
Remove duped pic #1476 (YikSanChan)
Fix created timestamp related errors for BigQuery source #1474 (jklegar)
Remove unnecessary MAVEN_CONFIG #1472 (danielsiwiec)
Fix CLI entities command & add feature-views command #1471 (tsotnet)

v0.10.0 (2021-04-15)

Full Changelog

Features

Add template generation to Feast CLI for Google Cloud Platform #1460 (woop)
Add support for retrieving data from sources that don't match providers #1454 (woop)
Add materialize-incremental CLI command #1442 (tsotnet)
Add registry refreshing and caching #1431 (woop)
Add missing FeatureStore methods #1423 (jklegar)
Allow importing of new FeatureStore classes #1422 (woop)
Add Feast init command #1414 (oavdeev)
Add support for parquet ingestion #1410 (oavdeev)
Add materialize_incremental method #1407 (jklegar)
Add support for pull query from BigQuery #1403 (jklegar)
Add support for partial apply to create infra #1402 (oavdeev)
Add online read API to FeatureStore class #1399 (oavdeev)
Add historical retrieval for BigQuery and Parquet #1389 (woop)
Add feature views #1386 (oavdeev)
Implement materialize method #1379 (jklegar)
Read and write path for Datastore and SQLite #1376 (oavdeev)
Download BigQuery table to pyarrow table for python-based ingestion flow #1366 (jklegar)
FeatureStore, FeatureView, Config, and BigQuerySource classes for updated SDK #1364 (jklegar)
Add support for new deploy CLI #1362 (oavdeev)

Bug Fixes

Fix time zone access with native python datetimes #1469 (tsotnet)
Small fixes for created_timestamp #1468 (jklegar)
Fix offline store (tz-naive & field_mapping issues) #1466 (tsotnet)
Fix get_online_features return schema #1455 (jklegar)
Fix noisy path warning #1452 (woop)
Fix flaky test_feature_store fixture #1447 (jklegar)
Use timestamp check for token refresh #1444 (terryyylim)
Fix bug in event timestamp removal in local mode #1441 (jklegar)
Fix timezone issue in materialize & materialize_incremental #1439 (tsotnet)
Fix materialization_intervals initialization in FeatureView #1438 (tsotnet)
Fix broken Terraform installation files #1420 (josegpg)
Fix retry handling for GCP datastore #1416 (oavdeev)
Make CLI apply in local mode idempotent #1401 (oavdeev)
Fix a bug in client archive_project method and fix lint in grpc auth #1396 (randxie)

Merged Pull Requests

Change GCP template names to match local template #1470 (jklegar)
Add logging to materialize #1467 (woop)
Validate timestamp column present in entity dataframe #1464 (jklegar)
Fix & clean up Feast CLI commands #1463 (tsotnet)
Flatten configuration structure for online store #1459 (woop)
Optimize write rate in Gcp Firestore #1458 (tsotnet)
Allow apply to take a single Entity or FeatureView #1457 (jklegar)
Validate datetimes in materialize in correct order #1456 (jklegar)
Add test to ensure saving and loading from registry is safe #1453 (woop)
Port telemetry to FeatureStore API #1446 (jklegar)
Add materialize-incremental cli test #1445 (tsotnet)
Support join keys in historical feature retrieval #1440 (jklegar)
Refactor OfflineStore into Provider #1437 (woop)
Fix multi-entity online retrieval #1435 (woop)
Fix feature name consistency between online & historical apis #1434 (tsotnet)
Rename Metadata Store to Registry #1433 (woop)
Add support for Pydantic as configuration loader #1432 (woop)
Add entity join key and fix entity references #1429 (jklegar)
Slightly more sensible test names #1428 (oavdeev)
Make entity description optional and fix empty table_ref #1425 (jklegar)
Add Development Guide for Main Feast Repo Feast Components #1424 (mrzzy)
Fix protobuf building for Python SDK #1418 (woop)
Add project name generator #1417 (woop)
[Python SDK][Auth] Refresh token id w/o gcloud cli #1413 (pyalex)
Firestore ingestion perf improvements + benchmark script #1411 (oavdeev)
Fixed old urls in documentation #1406 (tedhtchang)
Upgrade Gcloud setup dependency #1405 (woop)
Fix documentation building for Feast SDK #1400 (woop)
Bump jinja2 from 2.11.2 to 2.11.3 in /sdk/python #1398 (dependabot[bot])
Improve spark-on-k8s-operator documentation #1397 (jklegar)
Update Python SDK dependencies #1394 (woop)
Move Python proto package into submodule #1393 (woop)
Add nicer validation for repo config #1392 (oavdeev)
Remove Python CI dependencies #1390 (woop)
Move Project field to Table/View spec #1388 (woop)
Remove Mirror CI #1387 (woop)
Add feedback link to install docs page #1375 (jparthasarthy)
Support multiple features per key in firestore format spec #1374 (oavdeev)
Fix hashing algorithm in the firestore spec #1373 (oavdeev)
Support make protos on Mac #1371 (tedhtchang)
Add support for privileged tests #1369 (woop)
Remove base tests folder #1368 (woop)
Add Firestore online format specification #1367 (oavdeev)
Improve documentation for k8s-spark resource template #1363 (theofpa)

v0.9.1 (2021-01-29)

Full Changelog

Features

Add telemetry to Python SDK #1289 (jklegar)

Bug Fixes

Fix kafka download url #1298 (jklegar)
disable telemetry in docker-compose test and job_service #1297 (jklegar)

v0.9.0 (2021-01-28)

Full Changelog

Features

Enable user to provide spark job template as input for jobservice deployment #1285 (khorshuheng)
Add feature table name filter to jobs list api #1282 (terryyylim)
Report observed value for aggregated checks in pre-ingestion feature validation #1278 (pyalex)
Add docs page for Azure setup #1276 (jklegar)
Azure example terraform #1274 (jklegar)

Bug Fixes

make EMR jar uploader work the same as k8s one #1284 (oavdeev)
Don't error when azure vars not set #1277 (jklegar)
Prevent ingestion job config parser from unwanted fieldMapping transformation #1261 (pyalex)
Features are not being ingested due to max age overflow #1209 (pyalex)
Feature Table is not being update when only max_age was changed #1208 (pyalex)
Truncate staging timestamps in entities dataset to ms #1207 (pyalex)
Bump terraform rds module version #1204 (oavdeev)

Merged Pull Requests

Use date partitioning column in FileSource #1293 (pyalex)
Add EMR CI/CD entrypoint script #1290 (oavdeev)
Online serving optimizations #1286 (pyalex)
Make third party grpc packages recognizable as python module #1283 (khorshuheng)
Report observed values in feature validation as Gauge #1280 (pyalex)
Keep same amount of partitions after repartitioning in IngestionJob #1279 (pyalex)
Add request feature counter metric #1272 (terryyylim)
Use SEND_INTERRUPT to cancel EMR jobs #1271 (oavdeev)
Fix historical test flakiness #1270 (jklegar)
Allow https url for spark ingestion jar #1266 (jklegar)
Add project name to feature validation metric #1264 (pyalex)
Use dataproc console url instead of gcs for log uri #1263 (khorshuheng)
Make nodes priority (for redis cluster) configurable in Serving #1260 (pyalex)
Enhance job api to return associated feature table and start time #1259 (khorshuheng)
Reporting metrics from validation UDF #1256 (pyalex)
Allow use the same timestamp column for both created & even timestamp in Historical Retrieval #1255 (pyalex)
Apply grpc tracing interceptor on Feast SDK #1243 (khorshuheng)
Apply grpc tracing interceptor on online serving #1242 (khorshuheng)
Python UDF in Ingestion being used for feature validation #1234 (pyalex)
Add spark k8s operator launcher #1225 (oavdeev)
Add deadletter/read-from-source metrics to batch and stream ingestion #1223 (terryyylim)
Implement AbstractStagingClient for azure blob storage #1218 (jklegar)
Configurable materialization destination for view in BigQuerySource #1201 (pyalex)
Update Feast Core list features method #1176 (terryyylim)
S3 endpoint configuration #1169 #1172 (mike0sv)
Increase kafka consumer waiting time in e2e tests #1268 (pyalex)
E2E tests support for jobservice's control loop #1267 (pyalex)
Optimize memory footprint for Spark Ingestion Job #1265 (pyalex)
Fix historical test for azure #1262 (jklegar)
Change azure https to wasbs and add azure creds to spark #1258 (jklegar)
Docs, fixes and scripts to run e2e tests in minikube #1254 (oavdeev)
Fix azure blob storage access in e2e tests #1253 (jklegar)
Update python version requirements to 3.7 for Dataproc launcher #1251 (pyalex)
Fix build-ingestion-py-dependencies script #1250 (pyalex)
Add datadog(statsd) client to python package for IngestionJob #1249 (pyalex)
Add prow job for azure e2e test #1244 (jklegar)
Azure e2e test #1241 (jklegar)
Add Feast Serving histogram metrics #1240 (terryyylim)
CI should work on python 3.6 #1237 (pyalex)
Integration test for k8s spark operator support #1236 (oavdeev)
Add prow config for spark k8s operator integration testing #1235 (oavdeev-tt)
Upgrading spark to 3.0.1 #1227 (pyalex)
Support TFRecord as one of the output formats for historical feature retrieval #1222 (khorshuheng)
Remove stage_dataframe from the launcher interface #1220 (oavdeev)
Refactor staging client uploader and use it in EMR launcher #1219 (oavdeev)
Remove unused EMR code #1217 (oavdeev)
Remove job id from ingested row counter metric #1216 (terryyylim)
Quickstart link fixed #1213 (szczeles)
Delete v1 concepts #1194 (terryyylim)
Dont write defaults to config #1188 (mike0sv)
Refactor tests which utilizes feature sets #1186 (terryyylim)
Refactor configurable options and add sphinx docs #1174 (terryyylim)
Remove unnecessary Google Auth dependency #1170 (woop)

v0.8.2 (2020-12-01)

Full Changelog

Features

Configurable materialization destination for view in BigQuerySource #1201 (pyalex)

Bug Fixes

Fix tag order for release workflow #1205 (terryyylim)
Fix Feature Table not updated on new feature addition #1197 (khorshuheng)

Merged Pull Requests

Suppress kafka logs in Ingestion Job #1206 (pyalex)
Add project name to metrics labels in Ingestion Job #1202 (pyalex)

v0.8.1 (2020-11-24)

Full Changelog

Features

Expires Redis Keys based on Feature Table Max Age #1161 (khorshuheng)
Jobservice control loop (based on #1140) #1156 (oavdeev)

Bug Fixes

Lazy metrics initialization (to correct pick up in executor) #1195 (pyalex)
Add missing third_party folder #1185 (terryyylim)
Fix missing name variable instantiation #1166 (terryyylim)

Merged Pull Requests

Bump ssh-agent version #1175 (terryyylim)
Refactor configurable options and add sphinx docs #1174 (terryyylim)
Stabilize flaky e2e tests #1173 (pyalex)
Fix connection resets in CI for Maven #1164 (woop)
Add dataproc executor resource config #1160 (terryyylim)
Fix github workflow deprecating env variable #1158 (terryyylim)
Ensure consistency of github workflow #1157 (terryyylim)

v0.8.0 (2020-11-10)

Full Changelog

Features

Implement JobService API calls & connect it to SDK #1129 (tsotnet)
Allow user to specify custom secrets to be mounted on Feast Serving and Feast Core pods #1127 (khorshuheng)
Allow spark expressions in field mapping during Ingestion #1122 (pyalex)
Update rest endpoints #1121 (terryyylim)
Add feature table deletion #1114 (terryyylim)
Add historical retrieval via job service #1107 (oavdeev)
Implement list job and get job methods for Dataproc launcher #1106 (khorshuheng)
Allow entities and features to be updated #1105 (terryyylim)
Add get_by_id and list_jobs interface to the launcher interface and implement it for EMR #1095 (oavdeev)
Support redis ssl in feast-serving #1092 (oavdeev)
Add helm charts for feast jobservice #1081 (tsotnet)
Terraform cleanup: tags, formatting, better defaults #1080 (oavdeev)
Update docker-compose for Feast 0.8 #1078 (khorshuheng)
Configure jupyter env on AWS via terraform #1077 (oavdeev)
Implement EMR job cancelling #1075 (oavdeev)
Streaming Ingestion Job supports AVRO format as input #1072 (pyalex)
Accept Pandas dataframe as input for historical feature retrieval #1071 (khorshuheng)
Add EMR streaming job launcher #1065 (oavdeev)
EMR launcher #1061 (oavdeev)
Add AWS managed kafka config to the example terraform #1058 (oavdeev)
Feast SDK integration for historical feature retrieval using Spark #1054 (khorshuheng)
Update GetOnlineFeatures method in sdks #1052 (terryyylim)
"Start Offline-to-online ingestion" method in Python SDK #1051 (pyalex)
Adding support for custom grpc dial options in Go SDK #1043 (ankurs)
CLI command to start/stop/list streaming ingestion job on emr #1040 (oavdeev)
Update serving service to handle new redis encoding #1038 (terryyylim)
terraform config for aws #1033 (oavdeev)
Streaming Ingestion Pipeline with Spark #1027 (pyalex)
Run offline-to-online ingestion job on EMR #1026 (oavdeev)
Add redis SSL support to the offline-to-online ingestion job #1025 (oavdeev)
Dataproc and Standalone Cluster Spark Job launcher #1022 (khorshuheng)
Pyspark job for feature batch retrieval #1021 (khorshuheng)
Batch Ingestion Job rewritten on Spark #1020 (pyalex)
Add Feature Tables API to Core & Python SDK #1019 (mrzzy)
Introduce Entity as higher-level concept #1014 (terryyylim)

Bug Fixes

Fix stencil client serialization issue #1147 (pyalex)
Deadletter path is being incorrectly joined #1144 (pyalex)
In Historical Retrieval (SDK) use project from client context #1138 (pyalex)
Pass project from context to get entities #1137 (pyalex)
JobService is in crashloop after installing helm chart #1135 (pyalex)
Fix env var names for jupyter terraform config #1085 (oavdeev)
Fix java class name validation #1084 (oavdeev)
Multiple tiny AWS related fixes #1083 (oavdeev)

Merged Pull Requests

Make created_timestamp property optional in KafkaSource #1146 (pyalex)
In Streaming E2E Test filter kafka consumers by group id prefix #1145 (pyalex)
Limit concurrency on e2e test runs to 1 #1142 (oavdeev)
Update prow trigger for AWS #1139 (oavdeev)
e2e test fixes to make them work on AWS #1132 (oavdeev)
Add feature table name & job id to deadletter destination #1143 (pyalex)
Drop hardcoded FEAST_CORE_URL env from JobService helm chart #1136 (pyalex)
Add Prow to AWS codebuild trigger #1133 (oavdeev)
Optional IngestionJob parameters passed by Spark Launcher #1130 (pyalex)
Wait for job to be ready before cancelling #1126 (khorshuheng)
Ability to run e2e tests in non-default project #1125 (pyalex)
Ensure job is completed when ingesting to BQ #1123 (terryyylim)
Add end-to-end Prow Job launcher for AWS tests #1118 (woop)
Add confluent kafka installation to minimal notebook #1116 (woop)
Scaffolding for integration tests #1113 (khorshuheng)
Add serving integration test for updated feature type #1112 (terryyylim)
In Historical Retrieval from BQ join between source & entities is performed inside BQ #1110 (pyalex)
Make created timestamp column optional #1108 (khorshuheng)
Add validation when feature type is changed #1102 (terryyylim)
E2E flow in prow is working #1101 (pyalex)
Return e2e back to prow runner #1100 (pyalex)
Add gh workflow for dockerhub #1098 (terryyylim)
Make demo notebook work on AWS #1097 (oavdeev)
Update Kubernetes setup for Feast 0.8 #1096 (khorshuheng)
Refactored end-to-end tests fully orchestrated by pytest #1094 (pyalex)
Disable statsd by default for spark #1089 (oavdeev-tt)
Restructure tutorial subfolder #1088 (terryyylim)
Remove load test from github action #1087 (khorshuheng)
Add more explanations to the demo notebook, use local file system instead of GCS by default #1086 (khorshuheng)
Tutorial (Full demo) in Jupyter #1079 (pyalex)
Add unit test for historical retrieval with panda dataframe #1073 (khorshuheng)
Remove outdated tutorials #1069 (terryyylim)
Add method to add feature to Feature table #1068 (terryyylim)
Historical feature retrieval e2e test #1067 (khorshuheng)
Use RedisKeyV2 as key serializer and java murmur implementation in Redis Sink #1064 (pyalex)
Use existing staging client for dataproc staging #1063 (khorshuheng)
Cleanup CLI and Python dependencies #1062 (terryyylim)
Refactor Spark Job launcher API #1060 (pyalex)
Create empty Job Service #1059 (tsotnet)
Replace Data Source specific format options with DataFormat message #1049 (mrzzy)
Add created_timestamp_column to DataSource. Rename timestamp_column -> event_timestamp_column #1048 (pyalex)
Cleanup e2e and docker-compose tests #1035 (terryyylim)
Add svc account volume mount to prow jobs #1034 (terryyylim)
Update prow config and makefile #1024 (terryyylim)
Refactor Python SDK to remove v1 concepts #1023 (terryyylim)

v0.7.1 (2020-10-07)

Full Changelog

Bug Fixes

Provide stable jobName in RowMetrics labels #1028 (pyalex)

v0.7.0 (2020-09-09)

Full Changelog

Breaking Changes

Add request response logging via fluentd #961 (terryyylim)
Run JobCoontroller as separate application #951 (pyalex)
Output Subject Claim as Identity in Logging interceptor #946 (mrzzy)
Use JobManager's backend as persistent storage and source of truth #903 (pyalex)
Fix invalid characters for project, featureset, entity and features creation #976 (terryyylim)

Features

Add redis key prefix as an option to Redis cluster #975 (khorshuheng)
Authentication Support for Java & Go SDKs #971 (mrzzy)
Add configurable prefix to Consumer Group in IngestionJob's Kafka reader #969 (terryyylim)
Configurable kafka consumer in IngestionJob #959 (pyalex)
Restart Ingestion Job on code version update #949 (pyalex)
Add REST endpoints for Feast UI #878 (SwampertX)
Upgrade Feast dependencies #876 (pyalex)

Bug Fixes

Fix Java & Go SDK TLS support #986 (mrzzy)
Fix Python SDK setuptools not supporting tags required for Go SDK to be versioned. #983 (mrzzy)
Fix Python native types multiple entities online retrieval #977 (terryyylim)
Prevent historical retrieval from failing on dash in project / featureSet name #970 (pyalex)
Fetch Job's labels from dataflow #968 (pyalex)
Fetch Job's Created Datetime from Dataflow #966 (pyalex)
Fix flaky tests #953 (pyalex)
Prevent field duplications on schema merge in BigQuery sink #945 (pyalex)
Fix Audit Message Logging Interceptor Race Condition #938 (mrzzy)
Bypass authentication for metric endpoints on Serving. #936 (mrzzy)
Fix grpc security variables name and missing exec qualifier in docker.dev #935 (jmelinav)
Remove extra line that duplicates statistics list #934 (terryyylim)
Fix empty array when retrieving stats data #930 (terryyylim)
Allow unauthenticated access when Authorization is disabled and to Health Probe #927 (mrzzy)
Impute default project if empty before authorization is called #926 (jmelinav)
Fix Github Actions CI load-test job failing due inability to install Feast Python SDK. #914 (mrzzy)
Fix Online Serving unable to retrieve feature data after Feature Set update. #908 (mrzzy)
Fix unit tests not running in feast.core package. #883 (mrzzy)
Exclude dependencies signatures from IngestionJob package #879 (pyalex)
Prevent race condition in BQ sink jobId generation #877 (pyalex)
Add IngestionId & EventTimestamp to FeatureRowBatch to calculate lag metric correctly #874 (pyalex)
Fix typo for fluentd request response map key #989 (terryyylim)
Reduce polling interval for docker-compose test and fix flaky e2e test #982 (terryyylim)
Fix rate-limiting issue on github actions for master branch #974 (terryyylim)
Fix docker-compose test #973 (terryyylim)
Fix Helm chart requirements lock and version linting #925 (woop)
Fix Github Actions failures due to possible rate limiting. #972 (mrzzy)
Fix docker image building for PR commits #907 (woop)
Fix Github Actions versioned image push #994(mrzzy)
Fix Go SDK extra colon in metadata header for Authentication #1001(mrzzy)
Fix lint version not pulling tags. #999(mrzzy)
Call fallback only when theres missing keys #1009 (pyalex)

Merged Pull Requests

Add cryptography to python ci-requirements #988 (pyalex)
Allow maps in environment variables in helm charts #987 (pyalex)
Speed up Github Actions Docker builds #980 (mrzzy)
Use setup.py develop instead of pip install -e #967 (pyalex)
Peg black version #963 (terryyylim)
Remove FeatureRow compaction in BQ sink #960 (pyalex)
Get job controller deployment for docker compose back #958 (pyalex)
Revert job controller deployment for docker compose #957 (woop)
JobCoordinator use public API to communicate with Core #943 (pyalex)
Allow Logging Interceptor to be toggled by Message Logging Enabled Flag #940 (mrzzy)
Clean up Feast CI, docker compose, and notebooks #916 (woop)
Allow use of Kubernetes for Github Actions #910 (woop)
Wait for docker images to be ready for e2e dataflow test #909 (woop)
Add docker image building to GitHub Actions and consolidate workflows #898 (woop)
Add load test GitHub Action #897 (woop)
Typo in feature sets example. #894 (ashwinath)
Add auth integration tests #892 (woop)
Integration Test for Job Coordinator #886 (pyalex)
BQ sink produces sample of successful inserts #875 (pyalex)
Add Branch and RC Awareness to Version Lint & Fix Semver Regex #998 (mrzzy)

v0.6.2 (2020-08-02)

Full Changelog

Features

Redis sink flushes only rows that have more recent eventTimestamp #913 (pyalex)
Dataflow runner options: disk type & streaming engine #906 (pyalex)
Add Structured Audit Logging #891 (mrzzy)
Add Authentication and Authorization for feast serving #865 (jmelinav)
Throw more informative exception when write_triggering_frequency_seconds is missing #917 (pyalex)
Add caching to authorization #884 (jmelinav)
Add Auth header #885 (AnujaVane)

Bug Fixes

Fix Online Serving unable to retrieve feature data after Feature Set update. #908 (mrzzy)
Fix Python SDK ingestion for featureset name that exist in multiple projects #868 (terryyylim)
Backport delay in Redis acknowledgement of spec #915 (woop)
Allow unauthenticated access when Authorization is disabled and to Health Probe #927 (mrzzy)

Merged Pull Requests

Upgrade Feast dependencies #876 (pyalex)

v0.6.1 (2020-07-17)

Full Changelog

Features

Improve parallelization in Redis Sink #866 (pyalex)
BQ sink produces sample of successful inserts #875 (pyalex)

Bug Fixes

Add IngestionId & EventTimestamp to FeatureRowBatch to calculate lag metric correctly #874 (pyalex)
Prevent race condition in BQ sink jobId generation #877 (pyalex)

v0.6.0 (2020-07-13)

Full Changelog

Breaking Changes

Compute and write metrics for rows prior to store writes #763 (zhilingc)

Features

Allow users compute statistics over retrieved batch datasets #799 (zhilingc)
Replace Keto Authorization with External HTTP Authorization #864 (woop)
Add disk size as Dataflow Job Configuration #841 (khorshuheng)
JobCoordinator may be turned off by configuration #829 (pyalex)
Allow ingestion job grouping/consolidation to be configurable #825 (pyalex)
Add subscriptions blacklist functionality #813 (terryyylim)
Add Common module #801 (terryyylim)
FeatureSets are delivered to Ingestion Job through Kafka #792 (pyalex)
Add YAML export to Python SDK #782 (woop)
Add support to Python SDK for staging files on Amazon S3 #769 (jmelinav)
Add support for version method in Feast SDK and Core #759 (woop)
Upgrade ingestion to allow for in-flight updates to feature sets for sinks #757 (pyalex)
Add Discovery API for listing features #797 (terryyylim)
Authentication and authorization support #793 (dr3s)
Add API for listing feature sets using labels #785 (terryyylim)

Bug Fixes

Bypass authentication for metric endpoints #862 (woop)
Python SDK listing of ingestion job fails for featureset reference filter #861 (terryyylim)
Fix BigQuerySink successful output to produce only once #858 (pyalex)
Re-applying of featuresets does not update label changes #857 (terryyylim)
BQ Sink is failing when Feature consists of only null values #853 (pyalex)
Fix FeatureSetJobStatus removal #848 (pyalex)
Fix: JobCoordinator tries to create duplicate FeatureSetJobStatuses #847 (pyalex)
Replace IngestionJob when store was updated #846 (pyalex)
Don't send unrecognized featureSets to deadletter in IngestionJob #845 (pyalex)
Deallocate featureSet from job when source changed #844 (pyalex)
Fix CPU count selection in Python SDK for non-Unix #839 (pyalex)
Write metrics for store allocated rows only #830 (zhilingc)
Prevent reserved fields from being registered #819 (terryyylim)
Fix Optional#get() and string comparison bugs in JobService #804 (ches)
Publish helm chart script should not modify the chart content #779 (khorshuheng)
Fix pipeline options toArgs() returning empty list #765 (zhilingc)
Remove usage of parallel stream for feature value map generation #751 (khorshuheng)

Merged Pull Requests

Remove Spring Boot from auth tests #859 (woop)
Authentication and Authorization into feast-auth module. #856 (jmelinav)
Keep StoreProto inside JobStore to decouple JobCoordination from SpecService internals #852 (pyalex)
Enable isort for Python SDK #843 (woop)
Replace batch with historical for Python SDK retrieval #842 (woop)
Upgrade pandas to 1.0.x #840 (duongnt)
Ensure store subscriptions are migrated to allow exclusion schema #838 (pyalex)
Remove project reference from feature set id in stats example notebook #836 (zhilingc)
Enable linting and formatting for e2e tests #832 (woop)
IngestionJob is being gracefully replaced to minimize downtime #828 (pyalex)
Add native types for Python SDK online retrieval #826 (terryyylim)
Send acknowledgment on Spec Update only after sinks are ready #822 (pyalex)
Remove Duplicated Strip Projects Code from SDKs #820 (mrzzy)
Consolidate ingestion jobs to one job per source #817 (pyalex)
Add missing key count metric #816 (terryyylim)
Create table in BigQuery if doesn't exists when new FeatureSetSpec arrived to IngestionJob #815 (pyalex)
Refactor common module's feature string reference method #814 (terryyylim)
Fix typo in documentation #811 (ravisuhag)
Database Schema migration for RELEASE 0.6 with Flyway #810 (pyalex)
Update helm installation docs - Fix broken link #808 (davidheryanto)
Add authentication support for end-to-end tests #807 (jmelinav)
Use latest instead of dev as the default image tag in helm charts #806 (duongnt)
Build Feast Jupyter image and clean up examples #803 (woop)
Move communication with IngestionJob to JobCoordinator #800 (pyalex)
Compression of FeatureRows collection in memory #798 (pyalex)
Add Kubernetes Pod labels to Core and Serving. #795 (ashwinath)
Add v0.3.8 changelog #788 (ches)
Update change log due to release 0.5.1 #783 (khorshuheng)
Refactor end-to-end tests to reduce duplication #758 (woop)
Recompile golang protos to include new FeatureSetStatus #755 (zhilingc)
Merge Redis cluster connector with Redis connector #752 (pyalex)

0.5.1 (2020-06-06)

Full Changelog

Features

Add support for version method in Feast SDK and Core #759 (woop)
Refactor runner configuration, add labels to dataflow options #718 (zhilingc)

Bug Fixes

Fix pipeline options toArgs() returning empty list #765 (zhilingc)
Fix project argument for feature set describe in CLI #731 (terryyylim)
Fix Go and Java SDK Regressions #729 (mrzzy)
Remove usage of parallel stream for feature value map generation #751 (khorshuheng)
Restore Feast Java SDK and Ingestion compatibility with Java 8 runtimes #722 (ches)
Python sdk bug fixes #723 (zhilingc)

Merged Pull Requests

Increase Jaeger Tracing coverage #719 (terryyylim)
Recompile golang protos to include new FeatureSetStatus #755 (zhilingc)
Merge Redis cluster connector with Redis connector #752 (pyalex)
Remove unused Hibernate dep from Serving #721 (ches)

v0.5.0 (2020-05-19)

Full Changelog

Breaking Changes

Add .proto to packages of Protobuf generated Java classes #700 (woop)
Add support for feature set updates and remove versions #676 (zhilingc)
Feast configuration files refactored #611 (woop)

See Feast 0.5 Release Issue for more details.

Features

Add general storage API and refactor existing store implementations #567 (zhilingc)
Add support for feature set updates and remove versions #676 (zhilingc)
Add unique ingestion id for all batch ingestions #656 (zhilingc)
Add storage interfaces #529 (zhilingc)
Add BigQuery storage implementation #546 (zhilingc)
Add Redis storage implementation #547 (zhilingc)
Add Support for Redis Cluster #502 (lavkesh)
Add Ingestion Job management API for Feast Core #548 (mrzzy)
Add feature and feature set labels for metadata #536 (imjuanleonard)
Update Python SDK so FeatureSet can import Schema from Tensorflow metadata #450 (davidheryanto)

Bug Fixes

Add feature set status JOB_STARTING to denote feature sets waiting for job to get to RUNNING state #714 (zhilingc)
Remove feature set status check for job update requirement #708 (khorshuheng)
Fix Feast Core docker image #703 (khorshuheng)
Include server port config on the generated application.yml #696 (khorshuheng)
Fix typo in all types parquet yml file (e2e test) #683 (khorshuheng)
Add grpc health probe implementation to core #680 (zhilingc)
Ensure that generated python code are considered as module #679 (khorshuheng)
Fix DataflowJobManager to update existing job instance instead of creating new one #678 (zhilingc)
Fix config validation for feast.jobs.metrics.host #662 (davidheryanto)
Docker compose bug fix #661 (woop)
Swap join columns #647 (zhilingc)
Fix Feast Serving not registering its store in Feast Core #641 (mrzzy)
Kafka producer should raise an exception when it fails to connect to broker #636 (junhui096)

Merged Pull Requests

Change organization from gojek to feast-dev #712 (woop)
Extract feature set update tests so CI doesn't run it #709 (zhilingc)
Ensure that batch retrieval tests clean up after themselves #704 (zhilingc)
Apply default project to rows without project during ingestion #701 (zhilingc)
Update tests to correct compute region #699 (terryyylim)
Make Projects optional & Update Feature References #693 (mrzzy)
Add Java code coverage reporting #686 (ches)
Update e2e tests to allow non-SNAPSHOT testing #672 (woop)
Move TFDV stats to higher-numbered protobuf fields #669 (ches)
Clean up Docker Compose and add test #668 (woop)
Enable Prow e2e tests by default #666 (woop)
Add label checking to Prow #665 (woop)
Upgrade Github Checkout action to v2 #660 (khorshuheng)
Fix Redis cluster e2e #659 (terryyylim)
Split Field model into distinct Feature and Entity objects #655 (zhilingc)
Use Runner enum type instead of string for Job model #651 (ches)
JobUpdateTask cleanups #650 (ches)
Update approvers list #648 (khorshuheng)
Update end-to-end test config #645 (zhilingc)
Fix bigquery config for serving store #644 (zhilingc)
Fix Dataflow translator bug #643 (zhilingc)
Fix subscription config and doctests #634 (woop)
Correct links to why-feast and concepts doc site #627 (anderseriksson)
Make error on retrieval of nonexistent feature humanly readable #625 (mrzzy)
Generate golang code for non-serving protos #618 (zhilingc)
Regenerate golang code, fix proto comparisons #616 (zhilingc)
Fix doc building #603 (woop)
Pin Jupyter Notebook version #597 (imjuanleonard)
Create project if not exists on applyFeatureSet #596 (Joostrothweiler)
Apply a fixed window before writing row metrics #590 (davidheryanto)
Allow tests to run on non-master branches #588 (woop)

v0.4.7 (2020-03-17)

Full Changelog

Merged Pull Requests

Add log4j-web jar to core and serving. #498 (Yanson)
Clear all the futures when sync is called. #501 (lavkesh)
Encode feature row before storing in Redis #530 (khorshuheng)
Remove transaction when listing projects #522 (davidheryanto)
Remove unused ingestion deps #520 (ches)
Parameterize end to end test scripts. #433 (Yanson)
Replacing Jedis With Lettuce in ingestion and serving #485 (lavkesh)

v0.4.6 (2020-02-26)

Full Changelog

Merged Pull Requests

Rename metric name for request latency in feast serving #488 (davidheryanto)
Allow use of secure gRPC in Feast Python client #459 (Yanson)
Extend WriteMetricsTransform in Ingestion to write feature value stats to StatsD #486 (davidheryanto)
Remove transaction from Ingestion #480 (imjuanleonard)
Fix fastavro version used in Feast to avoid Timestamp delta error #490 (davidheryanto)
Fail Spotless formatting check before tests execute #487 (ches)
Reduce refresh rate of specification refresh in Serving to 10 seconds #481 (woop)

v0.4.5 (2020-02-14)

Full Changelog

Merged Pull Requests

Use bzip2 compressed feature set json as pipeline option #466 (khorshuheng)
Make redis key creation more determinisitic #471 (zhilingc)
Helm Chart Upgrades #458 (Yanson)
Exclude version from grouping #441 (khorshuheng)
Use concrete class for AvroCoder compatibility #465 (zhilingc)
Fix typo in split string length check #464 (zhilingc)
Update README.md and remove versions from Helm Charts #457 (woop)
Deduplicate example notebooks #456 (woop)
Allow users not to set max age for batch retrieval #446 (zhilingc)

v0.4.4 (2020-01-28)

Full Changelog

Merged Pull Requests

Change RedisBackedJobService to use a connection pool #439 (zhilingc)
Update GKE installation and chart values to work with 0.4.3 #434 (lgvital)
Remove "resource" concept and the need to specify a kind in feature sets #432 (woop)
Add retry options to BigQuery #431 (Yanson)
Fix logging #430 (Yanson)
Add documentation for bigquery batch retrieval #428 (zhilingc)
Publish datatypes/java along with sdk/java #426 (ches)
Update basic Feast example to Feast 0.4 #424 (woop)
Introduce datatypes/java module for proto generation #391 (ches)

v0.4.3 (2020-01-08)

Full Changelog

Bug Fixes

Bugfix for redis ingestion retries throwing NullPointerException on remote runners #417 (khorshuheng)

v0.4.2 (2020-01-07)

Full Changelog

Bug Fixes

Missing argument in error string in ValidateFeatureRowDoFn #401

Merged Pull Requests

Define maven revision property when packaging jars in Dockerfile so the images are built successfully #410 (davidheryanto)
Deduplicate rows in subquery #409 (zhilingc)
Filter out extra fields, deduplicate fields in ingestion #404 (zhilingc)
Automatic documentation generation for gRPC API #403 (woop)
Update feast core default values to include hibernate merge strategy #400 (zhilingc)
Move cli into feast package #398 (zhilingc)
Use Nexus staging plugin for deployment #394 (khorshuheng)
Handle retry for redis io flow #274 (khorshuheng)

v0.4.1 (2019-12-30)

Full Changelog

Merged Pull Requests

Add project-related commands to CLI #397 (zhilingc)

v0.4.0 (2019-12-28)

Full Changelog

Features

Edit description in feature specification to also reflect in BigQuery schema description. #239
Allow for disabling of metrics pushing #57

Merged Pull Requests

Java SDK release script #406 (davidheryanto)
Use fixed 'dev' revision for test-e2e-batch #395 (davidheryanto)
Project Namespacing #393 (woop)
<docs>(concepts): change data types to upper case because lower case … #389 (david30907d)
Remove alpha v1 from java package name #387 (khorshuheng)
Minor bug fixes for Python SDK #383 (voonhous)
Allow user to override job options #377 (khorshuheng)
Add documentation to default values.yaml in Feast chart #376 (davidheryanto)
Add support for file paths for providing entity rows during batch retrieval #375 (voonhous)
Update sync helm chart script to ensure requirements.lock in in sync with requirements.yaml #373 (davidheryanto)
Catch errors thrown by BQ during entity table loading #371 (zhilingc)
Async job management #361 (zhilingc)
Infer schema of PyArrow table directly #355 (voonhous)
Add readiness checks for Feast services in end to end test #337 (davidheryanto)
Create CHANGELOG.md #321 (woop)

v0.3.8 (2020-06-10)

Full Changelog

Features

v0.3 backport: Add feature and feature set labels #737 (ches)

Merged Pull Requests

v0.3 backport: Add Java coverage reporting #734 (ches)

v0.3.7 (2020-05-01)

Full Changelog

Merged Pull Requests

Moved end-to-end test scripts from .prow to infra #657 (khorshuheng)
Backported #566 & #647 to v0.3 #654 (ches)

v0.3.6 (2020-01-03)

Merged Pull Requests

Full Changelog

Add support for file paths for providing entity rows during batch retrieval #375 (voonhous)

v0.3.5 (2019-12-26)

Full Changelog

Merged Pull Requests

Always set destination table in BigQuery query config in Feast Batch Serving so it can handle large results #392 (davidheryanto)

v0.3.4 (2019-12-23)

Full Changelog

Merged Pull Requests

Make redis key creation more determinisitic #380 (zhilingc)

v0.3.3 (2019-12-18)

Full Changelog

Features

Added Docker Compose for Feast #272
Added ability to check import job status and cancel job through Python SDK #194
Added basic customer transactions example #354 (woop)

Merged Pull Requests

Added Prow jobs to automate the release of Docker images and Python SDK #369 (davidheryanto)
Fixed installation link in README.md #368 (Jeffwan)
Fixed Java SDK tests not actually running (missing dependencies) #366 (woop)
Added more batch retrieval tests #357 (zhilingc)
Python SDK and Feast Core Bug Fixes #353 (woop)
Updated buildFeatureSets method in Golang SDK #351 (davidheryanto)
Python SDK cleanup #348 (woop)
Broke up queries for point in time correctness joins #347 (zhilingc)
Exports gRPC call metrics and Feast resource metrics in Core #345 (davidheryanto)
Fixed broken Google Group link on Community page #343 (ches)
Ensured ImportJobTest is not flaky by checking WriteToStore metric and requesting adequate resources for testing #332 (davidheryanto)
Added docker-compose file with Jupyter notebook #328 (khorshuheng)
Added minimal implementation of ingesting Parquet and CSV files #327 (voonhous)

v0.3.2 (2019-11-29)

Full Changelog

Merged Pull Requests

Fixed incorrect BigQuery schema creation from FeatureSetSpec #340 (davidheryanto)
Filtered out feature sets that dont share the same source #339 (zhilingc)
Changed latency calculation method to not use Timer #338 (zhilingc)
Moved Prometheus annotations to pod template for serving #336 (zhilingc)
Removed metrics windowing, cleaned up step names for metrics writing #334 (zhilingc)
Set BigQuery table time partition inside get table function #333 (zhilingc)
Added unit test in Redis to return values with no max age set #329 (smadarasmi)
Consolidated jobs into single steps instead of branching out #326 (zhilingc)
Pinned Python SDK to minor versions for dependencies #322 (woop)
Added Auto format to Google style with Spotless #317 (ches)

v0.3.1 (2019-11-25)

Full Changelog

Merged Pull Requests

Added Prometheus metrics to serving #316 (zhilingc)
Changed default job metrics sink to Statsd #315 (zhilingc)
Fixed module import error in Feast CLI #314 (davidheryanto)

v0.3.0 (2019-11-19)

Full Changelog

Summary:

Introduced "Feature Sets" as a concept with a new Feast Core API, Feast Serving API
Upgraded Python SDK to support new Feast API. Allows for management of Feast as a library or through the command line.
Implemented a Golang SDK and Java SDK to support the new Feast Core and Feast Serving APIs.
Added support for multi-feature set retrieval and joins.
Added point-in-time correct retrieval for both batch and online serving.
Added support for an external source in Kafka.
Added job management to Feast Core to manage ingestion/population jobs to remote Feast deployments
Added metric support through Prometheus

Merged Pull Requests

Regenerate go protos #313 (zhilingc)
Bump chart version to 0.3.0 #311 (zhilingc)
Refactored Core API: ListFeatureSets, ListStore, and GetFeatureSet #309 (woop)
Use Maven's --also-make by default #308 (ches)
Python SDK Ingestion and schema inference updates #307 (woop)
Batch ingestion fix #299 (zhilingc)
Update values-demo.yaml to make Minikube installation simpler #298 (woop)
Fix bug in core not setting default Kafka source #297 (woop)
Replace Prometheus logging in ingestion with StatsD logging #293 (woop)
Feast Core: Stage files manually when launching Dataflow jobs #291 (davidheryanto)
Database tweaks #290 (smadarasmi)
Feast Helm charts and build script #289 (davidheryanto)
Fix max_age changes not updating specs and add TQDM silencing flag #292 (woop)
Ingestion fixes #286 (zhilingc)
Consolidate jobs #279 (zhilingc)
Import Spring Boot's dependency BOM, fix spring-boot:run at parent project level #276 (ches)
Feast 0.3 Continuous Integration (CI) Update #271 (davidheryanto)
Add batch feature retrieval to Python SDK #268 (woop)
Set Maven build requirements and some project POM metadata #267 (ches)
Python SDK enhancements #264 (woop)
Use a symlink for Java SDK's protos #263 (ches)
Clean up the Maven build #262 (ches)
Add golang SDK #261 (zhilingc)
Move storage configuration to serving #254 (zhilingc)
Serving API changes for 0.3 #253 (zhilingc)

v0.1.8 (2019-10-30)

Full Changelog

Features

Feast cli config file should be settable by an env var #149
Helm chart for deploying feast using Flink as runner #64
Get ingestion metrics when running on Flink runner #63
Move source types into their own package and discover them using java.util.ServiceLoader #61
Change config to yaml #51
Ability to pass runner option during ingestion job submission #50

Bug Fixes

Fix Print Method in Feast CLI #211
Dataflow monitoring by core is failing with incorrect job id #153
Feast core crashes without logger set #150

Merged Pull Requests

Remove redis transaction #280 (pradithya)
Fix tracing to continue from existing trace created by grpc client #245 (pradithya)

v0.1.2 (2019-08-23)

Full Changelog

Bug Fixes

Batch Import, feature with datetime format issue #203
Serving not correctly reporting readiness check if there is no activity #190
Serving stop periodically reloading feature specification after a while #188

Merged Pull Requests

Add romanwozniak to prow owners config #216 (romanwozniak)
Implement filter for create dataset api #215 (pradithya)
expand raw column to accomodate more features ingested in one go #213 (budi)
update feast installation docs #210 (budi)
Add Prow job for unit testing Python SDK #209 (davidheryanto)
fix create_dataset #208 (budi)
Update Feast installation doc #207 (davidheryanto)
Fix unit test cli in prow script not returning correct exit code #206 (davidheryanto)
Fix pytests and make TS conversion conditional #205 (zhilingc)
Use full prow build id as dataset name during test #200 (davidheryanto)
Add Feast CLI / python SDK documentation #199 (romanwozniak)
Update library version to fix security vulnerabilities in dependencies #198 (davidheryanto)
Update Prow configuration for Feast CI #197 (davidheryanto)
[budi] update python sdk quickstart #196 (budi)
Readiness probe #191 (pradithya)
Fix periodic feature spec reload #189 (pradithya)
Fixed a typo in environment variable in installation #187 (gauravkumar37)
Revert "Update Quickstart" #185 (zhilingc)
Update Quickstart #184 (pradithya)
Continuous integration and deployment (CI/CD) update #183 (davidheryanto)
Remove feature specs being able to declare their serving or warehouse stores #159 (tims)

v0.1.1 (2019-04-18)

Full Changelog

Bug Fixes

Fix BigQuery query template to retrieve training data #182 (davidheryanto)

Merged Pull Requests

Add python init files #176 (zhilingc)
Change pypi package from Feast to feast #173 (zhilingc)

v0.1.0 (2019-04-09)

Full Changelog

Features

Removal of storing historical value of feature in serving storage #53
Remove feature "granularity" and relegate to metadata #17

Closes Issues

Add ability to name an import job #167
Ingestion retrying an invalid FeatureRow endlessly #163
Ability to associate data ingested in Warehouse store to its ingestion job #145
Missing (Fixing) unit test for FeatureRowKafkaIO #132

Merged Pull Requests

Catch all kind of exception to avoid retrying #171 (pradithya)
Integration test #170 (zhilingc)
Proto error #169 (pradithya)
Add --name flag to submit job #168 (pradithya)
Prevent throwing RuntimeException when invalid proto is received #166 (pradithya)
Add davidheryanto to OWNER file #165 (pradithya)
Check validity of event timestamp in ValidateFeatureRowDoFn #164 (pradithya)
Remove granularity #162 (pradithya)
Better Kafka test #160 (tims)
Simplify and document CLI building steps #158 (thirteen37)
Fix link typo in README.md #156 (pradithya)
Add Feast admin quickstart guide #155 (thirteen37)
Pass all specs to ingestion by file #154 (tims)
Preload spec in serving cache #152 (pradithya)
Add job identifier to FeatureRow #147 (mansiib)
Fix unit tests #146 (mansiib)
Add thirteen37 to OWNERS #144 (thirteen37)
Fix import spec created from Importer.from_csv #143 (pradithya)
Regenerate go #142 (zhilingc)
Flat JSON for pubsub and text files #141 (tims)
Add wait flag for jobs, fix go proto path for dataset service #138 (zhilingc)
Fix Python SDK importer's ability to apply features #135 (woop)
Refactor stores #110 (tims)
Coalesce rows #89 (tims)
Remove historical feature in serving store #87 (pradithya)

v0.0.2 (2019-03-11)

Full Changelog

Features

Coalesce FeatureRows for improved "latest" value consistency in serving stores #88
Kafka source #22

Closes Issues

Preload Feast's spec in serving cache #151
Feast csv data upload job #137
Blocking call to start feast ingestion job #136
Python SDK fails to apply feature when submitting job #134
Default dump format should be changed for Python SDK #133
Listing resources and finding out system state #131
Reorganise ingestion store classes to match architecture #109

v0.0.1 (2019-02-11)

Full Changelog

Features

Spring boot CLI logs show up as JSON #104
Allow for registering feature that doesn't have warehouse store #5

Bug Fixes

Error when submitting large import spec #125
Ingestion is not ignoring unknown feature in streaming source #99
Vulnerability in dependency (core - jackson-databind ) #92
TF file for cloud build trigger broken #72
Job Execution Failure with NullPointerException #46
Runtime Dependency Error After Upgrade to Beam 2.9.0 #44
[FlinkRunner] Core should not follow remote flink runner job to completion #21
Go packages in protos use incorrect repo #16

Merged Pull Requests

Disable test during docker image creation #129 (pradithya)
Repackage helm chart #127 (pradithya)
Increase the column size for storing raw import spec #126 (pradithya)
Update Helm Charts (Redis, Logging) #123 (woop)
Added LOG_TYPE environmental variable #120 (woop)
Fix missing Redis write #119 (pradithya)
add logging when error on request feature #117 (pradithya)
run yarn run build during generate-resource #115 (pradithya)
Add loadBalancerSourceRanges option for both serving and core #114 (zhilingc)
Build master #112 (pradithya)
Cleanup warning while building proto files #108 (pradithya)
Embed ui build & packaging into core's build #106 (pradithya)
Add build badge to README #103 (woop)
Ignore features in FeatureRow if it's not requested in import spec #101 (pradithya)
Add override for serving service static ip #100 (zhilingc)
Fix go test #97 (zhilingc)
add missing copyright headers and fix test fail due to previous merge #95 (tims)
Allow submission of kafka jobs #94 (zhilingc)
upgrade jackson databind for security vulnerability #93 (tims)
Version revert #91 (zhilingc)
Fix validating feature row when the associated feature spec has no warehouse store #90 (pradithya)
Add get command #85 (zhilingc)
Avoid error thrown when no storage for warehouse/serving is registered #83 (pradithya)
Fix jackson dependency issue #82 (zhilingc)
Allow registration of feature without warehouse store #80 (pradithya)
Remove branch from cloud build trigger #79 (woop)
move read transforms into "source" package as FeatureSources #74 (tims)
Fix tag regex in tf file #73 (zhilingc)
Update charts #71 (mansiib)
Deduplicate storage ids before we fetch them #68 (tims)
Check the size of result against deduplicated request #67 (pradithya)
Add ability to submit ingestion job using Flink #62 (pradithya)
Fix vulnerabilities for webpack-dev #59 (budi)
Build push #56 (zhilingc)
Fix github vulnerability issue with webpack #54 (budi)
Only lookup storage specs that we actually need #52 (tims)
Link Python SDK RFC to PR and Issue #49 (woop)
Python SDK #47 (zhilingc)
Update com.google.httpclient to be same as Beam's dependency #45 (pradithya)
Bump Beam SDK to 2.9.0 #43 (pradithya)
Add fix for tests failing in docker image #40 (zhilingc)
Change error store to be part of configuration instead #39 (zhilingc)
Fix location of Prow's Tide configuration #35 (woop)
Add testing folder for deploying test infrastructure and running tests #34 (woop)
skeleton contributing guide #33 (tims)
allow empty string to select a NoOp write transform #30 (tims)
Remove packaging ingestion as separate profile (fix #28) #29 (pradithya)
Change gopath to point to feast-dev repo #26 (zhilingc)
Fixes #31 - errors during kafka deserializer (passing) test execution #25 (baskaranz)
Kafka IO fixes #23 (tims)
KafkaIO implementation for feast #19 (baskaranz)
Return same type string for warehouse and serving NoOp stores #18 (tims)
#12: prefetch specs and validate on job expansion #15 (tims)
Added RFC for Feast Python SDK #14 (woop)
Add more validation in feature spec registration #11 (pradithya)
Added rfcs/ folder with readme and template #10 (woop)
Expose ui service rpc #9 (pradithya)
Add Feast overview to README #8 (woop)
Directory structure changes #7 (zhilingc)
Change register to apply #4 (zhilingc)
Empty response handling in serving api #3 (pradithya)
Proto file fixes #1 (pradithya)

Files

CHANGELOG.md

Latest commit

History

CHANGELOG.md

File metadata and controls

Changelog

0.41.0 (2024-10-26)

Bug Fixes

Features

Performance Improvements

BREAKING CHANGES

0.40.0 (2024-07-31)

Bug Fixes

Features

Reverts

0.39.0 (2024-06-18)

Bug Fixes

Features

0.38.0 (2024-05-24)

Bug Fixes

Features

Reverts

0.37.1 (2024-04-17)

Bug Fixes

Reverts

0.37.0 (2024-04-17)

Bug Fixes

Features

0.36.0 (2024-04-16)

Bug Fixes

Features

Reverts

0.35.0 (2024-01-13)

Bug Fixes

Features

0.34.0 (2023-09-07)

Bug Fixes

Features

0.33.0 (2023-08-14)

Bug Fixes

Features

0.32.0 (2023-07-17)

Bug Fixes

Features

0.31.0 (2023-04-21)

Bug Fixes

Features

0.30.0 (2023-03-24)

Bug Fixes

Features

0.29.0 (2023-01-31)

Bug Fixes

Features

0.28.0 (2023-01-03)

Bug Fixes

Features

0.27.0 (2022-12-05)

Bug Fixes

Features

0.26.0 (2022-10-06)

Bug Fixes

Features

0.25.0 (2022-09-20)

Bug Fixes

Features

0.24.0 (2022-08-25)

Bug Fixes

Features

0.23.0 (2022-08-02)

Bug Fixes

Features

0.22.0 (2022-06-29)

Bug Fixes

Features

Reverts

0.21.0 (2022-05-13)

Bug Fixes

Features

Reverts