Skip to content

Latest commit

 

History

History
261 lines (224 loc) · 23.6 KB

CHANGELOG.md

File metadata and controls

261 lines (224 loc) · 23.6 KB

Changelog

v0.6.2 (2022-11-07)

  • 99be6c0 Update manifests to v0.6.2
  • dc733da feat: populate watermark settings to vertex spec. Closes #320 (#321)
  • 2b247ca doc: add few use cases (#318)
  • 07ffa16 Chore: run in sdks-e2e tests, python-udsink log check before go-udsink (#315)
  • 7b3285b fix: jetstream build watermark progressors bug (#316)
  • 1198a60 feat: update watermark offset bucket implementation (#307)
  • 34a6d70 feat: shuffling support (#306)
  • 448127f feat: customize init-container resources. Closes #303 (#304)
  • 61cf227 feat: watermark - remove non-share OT bucket option (#302)
  • 51c9ff4 feat: customization for batch jobs. Closes #259 (#300)
  • afbe255 refactor: abstract pod template (#296)
  • 2408946 feat: customization for daemon deployment. Closes #223 (#290)
  • bedf567 feat: add pvc support for reduce vertex PBQ (#292)
  • 2341614 fix(doc): hyperlink for security doc (#288)
  • 6c05190 feat: support adding init containers to vertices. Closes #284 (#285)
  • dc96b87 fix: retry when getting EOF error at E2E test (#281)
  • f5db937 feat: Watermark millisecond. Fixes #201 (#278)
  • c153536 feat: add pipeline node counts and age to printcolumn. Closes #267 (#282)

Contributors

  • David Seapy
  • Derek Wang
  • Juanlu Yu
  • Keran Yang
  • Vigith Maurice

v0.6.1 (2022-10-26)

  • 32b284f Update manifests to v0.6.1
  • 9684e16 fix(manifests): Include ServiceAccount in namespace scoped install (#240)
  • fe83918 fix(docs): fix a typo (#241)
  • f2094b4 feat: introduce reduce UDF. Closes #246 (#262)
  • e19a1e7 feat: add pandoc to required tools development doc. Closes #276 (#277)
  • 9a93711 feat: add isbsvc type and age to printcolumn. Closes #268 (#275)
  • f25e303 fix: watermark consumer fix (#273)
  • d2a3d90 refactor: generalize watermark fetching as an interface of ISB service. Fixes #252 (#263)
  • 5ffcadc fix: set default property values for minimal CRD installation (#264)
  • 17a9956 fix: validate only one isbsvc implementation type is defined. Fixes #269 (#271)
  • 2272a1f fix: main branch make build failure: math.MaxInt64 for int type (#265)
  • 02c31d2 fix: nil pointer deref when running example with minimal CRD. Fixes #260 (#261)
  • 391b53e fix: retry only the failed offsets (#255)
  • 7b42dc8 fix: re-enable build constraint on processor manager test. Fixes #256 (#257)
  • 3436049 fix: container resource for jetstream isbsvc. Fixes #253 (#254)
  • 33ce742 fix: update vertex watermark fetching logic. Fixes: #134 (#245)
  • fd219a5 fix: watermark watcher leak (#242)
  • 979a3a3 feat: Support running UX server with namespace scope. Fixes #248 (#249)
  • 5e9d1c1 fix: Watermark close fix and removed the nil check (#238)
  • 340bd82 fix: skip publishing watermarks to unexpected vertices. Fixes #235 (#236)
  • 904b2cd fix: update default watermark to -1. Fixes #133 (#218)
  • 321e285 feat: support disabling TLS and changing port for UX server (#228)
  • d0d74e1 feat: reducer for stream aggregation without fault tolerance (#208)
  • 06a9b58 feat: in-memory watermark store for better testing (#216)
  • f25cc58 Add USERS.md (#221)
  • a37cece fix(watermark): generator should not publish wm for every message (#217)

Contributors

  • David Seapy
  • Derek Wang
  • Ed Lee
  • Juanlu Yu
  • Keran Yang
  • SianLoong
  • Yashash H L
  • ashwinidulams

v0.6.0 (2022-10-12)

  • 48aad5f Update manifests to v0.6.0
  • 09ce54f fix(autoscaling): Ack pending should be included in total pending calculation (#212)
  • 9922787 fix(autoscaling): Skip autoscaling if vertex is not in running phase (#207)
  • bc2380a feat: ISBSVC add support for redis cluster mode (#195)
  • 72a96a5 refactor: move controllers package to pkg/reconciler (#192)
  • b1b78fa fix: update udf fetchWatermark and publishWatermark initial values (#193)
  • d491260 fix(docs): readme for UI development (#181)
  • 6b121c6 feat: grpc udsink (#174)
  • 567da7b fix: numaflow-go udf example & docs (#177)
  • 4652f80 fix: use scale.max if it is set (#179)
  • 900314b fix broken path (#176)
  • 3b02f2a feat: Shuffle implementation (#169)
  • 021bb9d feat: windowing operations (#157)
  • 7d41129 feat: watermark for sources (#159)
  • 5f5b2df fix: daemon service client memory leak (#161)
  • bfe9669 pbq implementation (#155)
  • 8dfedd8 feat: check if udf is running in liveness probe (#156)
  • 81e76d8 feat: Add udf grpc support Fixes #145 (#146)
  • 511faff refactor: some refactor on watermark (#149)
  • 7fe40c4 fix: Fixed JS bug (#144)
  • 24a16a0 bug: watermark needs nil check
  • f4ed831 fix: pipeline UI broken when vertex scaling down to 0 (#132)
  • 0ae0377 feat: JetStream auto-reconnection (#127)
  • 2fc04eb feat: Add watermark for sink vertex (#124)
  • d958ee6 feat: autoscaling with back pressure factor (#123)
  • b1f7768 feat: add watermark to UI (#122)
  • 7feeaa8 feat: add processing rate to UI (#121)
  • 43fae93 feat: Expose watermark over HTTP (#120)
  • ec02304 fix: daemon service rest api not working (#119)
  • f3da56d chore(deps): bump terser from 5.14.1 to 5.14.2 in /ui (#117)
  • e2e63c8 feat: Numaflow autoscaling (#115)
  • e5da3f5 feat: watermark for headoffset (#116)
  • a45b2ee feat: support namespace scope installation (#112)
  • ce39199 feat: Expose ReadTimeoutSeconds on Vertex (#110)
  • 18ad1c5 fix: imagepullpocily for local testing (#113)
  • 469849b feat: removed udfWorkers from limits and added some docs (#103)
  • 3fada66 feat: Add icon and other minor changes (#94)
  • a81838d feat: end to end tickgen watermark validation (#98)
  • d7d9317 fix: Broken hyperlink (#96)
  • a2e0792 add no-op KV Store (#91)
  • 45c8cb6 feat: no operation watermark progressor (#90)
  • 448c229 feat: kafka source pending messages (#80)
  • 1aa3930 feat: Interface for Watermark (#82)
  • be78c52 feat: expose pending messages and processing rate (#79)
  • df30f2a feat: Added the right way to decipher from and to vertex (#78)
  • 639c459 feat: define buffer limits on edges (#70)
  • 41fdd38 feat: Merge UX server code (#67)
  • ced9907 feat: auto-scaling (part 1) (#59)
  • fd5b374 Added name to service spec (#58)
  • dc2badf feat: introduce source buffer and sink buffer (#53)
  • 4ed83a2 feat: async publishing for kafka sink (#51)
  • 9f9f5ba fix spelling errors (#48)
  • f423002 feat: controller to create buckets (#47)
  • 8328739 turn on watermark only if ENV value is true (#46)
  • 46f72e2 minimal end to end line-graph watermark integration (#43)
  • 1f8203f Fixed spelling error (#44)
  • f1e99ea Exponential buckets (#42)
  • dfcfdeb fix: different behavior for time.After in go 1.18 (#39)

Contributors

  • Chrome
  • Derek Wang
  • Juanlu Yu
  • Krithika3
  • Qianbo Huai
  • Saravanan Balasubramanian
  • Sidhant Kohli
  • Vigith Maurice
  • Yashash H L
  • dependabot[bot]

v0.5.6 (2022-09-19)

  • ac15d22 Update manifests to v0.5.6
  • f236375 feat: grpc udsink (#174)
  • 2650c2d fix: numaflow-go udf example & docs (#177)
  • c44f733 fix: use scale.max if it is set (#179)
  • 39e92d0 fix broken path (#176)
  • 46ce0f8 feat: Shuffle implementation (#169)
  • 71ca00a feat: windowing operations (#157)
  • ca00b78 feat: watermark for sources (#159)
  • 91e21ce pbq implementation (#155)
  • 6542400 feat: check if udf is running in liveness probe (#156)
  • 79dce0b feat: Add udf grpc support Fixes #145 (#146)

Contributors

  • Chrome
  • Derek Wang
  • Juanlu Yu
  • Vigith Maurice
  • Yashash H L

v0.5.5 (2022-09-07)

  • 9aae638 Update manifests to v0.5.5
  • 3241432 fix: daemon service client memory leak (#161)
  • be47a26 refactor: some refactor on watermark (#149)
  • 857cce7 fix: Fixed JS bug (#144)
  • da16abc bug: watermark needs nil check
  • c9998a1 fix: pipeline UI broken when vertex scaling down to 0 (#132)

Contributors

  • Derek Wang
  • Krithika3
  • Vigith Maurice

v0.5.4 (2022-08-05)

  • 57513b4 Update manifests to v0.5.4
  • 94cdb82 feat: JetStream auto-reconnection (#127)
  • 8d83540 feat: Add watermark for sink vertex (#124)
  • 228ba32 feat: autoscaling with back pressure factor (#123)
  • 9833efd feat: add watermark to UI (#122)
  • 0dab55d feat: add processing rate to UI (#121)
  • ffd38a1 feat: Expose watermark over HTTP (#120)
  • c09502a fix: daemon service rest api not working (#119)
  • ebc10f4 chore(deps): bump terser from 5.14.1 to 5.14.2 in /ui (#117)
  • 84490ca feat: Numaflow autoscaling (#115)
  • 32b9848 feat: watermark for headoffset (#116)
  • 283dae9 feat: support namespace scope installation (#112)
  • 8e612b1 feat: Expose ReadTimeoutSeconds on Vertex (#110)
  • d95d41b fix: imagepullpocily for local testing (#113)

Contributors

  • Derek Wang
  • Krithika3
  • Saravanan Balasubramanian
  • Sidhant Kohli
  • Vigith Maurice
  • dependabot[bot]

v0.5.3 (2022-07-08)

  • efee544 Update manifests to v0.5.3
  • 5895fac feat: removed udfWorkers from limits and added some docs (#103)
  • 0b75495 feat: Add icon and other minor changes (#94)
  • 7eb08f5 feat: end to end tickgen watermark validation (#98)
  • 3338e65 fix: Broken hyperlink (#96)
  • e311222 add no-op KV Store (#91)
  • 5d2f90e feat: no operation watermark progressor (#90)
  • f58d0f4 feat: kafka source pending messages (#80)
  • cbb16ca feat: Interface for Watermark (#82)
  • 5592bb1 feat: expose pending messages and processing rate (#79)
  • 06a3df2 feat: Added the right way to decipher from and to vertex (#78)
  • a0908ad feat: define buffer limits on edges (#70)
  • a1d3639 feat: Merge UX server code (#67)
  • 571c48e feat: auto-scaling (part 1) (#59)
  • 1e0384b Added name to service spec (#58)

Contributors

  • Derek Wang
  • Krithika3
  • Sidhant Kohli
  • Vigith Maurice

v0.5.2 (2022-06-13)

  • 2f2d10c Update manifests to v0.5.2
  • cedd0d1 feat: introduce source buffer and sink buffer (#53)
  • d3301aa feat: async publishing for kafka sink (#51)
  • 2474eb8 fix spelling errors (#48)
  • c4a12f8 feat: controller to create buckets (#47)
  • eb97dc3 turn on watermark only if ENV value is true (#46)
  • f189ba3 minimal end to end line-graph watermark integration (#43)

Contributors

  • Derek Wang
  • Qianbo Huai
  • Vigith Maurice

v0.5.1 (2022-06-02)

  • bb9be80 Update manifests to v0.5.1
  • 912747e Fixed spelling error (#44)
  • 3aeb33a Exponential buckets (#42)
  • 1d65682 fix: different behavior for time.After in go 1.18 (#39)

Contributors

  • Derek Wang
  • Krithika3