2.0.65

Changelog

Unreleased

No issue

CCMSG-1613 | Use the configured schema.generation.key.name and schema.generation.value.name while creating the schema's. (#204)

7506b3da07014e8 Parag 2022-10-17 15:13:15

2.0.64: Issue 183 (#195)

Changelog

Unreleased

No issue

Issue 183 (#195)

• Removed shaded components. Fixes #183
• Corrected description. Fixes #184.
• Corrected description. Fixes #159

ec283f8439905c2 Jeremy Custenborder 2021-12-16 16:33:36

2.0.63: Issue 183 (#195)

Changelog

Unreleased

No issue

Issue 183 (#195)

• Removed shaded components. Fixes #183
• Corrected description. Fixes #184.
• Corrected description. Fixes #159

ec283f8439905c2 Jeremy Custenborder 2021-12-16 16:33:36

Upgrade opencsv to 4.6 and commons-beanutils to 1.9.4 (#191)

• Co-authored-by: Konstantine Karantasis <[email protected]>

a790464a12eebfe Konstantine Karantasis 2021-09-24 12:52:45

2.0.62: new header: file.parent.dir.name (#181)

Changelog

Unreleased

GitHub #180 feature: new metadata header "file.parent.dir.name"

new header: file.parent.dir.name (#181)

• changes for #180
• fix leading whitespace
• fix unit test for new header addition

fce8cddc6c6b9c9 bitsofinfo 2021-04-29 17:04:57

GitHub #181 new header: file.parent.dir.name

new header: file.parent.dir.name (#181)

• changes for #180
• fix leading whitespace
• fix unit test for new header addition

fce8cddc6c6b9c9 bitsofinfo 2021-04-29 17:04:57

2.0.61

Changelog

Unreleased

GitHub #176 SpoolDirLineDelimitedSourceTask NPE on recordOffset() bug

NPE thrown when retrieving the offset for a file that filed to open. Fixes #176 (#177)

75a9b43a7c896bd Jeremy Custenborder 2021-03-26 17:44:32

GitHub #177 NPE thrown when retrieving the offset for a file that filed to open. …

NPE thrown when retrieving the offset for a file that filed to open. Fixes #176 (#177)

75a9b43a7c896bd Jeremy Custenborder 2021-03-26 17:44:32

2.0.60

Changelog

Unreleased

GitHub #173 Plugin should suppport multiple versions of the Confluent Platform bug

Refactored to shade jackson and guava. Fixes #173. (#175)

9e5c130f5784ba7 Jeremy Custenborder 2021-02-14 23:37:56

GitHub #175 Refactored to shade jackson and guava. Fixes #173.

Refactored to shade jackson and guava. Fixes #173. (#175)

9e5c130f5784ba7 Jeremy Custenborder 2021-02-14 23:37:56

2.0.59: Issue 100 (#172)

Changelog

Unreleased

GitHub #100 Add support for ingesting Avro files enhancement

Issue 100 (#172)

• Initial commit adding support for reading avro files. Fixes #100.

• Updated introduction.

• Added testcases and added method to start the processing of a while when you don't open in the context of the InputFile.

• Added check to test case to call out when a resource file is not found.

• Added testing data for Avro files.

• Code cleanup.

• Updated documentation about installation.

• Updated to new parent pom to correct jdk 11 issues. Fixes #170.

011238a24d385e3 Jeremy Custenborder 2021-02-03 22:08:44

GitHub #170 Building with jdk 11 causes plugin to not load with jdk 8. bug

Issue 100 (#172)

• Initial commit adding support for reading avro files. Fixes #100.

• Updated introduction.

• Added testcases and added method to start the processing of a while when you don't open in the context of the InputFile.

• Added check to test case to call out when a resource file is not found.

• Added testing data for Avro files.

• Code cleanup.

• Updated documentation about installation.

• Updated to new parent pom to correct jdk 11 issues. Fixes #170.

011238a24d385e3 Jeremy Custenborder 2021-02-03 22:08:44

GitHub #172 Issue 100

Issue 100 (#172)

• Initial commit adding support for reading avro files. Fixes #100.

• Updated introduction.

• Added testcases and added method to start the processing of a while when you don't open in the context of the InputFile.

• Added check to test case to call out when a resource file is not found.

• Added testing data for Avro files.

• Code cleanup.

• Updated documentation about installation.

• Updated to new parent pom to correct jdk 11 issues. Fixes #170.

011238a24d385e3 Jeremy Custenborder 2021-02-03 22:08:44

2.0.58: Multiple fixes (#166)

Changelog

Unreleased

GitHub #133 Blank lines

Multiple fixes (#166)

• Change parent version to bring in alternative dependencies. fixes #162. fixes #156.
• Refactored to store all references to streams and readers in the InputFile class to ensure they are closed. Cleanup policies now will ensure that file handles are closed. Fixes #163
• Added example of copying headers to field names. Fixes #149.
• Schema settings were not being sent to tasks causing the tasks to error. Fixes #157.
• CsvSchemaGenerator was not using the builder to create an instance the CSVReader. Fixes #164.
• Added check when there are blank lines in a file. Skip any blank lines. Fixes #133.

10dcc694cad3336 Jeremy Custenborder 2021-01-19 23:02:36

GitHub #149 add a static/dynamic field in value schema.

Multiple fixes (#166)

• Change parent version to bring in alternative dependencies. fixes #162. fixes #156.
• Refactored to store all references to streams and readers in the InputFile class to ensure they are closed. Cleanup policies now will ensure that file handles are closed. Fixes #163
• Added example of copying headers to field names. Fixes #149.
• Schema settings were not being sent to tasks causing the tasks to error. Fixes #157.
• CsvSchemaGenerator was not using the builder to create an instance the CSVReader. Fixes #164.
• Added check when there are blank lines in a file. Skip any blank lines. Fixes #133.

10dcc694cad3336 Jeremy Custenborder 2021-01-19 23:02:36

GitHub #156 ClassNotFoundException: com.fasterxml.jackson.annotation.JsonKey due to the old jackson-annotations-2.9.0

Multiple fixes (#166)

• Change parent version to bring in alternative dependencies. fixes #162. fixes #156.
• Refactored to store all references to streams and readers in the InputFile class to ensure they are closed. Cleanup policies now will ensure that file handles are closed. Fixes #163
• Added example of copying headers to field names. Fixes #149.
• Schema settings were not being sent to tasks causing the tasks to error. Fixes #157.
• CsvSchemaGenerator was not using the builder to create an instance the CSVReader. Fixes #164.
• Added check when there are blank lines in a file. Skip any blank lines. Fixes #133.

10dcc694cad3336 Jeremy Custenborder 2021-01-19 23:02:36

GitHub #157 DataException: "'value.schema' must be set to a valid schema" after correct schema generation

Multiple fixes (#166)

• Change parent version to bring in alternative dependencies. fixes #162. fixes #156.
• Refactored to store all references to streams and readers in the InputFile class to ensure they are closed. Cleanup policies now will ensure that file handles are closed. Fixes #163
• Added example of copying headers to field names. Fixes #149.
• Schema settings were not being sent to tasks causing the tasks to error. Fixes #157.
• CsvSchemaGenerator was not using the builder to create an instance the CSVReader. Fixes #164.
• Added check when there are blank lines in a file. Skip any blank lines. Fixes #133.

10dcc694cad3336 Jeremy Custenborder 2021-01-19 23:02:36

GitHub #162 Plugin throwing exception with Kafka 2.7.0

Multiple fixes (#166)

• Change parent version to bring in alternative dependencies. fixes #162. fixes #156.
• Refactored to store all references to streams and readers in the InputFile class to ensure they are closed. Cleanup policies now will ensure that file handles are closed. Fixes #163
• Added example of copying headers to field names. Fixes #149.
• Schema settings were not being sent to tasks causing the tasks to error. Fixes #157.
• CsvSchemaGenerator was not using the builder to create an instance the CSVReader. Fixes #164.
• Added check when there are blank lines in a file. Skip any blank lines. Fixes #133.

10dcc694cad3336 Jeremy Custenborder 2021-01-19 23:02:36

GitHub #163 Cleanup policy can leak buffers with extreme number of errored files. bug

Multiple fixes (#166)

• Change parent version to bring in alternative dependencies. fixes #162. fixes #156.
• Refactored to store all references to streams and readers in the InputFile class to ensure they are closed. Cleanup policies now will ensure that file handles are closed. Fixes #163
• Added example of copying headers to field names. Fixes #149.
• Schema settings were not being sent to tasks causing the tasks to error. Fixes #157.
• CsvSchemaGenerator was not using the builder to create an instance the CSVReader. Fixes #164.
• Added check when there are blank lines in a file. Skip any blank lines. Fixes #133.

10dcc694cad3336 Jeremy Custenborder 2021-01-19 23:02:36

GitHub #164 Skipping rows for header

Multiple fixes (#166)

• Change parent version to bring in alternative dependencies. fixes #162. fixes #156.
• Refactored to store all references to streams and readers in the InputFile class to ensure they are closed. Cleanup policies now will ensure that file handles are closed. Fixes #163
• Added example of copying headers to field names. Fixes #149.
• Schema settings were not being sent to tasks causing the tasks to error. Fixes #157.
• CsvSchemaGenerator was not using the builder to create an instance the CSVReader. Fixes #164.
• Added check when there are blank lines in a file. Skip any blank lines. Fixes #133.

10dcc694cad3336 Jeremy Custenborder 2021-01-19 23:02:36

GitHub #166 Multiple fixes

Multiple fixes (#166)

• Change parent version to bring in alternative dependencies. fixes #162. fixes #156.
• Refactored to store all references to streams and readers in the InputFile class to ensure they are closed. Cleanup policies now will ensure that file handles are closed. Fixes #163
• Added example of copying headers to field names. Fixes #149.
• Schema settings were not being sent to tasks causing the tasks to error. Fixes #157.
• CsvSchemaGenerator was not using the builder to create an instance the CSVReader. Fixes #164.
• Added check when there are blank lines in a file. Skip any blank lines. Fixes #133.

10dcc694cad3336 Jeremy Custenborder 2021-01-19 23:02:36

2.0.57: Multiple fixes (#165)

Changelog

Unreleased

GitHub #149 add a static/dynamic field in value schema.

Multiple fixes (#165)

• Change parent version to bring in alternative dependencies. fixes #162. fixes #156.
• Refactored to store all references to streams and readers in the InputFile class to ensure they are closed. Cleanup policies now will ensure that file handles are closed. Fixes #163
• Added example of copying headers to field names. Fixes #149.
• Schema settings were not being sent to tasks causing the tasks to error. Fixes #157.

43fab15dbb00a1f Jeremy Custenborder 2021-01-15 19:53:24

GitHub #156 ClassNotFoundException: com.fasterxml.jackson.annotation.JsonKey due to the old jackson-annotations-2.9.0

Multiple fixes (#165)

• Change parent version to bring in alternative dependencies. fixes #162. fixes #156.
• Refactored to store all references to streams and readers in the InputFile class to ensure they are closed. Cleanup policies now will ensure that file handles are closed. Fixes #163
• Added example of copying headers to field names. Fixes #149.
• Schema settings were not being sent to tasks causing the tasks to error. Fixes #157.

43fab15dbb00a1f Jeremy Custenborder 2021-01-15 19:53:24

GitHub #157 DataException: "'value.schema' must be set to a valid schema" after correct schema generation

Multiple fixes (#165)

• Change parent version to bring in alternative dependencies. fixes #162. fixes #156.
• Refactored to store all references to streams and readers in the InputFile class to ensure they are closed. Cleanup policies now will ensure that file handles are closed. Fixes #163
• Added example of copying headers to field names. Fixes #149.
• Schema settings were not being sent to tasks causing the tasks to error. Fixes #157.

43fab15dbb00a1f Jeremy Custenborder 2021-01-15 19:53:24

GitHub #162 Plugin throwing exception with Kafka 2.7.0

Multiple fixes (#165)

• Change parent version to bring in alternative dependencies. fixes #162. fixes #156.
• Refactored to store all references to streams and readers in the InputFile class to ensure they are closed. Cleanup policies now will ensure that file handles are closed. Fixes #163
• Added example of copying headers to field names. Fixes #149.
• Schema settings were not being sent to tasks causing the tasks to error. Fixes #157.

43fab15dbb00a1f Jeremy Custenborder 2021-01-15 19:53:24

GitHub #163 Cleanup policy can leak buffers with extreme number of errored files. bug

Multiple fixes (#165)

• Change parent version to bring in alternative dependencies. fixes #162. fixes #156.
• Refactored to store all references to streams and readers in the InputFile class to ensure they are closed. Cleanup policies now will ensure that file handles are closed. Fixes #163
• Added example of copying headers to field names. Fixes #149.
• Schema settings were not being sent to tasks causing the tasks to error. Fixes #157.

43fab15dbb00a1f Jeremy Custenborder 2021-01-15 19:53:24

GitHub #165 Multiple fixes

Multiple fixes (#165)

• Change parent version to bring in alternative dependencies. fixes #162. fixes #156.
• Refactored to store all references to streams and readers in the InputFile class to ensure they are closed. Cleanup policies now will ensure that file handles are closed. Fixes #163
• Added example of copying headers to field names. Fixes #149.
• Schema settings were not being sent to tasks causing the tasks to error. Fixes #157.

43fab15dbb00a1f Jeremy Custenborder 2021-01-15 19:53:24

2.0.56

Changelog

Unreleased

GitHub #155 Changing to correct Task SpoolDirBinaryFileSourceTask

Changing to correct Task SpoolDirBinaryFileSourceTask (#155)

• Co-authored-by: rlanhellas <[email protected]>

d02632bda504904 Ronaldo Lanhellas 2020-12-07 20:01:26

GitHub #161 Update docs URL path

Update docs URL path (#161)

df641c5ce5fd99a tikimims 2021-01-06 19:40:00