Skip to content

Commit

Permalink
Update tuning/data/setup_dataprocessor.py
Browse files Browse the repository at this point in the history
Co-authored-by: Yu Chin Fabian Lim <[email protected]>
Signed-off-by: Hari <[email protected]>
  • Loading branch information
HarikrishnanBalagopal and fabianlim authored Dec 21, 2024
1 parent 9ec15b5 commit bf03ac6
Showing 1 changed file with 0 additions and 2 deletions.
2 changes: 0 additions & 2 deletions tuning/data/setup_dataprocessor.py
Original file line number Diff line number Diff line change
Expand Up @@ -320,8 +320,6 @@ def process_dataargs(
Used for packing and max_seq_length
additional_data_handlers: A Dict of [str, callable] data handlers
which need to be registered with the data preprocessor
padding_free: str
padding free method
Returns:
Tuple(Dataset, Dataset, str, DataCollator, int, Dict)
tuple containing
Expand Down

0 comments on commit bf03ac6

Please sign in to comment.