Code

Add BERT Model To NeMo2.0#11333

Code

Merged

JRD971000 merged 59 commits intomainNVIDIA/NeMo:mainfrom aot/bert-nemo-uxNVIDIA/NeMo:aot/bert-nemo-uxCopy head branch name to clipboardDec 5, 2024

+2,071-4

Commits

Commits on Sep 4, 2024

• add bert in nemo2

  suiyoubi

  committed
  b922807

  Copy full SHA for b922807

Commits on Sep 9, 2024

• Add bert loss

  suiyoubi

  committed
  0e0822c

  Copy full SHA for 0e0822c

Commits on Nov 14, 2024

• Merge branch 'main' into aot/bert-nemo-ux

  Show description for ccab2d5
  suiyoubi

  committed
  ccab2d5

  Copy full SHA for ccab2d5

• update bert with latest nemo

  suiyoubi

  committed
  70973cd

  Copy full SHA for 70973cd

• Apply isort and black reformatting

  Show description for 686eed1
  suiyoubi

  committed
  686eed1

  Copy full SHA for 686eed1

Commits on Nov 18, 2024

• Bert update

  suiyoubi

  committed
  794951e

  Copy full SHA for 794951e

• Apply isort and black reformatting

  Show description for bf91626
  suiyoubi

  committed
  bf91626

  Copy full SHA for bf91626

• import optimize

  suiyoubi

  committed
  c2b2949

  Copy full SHA for c2b2949

• Apply isort and black reformatting

  Show description for f64457f
  suiyoubi

  committed
  f64457f

  Copy full SHA for f64457f

Commits on Nov 19, 2024

• pylint

  suiyoubi

  committed
  d70c098

  Copy full SHA for d70c098

• Merge remote-tracking branch 'origin/aot/bert-nemo-ux' into aot/bert-nemo-ux

  suiyoubi

  committed
  27707f5

  Copy full SHA for 27707f5

• Apply isort and black reformatting

  Show description for b91c247
  suiyoubi

  committed
  b91c247

  Copy full SHA for b91c247

• Merge remote-tracking branch 'origin/main' into aot/bert-nemo-ux

  Show description for 146c21b
  suiyoubi

  committed
  146c21b

  Copy full SHA for 146c21b

• Merge remote-tracking branch 'origin/aot/bert-nemo-ux' into aot/bert-nemo-ux

  suiyoubi

  committed
  3a8841c

  Copy full SHA for 3a8841c

• pylint

  suiyoubi

  committed
  3247f36

  Copy full SHA for 3247f36

• Apply isort and black reformatting

  Show description for bcc9b7c
  suiyoubi

  committed
  bcc9b7c

  Copy full SHA for bcc9b7c

• pylint

  suiyoubi

  committed
  5f19763

  Copy full SHA for 5f19763

• Merge remote-tracking branch 'origin/aot/bert-nemo-ux' into aot/bert-nemo-ux

  suiyoubi

  committed
  9bbef09

  Copy full SHA for 9bbef09

• Apply isort and black reformatting

  Show description for f42ec30
  suiyoubi

  committed
  f42ec30

  Copy full SHA for f42ec30

Commits on Nov 20, 2024

• more comment

  suiyoubi

  committed
  388ed8a

  Copy full SHA for 388ed8a

• Merge remote-tracking branch 'origin/aot/bert-nemo-ux' into aot/bert-nemo-ux

  suiyoubi

  committed
  11a141e

  Copy full SHA for 11a141e

Commits on Nov 21, 2024

• Merge remote-tracking branch 'origin/main' into aot/bert-nemo-ux

  suiyoubi

  committed
  8dad5a5

  Copy full SHA for 8dad5a5

• use lightning package

  suiyoubi

  committed
  f00d2df

  Copy full SHA for f00d2df

• Apply isort and black reformatting

  Show description for ba73a4d
  suiyoubi

  committed
  ba73a4d

  Copy full SHA for ba73a4d

Commits on Nov 22, 2024

• comments resolved

  suiyoubi

  committed
  546a646

  Copy full SHA for 546a646

• Merge remote-tracking branch 'origin/aot/bert-nemo-ux' into aot/bert-nemo-ux

  suiyoubi

  committed
  2cf371d

  Copy full SHA for 2cf371d

• Add loss

  suiyoubi

  committed
  659e29c

  Copy full SHA for 659e29c

• Apply isort and black reformatting

  Show description for 2c542d0
  suiyoubi

  committed
  2c542d0

  Copy full SHA for 2c542d0

• Fix NaN loss when resume

  suiyoubi

  committed
  451a1a0

  Copy full SHA for 451a1a0

• Merge remote-tracking branch 'origin/aot/bert-nemo-ux' into aot/bert-nemo-ux

  suiyoubi

  committed
  c72f1be

  Copy full SHA for c72f1be

• Apply isort and black reformatting

  Show description for d2bbe9c
  suiyoubi

  committed
  d2bbe9c

  Copy full SHA for d2bbe9c

• add default for num_tokentypes

  suiyoubi

  committed
  846b236

  Copy full SHA for 846b236

Commits on Nov 24, 2024

• update forward output to be a dict

  suiyoubi

  committed
  cc1893d

  Copy full SHA for cc1893d

• Apply isort and black reformatting

  Show description for 9654cfd
  suiyoubi

  committed
  9654cfd

  Copy full SHA for 9654cfd

• ReName to HuggingFace Bert Model

  suiyoubi

  committed
  8658f53

  Copy full SHA for 8658f53

Commits on Nov 26, 2024

• Add BertLarge

  suiyoubi

  committed
  cb1332d

  Copy full SHA for cb1332d

• Apply isort and black reformatting

  Show description for 7ae576c
  suiyoubi

  committed
  7ae576c

  Copy full SHA for 7ae576c

• Add BERT Tests

  suiyoubi

  committed
  3826aa3

  Copy full SHA for 3826aa3

• Merge remote-tracking branch 'origin/aot/bert-nemo-ux' into aot/bert-nemo-ux

  suiyoubi

  committed
  51692ad

  Copy full SHA for 51692ad

• Apply isort and black reformatting

  Show description for ea969ed
  suiyoubi

  committed
  ea969ed

  Copy full SHA for ea969ed

• typo

  suiyoubi

  committed
  06f03ff

  Copy full SHA for 06f03ff

• add exporter

  suiyoubi

  committed
  f61877a

  Copy full SHA for f61877a

• Apply isort and black reformatting

  Show description for 79acd82
  suiyoubi

  committed
  79acd82

  Copy full SHA for 79acd82

• Fix Unit Tests

  suiyoubi

  committed
  19337e3

  Copy full SHA for 19337e3

• Apply isort and black reformatting

  Show description for b15051d
  suiyoubi

  committed
  b15051d

  Copy full SHA for b15051d

Commits on Nov 27, 2024

• add sig

  suiyoubi

  committed
  cca4c79

  Copy full SHA for cca4c79

Commits on Nov 28, 2024

• rename pretraining dataset testing for bert

  suiyoubi

  committed
  db19dd1

  Copy full SHA for db19dd1

• delete pretraining dataset testing for bert

  suiyoubi

  committed
  a2a859c

  Copy full SHA for a2a859c

• Merge branch 'main' into aot/bert-nemo-ux

  suiyoubi

  authored
  1e9bc3f

  Copy full SHA for 1e9bc3f

Commits on Dec 2, 2024

• resolve TE dependency

  suiyoubi

  committed
  69b6128

  Copy full SHA for 69b6128

• Apply isort and black reformatting

  Show description for 27b56a9
  suiyoubi

  committed
  27b56a9

  Copy full SHA for 27b56a9

• resolve TE dependency

  suiyoubi

  committed
  56fa3f1

  Copy full SHA for 56fa3f1

• resolve TE dependency

  suiyoubi

  committed
  9b11d84

  Copy full SHA for 9b11d84

• resolve TE dependency

  suiyoubi

  committed
  4a7f608

  Copy full SHA for 4a7f608

• Apply isort and black reformatting

  Show description for 5acf9aa
  suiyoubi

  committed
  5acf9aa

  Copy full SHA for 5acf9aa

• resolve TE dependency

  suiyoubi

  committed
  d363a11

  Copy full SHA for d363a11

• Apply isort and black reformatting

  Show description for c0a7836
  suiyoubi

  committed
  c0a7836

  Copy full SHA for c0a7836

Commits on Dec 3, 2024

• Merge branch 'main' into aot/bert-nemo-ux

  suiyoubi

  authored
  de1c788

  Copy full SHA for de1c788

• Merge branch 'main' into aot/bert-nemo-ux

  suiyoubi

  authored
  8e28ff5

  Copy full SHA for 8e28ff5