citation file (NVIDIA-NeMo#1165)

* text curation updates

Signed-off-by: Lawrence Lane <[email protected]>

* concepts

Signed-off-by: Lawrence Lane <[email protected]>

* remove synthetic docs not for this release

Signed-off-by: Lawrence Lane <[email protected]>

* updates

Signed-off-by: Lawrence Lane <[email protected]>

* text concepts and getting started changes

Signed-off-by: Lawrence Lane <[email protected]>

* links, concepts

Signed-off-by: Lawrence Lane <[email protected]>

* crosslinks

Signed-off-by: Lawrence Lane <[email protected]>

* quality assessment updates

Signed-off-by: Lawrence Lane <[email protected]>

* more cleanup

Signed-off-by: Lawrence Lane <[email protected]>

* semdedup

Signed-off-by: Lawrence Lane <[email protected]>

* example import cleanup

Signed-off-by: Lawrence Lane <[email protected]>

* concepts

Signed-off-by: Lawrence Lane <[email protected]>

* Update docs/about/concepts/text/data-acquisition-concepts.md

Co-authored-by: Praateek Mahajan <[email protected]>
Signed-off-by: L.B. <[email protected]>

* feedback batch 1

Signed-off-by: Lawrence Lane <[email protected]>

* feedback batch 2

Signed-off-by: Lawrence Lane <[email protected]>

* file_paths="/path/to/jsonl_directory",

Signed-off-by: Lawrence Lane <[email protected]>

* revert removal of xenna for common crawl executors

Signed-off-by: Lawrence Lane <[email protected]>

* quickstart installation steps

Signed-off-by: Lawrence Lane <[email protected]>

* Update docs/about/concepts/text/data-acquisition-concepts.md

Co-authored-by: Sarah Yurick <[email protected]>
Signed-off-by: L.B. <[email protected]>

* data loading concepts updates / simplification

Signed-off-by: Lawrence Lane <[email protected]>

* data processing feedback

Signed-off-by: Lawrence Lane <[email protected]>

* read-existing pg updates

Signed-off-by: Lawrence Lane <[email protected]>

* add-id updates

Signed-off-by: Lawrence Lane <[email protected]>

* dedup updates

Signed-off-by: Lawrence Lane <[email protected]>

* feedback

Signed-off-by: Lawrence Lane <[email protected]>

* citation file

Signed-off-by: Lawrence Lane <[email protected]>

* fix

Signed-off-by: Lawrence Lane <[email protected]>

* updates

Signed-off-by: Lawrence Lane <[email protected]>

---------

Signed-off-by: Lawrence Lane <[email protected]>
Signed-off-by: L.B. <[email protected]>
Co-authored-by: Praateek Mahajan <[email protected]>
Co-authored-by: Sarah Yurick <[email protected]>
Signed-off-by: Lawrence Lane <[email protected]>

Author: 3 people

CITATION.cff

@@ -1,25 +1,63 @@
-cff-version: 1.0.0
+cff-version: 1.2.0
 message: "If you use this software, please cite it as below."
 title: "NeMo-Curator: a toolkit for data curation"
 repository-code: https://github.com/NVIDIA-NeMo/Curator
+url: https://github.com/NVIDIA-NeMo/Curator
 authors:
   - family-names: Jennings
     given-names: Joseph
+    affiliation: "NVIDIA"
   - family-names: Patwary
     given-names: Mostofa
+    affiliation: "NVIDIA"
   - family-names: Subramanian
     given-names: Sandeep
+    affiliation: "NVIDIA (at the time of contribution)"
   - family-names: Prabhumoye
     given-names: Shrimai
+    affiliation: "NVIDIA"
   - family-names: Dattagupta
     given-names: Ayush
+    affiliation: "NVIDIA"
   - family-names: Jawa
     given-names: Vibhu
+    affiliation: "NVIDIA"
   - family-names: Liu
     given-names: Jiwei
+    affiliation: "NVIDIA"
   - family-names: Wolf
     given-names: Ryan
+    affiliation: "NVIDIA (at the time of contribution)"
   - family-names: Yurick
     given-names: Sarah
+    affiliation: "NVIDIA"
   - family-names: Singh
     given-names: Varun
+    affiliation: "NVIDIA"
+  - family-names: Chang
+    given-names: Dong Hyuk
+    affiliation: "NVIDIA"
+  - family-names: Tang
+    given-names: Ao
+    affiliation: "NVIDIA"
+  - family-names: Lane
+    given-names: Lawrence
+    affiliation: "NVIDIA"
+  - family-names: Truong
+    given-names: Charlie
+    affiliation: "NVIDIA"
+  - family-names: Vu
+    given-names: Huy
+    affiliation: "NVIDIA"
+  - family-names: Garg
+    given-names: Abhinav
+    affiliation: "NVIDIA"
+  - family-names: Mahajan
+    given-names: Praateek
+    affiliation: "NVIDIA"
+  - family-names: Karpov
+    given-names: Nikolay
+    affiliation: "NVIDIA"
+  - family-names: König
+    given-names: Oliver
+    affiliation: "NVIDIA"