* mUSE models were used in TensorFlow implementation in contrast to others in torch
+
a Base model is either monolingual version on which it was based or another multilingual model which was used and adopted
+
b Colossal Clean Crawled Corpus in multilingual version (mC4)
+
c multiple datasets from OPUS website (https://opus.nlpl.eu)
+
d bilingual dictionaries from MUSE (https://github.com/facebookresearch/MUSE)
+
e just titles from wiki articles in multiple languages
+
+
+
+
Results
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
References
+
+Artetxe, Mikel, and Holger Schwenk. 2019. “Massively Multilingual Sentence Embeddings for Zero-Shot Cross-Lingual Transfer and Beyond.”Transactions of the Association for Computational Linguistics 7 (September): 597–610. https://doi.org/10.1162/tacl_a_00288.
+
+
+Augustyniak, Łukasz, Szymon Woźniak, Marcin Gruza, Piotr Gramacki, Krzysztof Rajda, Mikołaj Morzy, and Tomasz Kajdanowicz. 2023. “Massively Multilingual Corpus of Sentiment Datasets and Multi-Faceted Sentiment Classification Benchmark.”https://arxiv.org/abs/2306.07902.
+
+
+Conneau, Alexis, Kartikay Khandelwal, Naman Goyal, Vishrav Chaudhary, Guillaume Wenzek, Francisco Guzmán, Edouard Grave, Myle Ott, Luke Zettlemoyer, and Veselin Stoyanov. 2020. “Unsupervised Cross-Lingual Representation Learning at Scale.” In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, 8440–51. Online: Association for Computational Linguistics. https://doi.org/10.18653/v1/2020.acl-main.747.
+
+
+Devlin, Jacob, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2019. “BERT: Pre-Training of Deep Bidirectional Transformers for Language Understanding.” In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers), 4171–86. Minneapolis, Minnesota: Association for Computational Linguistics. https://doi.org/10.18653/v1/N19-1423.
+
+
+Feng, Fangxiaoyu, Yinfei Yang, Daniel Cer, Naveen Arivazhagan, and Wei Wang. 2020. “Language-agnostic BERT Sentence Embedding.”Computing Research Repository arXiv:2007.01852. https://arxiv.org/abs/2007.01852.
+
+
+Rajda, Krzysztof, Lukasz Augustyniak, Piotr Gramacki, Marcin Gruza, Szymon Woźniak, and Tomasz Kajdanowicz. 2022. “Assessment of Massively Multilingual Sentiment Classifiers.” In Proceedings of the 12th Workshop on Computational Approaches to Subjectivity, Sentiment & Social Media Analysis, 125–40. Dublin, Ireland: Association for Computational Linguistics. https://doi.org/10.18653/v1/2022.wassa-1.13.
+
+
+Reimers, Nils, and Iryna Gurevych. 2020. “Making Monolingual Sentence Embeddings Multilingual Using Knowledge Distillation.” In Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP), 4512–25. Online: Association for Computational Linguistics. https://doi.org/10.18653/v1/2020.emnlp-main.365.
+
+
+Sanh, Victor, Lysandre Debut, Julien Chaumond, and Thomas Wolf. 2020. “DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lighter.”Computing Research Repository arXiv:1910.01108. https://arxiv.org/abs/1910.01108.
+
+
+Xue, Linting, Noah Constant, Adam Roberts, Mihir Kale, Rami Al-Rfou, Aditya Siddhant, Aditya Barua, and Colin Raffel. 2021. “MT5: A Massively Multilingual Pre-Trained Text-to-Text Transformer.” In Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, 483–98. Online: Association for Computational Linguistics. https://doi.org/10.18653/v1/2021.naacl-main.41.
+
+
+Yang, Yinfei, Daniel Cer, Amin Ahmad, Mandy Guo, Jax Law, Noah Constant, Gustavo Hernandez Abrego, et al. 2020. “Multilingual Universal Sentence Encoder for Semantic Retrieval.” In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics: System Demonstrations, 87–94. Online: Association for Computational Linguistics. https://doi.org/10.18653/v1/2020.acl-demos.12.
+
Coding of nominal plurality: mixed morphological plural
+
Grammatical genders: masculine, feminine
+
+
@InProceedings{dataset_ar_arsentdl,
+author = {Ramy Baly and
+ Alaa Khaddaj and
+ Hazem M. Hajj and
+ Wassim El{-}Hajj and
+ Khaled Bashir Shaban},
+title = {{ArSentD-LEV: A Multi-Topic Corpus for Target-based Sentiment Analysis in Arabic Levantine Tweets}},
+booktitle = {Proceedings of the Eleventh International Conference on Language Resources and Evaluation (LREC 2018)},
+year = {2018},
+month = {may},
+date = {7-12},
+location = {Miyazaki, Japan},
+editor = {Hend Al-Khalifa and King Saud University and KSA Walid Magdy and University of Edinburgh and UK Kareem Darwish and Qatar Computing Research Institute and Qatar Tamer Elsayed and Qatar University and Qatar},
+publisher = {European Language Resources Association (ELRA)},
+address = {Paris, France},
+isbn = {979-10-95546-25-2},
+language = {english}
+}
+
+
+
+
Dataset id: ar_astd
+
+
Domain: social_media
+
Language: ar
+
Language family: Afro-Asiatic
+
Genus: Semitic
+
Definite articles: definite affix
+
Indefinite articles: no article
+
Number of cases: 3
+
Order of subject, object, verb: SVO
+
Negative morphemes: negative particle
+
Polar questions: interrogative intonation only
+
Position of negative word wrt SOV: SNegVO
+
Prefixing vs suffixing: weakly suffixing
+
Coding of nominal plurality: mixed morphological plural
+
Grammatical genders: masculine, feminine
+
+
@inproceedings{dataset_ar_astd,
+title = "{ASTD}: {A}rabic Sentiment Tweets Dataset",
+author = "Nabil, Mahmoud and
+ Aly, Mohamed and
+ Atiya, Amir",
+booktitle = "Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing",
+month = sep,
+year = "2015",
+address = "Lisbon, Portugal",
+publisher = "Association for Computational Linguistics",
+url = "https://aclanthology.org/D15-1299",
+doi = "10.18653/v1/D15-1299",
+pages = "2515--2519",
+}
+
+
+
+
Dataset id: ar_bbn
+
+
Domain: social_media
+
Language: ar
+
Language family: Afro-Asiatic
+
Genus: Semitic
+
Definite articles: definite affix
+
Indefinite articles: no article
+
Number of cases: 3
+
Order of subject, object, verb: SVO
+
Negative morphemes: negative particle
+
Polar questions: interrogative intonation only
+
Position of negative word wrt SOV: SNegVO
+
Prefixing vs suffixing: weakly suffixing
+
Coding of nominal plurality: mixed morphological plural
+
Grammatical genders: masculine, feminine
+
+
@inproceedings{dataset_ar_bbn,
+title = "Sentiment after Translation: A Case-Study on {A}rabic Social Media Posts",
+author = "Salameh, Mohammad and
+ Mohammad, Saif and
+ Kiritchenko, Svetlana",
+booktitle = "Proceedings of the 2015 Conference of the North {A}merican Chapter of the Association for Computational Linguistics: Human Language Technologies",
+month = may # "{--}" # jun,
+year = "2015",
+address = "Denver, Colorado",
+publisher = "Association for Computational Linguistics",
+url = "https://aclanthology.org/N15-1078",
+doi = "10.3115/v1/N15-1078",
+pages = "767--777",
+}
+
+
+
+
Dataset id: ar_brad
+
+
Domain: reviews
+
Language: ar
+
Language family: Afro-Asiatic
+
Genus: Semitic
+
Definite articles: definite affix
+
Indefinite articles: no article
+
Number of cases: 3
+
Order of subject, object, verb: SVO
+
Negative morphemes: negative particle
+
Polar questions: interrogative intonation only
+
Position of negative word wrt SOV: SNegVO
+
Prefixing vs suffixing: weakly suffixing
+
Coding of nominal plurality: mixed morphological plural
+
Grammatical genders: masculine, feminine
+
+
@INPROCEEDINGS{dataset_ar_brad,
+author={Elnagar, Ashraf and Einea, Omar},
+booktitle={2016 IEEE/ACS 13th International Conference of Computer Systems and Applications (AICCSA)},
+title={{BRAD} 1.0: Book reviews in Arabic dataset},
+year={2016},
+volume={},
+number={},
+pages={1-8},
+doi={10.1109/AICCSA.2016.7945800}
+}
+
+
+
+
Dataset id: ar_hard
+
+
Domain: reviews
+
Language: ar
+
Language family: Afro-Asiatic
+
Genus: Semitic
+
Definite articles: definite affix
+
Indefinite articles: no article
+
Number of cases: 3
+
Order of subject, object, verb: SVO
+
Negative morphemes: negative particle
+
Polar questions: interrogative intonation only
+
Position of negative word wrt SOV: SNegVO
+
Prefixing vs suffixing: weakly suffixing
+
Coding of nominal plurality: mixed morphological plural
+
Grammatical genders: masculine, feminine
+
+
@Book{dataset_ar_hard,
+author="Elnagar, Ashraf
+ and Khalifa, Yasmin S.
+ and Einea, Anas",
+title={Hotel Arabic-Reviews Dataset Construction for Sentiment Analysis Applications},
+bookTitle="Intelligent Natural Language Processing: Trends and Applications",
+year="2018",
+publisher="Springer International Publishing",
+address="Cham",
+pages="35--52",
+isbn="978-3-319-67056-0",
+doi="10.1007/978-3-319-67056-0_3",
+url="https://doi.org/10.1007/978-3-319-67056-0_3"
+}
+
+
+
+
Dataset id: ar_labr
+
+
Domain: reviews
+
Language: ar
+
Language family: Afro-Asiatic
+
Genus: Semitic
+
Definite articles: definite affix
+
Indefinite articles: no article
+
Number of cases: 3
+
Order of subject, object, verb: SVO
+
Negative morphemes: negative particle
+
Polar questions: interrogative intonation only
+
Position of negative word wrt SOV: SNegVO
+
Prefixing vs suffixing: weakly suffixing
+
Coding of nominal plurality: mixed morphological plural
+
Grammatical genders: masculine, feminine
+
+
@inproceedings{dataset_ar_labr,
+title = "{LABR}: A Large Scale {A}rabic Book Reviews Dataset",
+author = "Aly, Mohamed and
+ Atiya, Amir",
+booktitle = "Proceedings of the 51st Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers)",
+month = aug,
+year = "2013",
+address = "Sofia, Bulgaria",
+publisher = "Association for Computational Linguistics",
+url = "https://aclanthology.org/P13-2088",
+pages = "494--498",
+}
+
+
+
+
Dataset id: ar_oclar
+
+
Domain: reviews
+
Language: ar
+
Language family: Afro-Asiatic
+
Genus: Semitic
+
Definite articles: definite affix
+
Indefinite articles: no article
+
Number of cases: 3
+
Order of subject, object, verb: SVO
+
Negative morphemes: negative particle
+
Polar questions: interrogative intonation only
+
Position of negative word wrt SOV: SNegVO
+
Prefixing vs suffixing: weakly suffixing
+
Coding of nominal plurality: mixed morphological plural
+
Grammatical genders: masculine, feminine
+
+
@inproceedings{dataset_ar_oclar,
+author={Al Omari, Marwan and Al-Hajj, Moustafa and Hammami, Nacereddine and Sabra, Amani},
+booktitle={2019 International Conference on Computer and Information Sciences (ICCIS)},
+title={Sentiment Classifier: Logistic Regression for Arabic Services’ Reviews in Lebanon},
+year={2019},
+volume={},
+number={},
+pages={1-5},
+doi={10.1109/ICCISci.2019.8716394}
+}
+
+
+
+
Dataset id: ar_semeval_2017
+
+
Domain: mixed
+
Language: ar
+
Language family: Afro-Asiatic
+
Genus: Semitic
+
Definite articles: definite affix
+
Indefinite articles: no article
+
Number of cases: 3
+
Order of subject, object, verb: SVO
+
Negative morphemes: negative particle
+
Polar questions: interrogative intonation only
+
Position of negative word wrt SOV: SNegVO
+
Prefixing vs suffixing: weakly suffixing
+
Coding of nominal plurality: mixed morphological plural
+
Grammatical genders: masculine, feminine
+
+
@inproceedings{dataset_semeval_2017,
+title = "{S}em{E}val-2017 Task 4: Sentiment Analysis in {T}witter",
+author = "Rosenthal, Sara and
+ Farra, Noura and
+ Nakov, Preslav",
+booktitle = "Proceedings of the 11th International Workshop on Semantic Evaluation ({S}em{E}val-2017)",
+month = aug,
+year = "2017",
+address = "Vancouver, Canada",
+publisher = "Association for Computational Linguistics",
+url = "https://aclanthology.org/S17-2088",
+doi = "10.18653/v1/S17-2088",
+pages = "502--518",
+abstract = "This paper describes the fifth year of the Sentiment Analysis in Twitter task. SemEval-2017 Task 4 continues with a rerun of the subtasks of SemEval-2016 Task 4, which include identifying the overall sentiment of the tweet, sentiment towards a topic with classification on a two-point and on a five-point ordinal scale, and quantification of the distribution of sentiment towards a topic across a number of tweets: again on a two-point and on a five-point ordinal scale. Compared to 2016, we made two changes: (i) we introduced a new language, Arabic, for all subtasks, and (ii) we made available information from the profiles of the Twitter users who posted the target tweets. The task continues to be very popular, with a total of 48 teams participating this year.",
+}
+
+
+
+
Dataset id: ar_syria_corpus
+
+
Domain: social_media
+
Language: ar
+
Language family: Afro-Asiatic
+
Genus: Semitic
+
Definite articles: definite affix
+
Indefinite articles: no article
+
Number of cases: 3
+
Order of subject, object, verb: SVO
+
Negative morphemes: negative particle
+
Polar questions: interrogative intonation only
+
Position of negative word wrt SOV: SNegVO
+
Prefixing vs suffixing: weakly suffixing
+
Coding of nominal plurality: mixed morphological plural
+
Grammatical genders: masculine, feminine
+
+
@inproceedings{dataset_ar_bbn,
+title = "Sentiment after Translation: A Case-Study on {A}rabic Social Media Posts",
+author = "Salameh, Mohammad and
+ Mohammad, Saif and
+ Kiritchenko, Svetlana",
+booktitle = "Proceedings of the 2015 Conference of the North {A}merican Chapter of the Association for Computational Linguistics: Human Language Technologies",
+month = may # "{--}" # jun,
+year = "2015",
+address = "Denver, Colorado",
+publisher = "Association for Computational Linguistics",
+url = "https://aclanthology.org/N15-1078",
+doi = "10.3115/v1/N15-1078",
+pages = "767--777",
+}
+
+
+
+
Dataset id: bg_twitter_sentiment
+
+
Domain: social_media
+
Language: bg
+
Language family: Indo-European
+
Genus: Slavic
+
Definite articles: definite word distinct from demonstrative
+
Indefinite articles: no article
+
Number of cases: no morphological case-making
+
Order of subject, object, verb: SVO
+
Negative morphemes: negative particle
+
Polar questions: question particle
+
Position of negative word wrt SOV: SNegVO
+
Prefixing vs suffixing: strongly suffixing
+
Coding of nominal plurality: plural suffix
+
Grammatical genders: masculine, feminine, neuter
+
+
@article{dataset_twitter_sentiment,
+doi = {10.1371/journal.pone.0155036},
+author = {Mozetič, Igor AND Grčar, Miha AND Smailović, Jasmina},
+journal = {PLOS ONE},
+publisher = {Public Library of Science},
+title = {Multilingual Twitter Sentiment Classification: The Role of Human Annotators},
+year = {2016},
+month = {05},
+volume = {11},
+url = {https://doi.org/10.1371/journal.pone.0155036},
+pages = {1-26},
+number = {5},
+}
+
+
+
+
Dataset id: bs_twitter_sentiment
+
+
Domain: social_media
+
Language: bs
+
Language family: Indo-European
+
Genus: Slavic
+
Definite articles: no article
+
Indefinite articles: no article
+
Number of cases: 5
+
Order of subject, object, verb: SVO
+
Negative morphemes: negative particle
+
Polar questions: question particle
+
Position of negative word wrt SOV: other
+
Prefixing vs suffixing: strongly suffixing
+
Coding of nominal plurality: plural suffix
+
Grammatical genders: masculine, feminine, neuter
+
+
@article{dataset_twitter_sentiment,
+doi = {10.1371/journal.pone.0155036},
+author = {Mozetič, Igor AND Grčar, Miha AND Smailović, Jasmina},
+journal = {PLOS ONE},
+publisher = {Public Library of Science},
+title = {Multilingual Twitter Sentiment Classification: The Role of Human Annotators},
+year = {2016},
+month = {05},
+volume = {11},
+url = {https://doi.org/10.1371/journal.pone.0155036},
+pages = {1-26},
+number = {5},
+}
+
+
+
+
Dataset id: cs_facebook
+
+
Domain: social_media
+
Language: cs
+
Language family: Indo-European
+
Genus: Slavic
+
Definite articles: no article
+
Indefinite articles: no article
+
Number of cases: 6-7
+
Order of subject, object, verb: SVO
+
Negative morphemes: negative affix
+
Polar questions: interrogative word order
+
Position of negative word wrt SOV: MorphNeg
+
Prefixing vs suffixing: weakly suffixing
+
Coding of nominal plurality: plural suffix
+
Grammatical genders: masculine, feminine, neuter
+
+
@inproceedings{dataset_cs_social_media,
+title = "Sentiment Analysis in {C}zech Social Media Using Supervised Machine Learning",
+author = "Habernal, Ivan and
+ Pt{\'a}{\v{c}}ek, Tom{\'a}{\v{s}} and
+ Steinberger, Josef",
+booktitle = "Proceedings of the 4th Workshop on Computational Approaches to Subjectivity, Sentiment and Social Media Analysis",
+month = jun,
+year = "2013",
+address = "Atlanta, Georgia",
+publisher = "Association for Computational Linguistics",
+url = "https://aclanthology.org/W13-1609",
+pages = "65--74",
+}
+
+
+
+
Dataset id: cs_mall_product_reviews
+
+
Domain: reviews
+
Language: cs
+
Language family: Indo-European
+
Genus: Slavic
+
Definite articles: no article
+
Indefinite articles: no article
+
Number of cases: 6-7
+
Order of subject, object, verb: SVO
+
Negative morphemes: negative affix
+
Polar questions: interrogative word order
+
Position of negative word wrt SOV: MorphNeg
+
Prefixing vs suffixing: weakly suffixing
+
Coding of nominal plurality: plural suffix
+
Grammatical genders: masculine, feminine, neuter
+
+
@inproceedings{dataset_cs_social_media,
+title = "Sentiment Analysis in {C}zech Social Media Using Supervised Machine Learning",
+author = "Habernal, Ivan and
+ Pt{\'a}{\v{c}}ek, Tom{\'a}{\v{s}} and
+ Steinberger, Josef",
+booktitle = "Proceedings of the 4th Workshop on Computational Approaches to Subjectivity, Sentiment and Social Media Analysis",
+month = jun,
+year = "2013",
+address = "Atlanta, Georgia",
+publisher = "Association for Computational Linguistics",
+url = "https://aclanthology.org/W13-1609",
+pages = "65--74",
+}
+
+
+
+
Dataset id: cs_movie_reviews
+
+
Domain: reviews
+
Language: cs
+
Language family: Indo-European
+
Genus: Slavic
+
Definite articles: no article
+
Indefinite articles: no article
+
Number of cases: 6-7
+
Order of subject, object, verb: SVO
+
Negative morphemes: negative affix
+
Polar questions: interrogative word order
+
Position of negative word wrt SOV: MorphNeg
+
Prefixing vs suffixing: weakly suffixing
+
Coding of nominal plurality: plural suffix
+
Grammatical genders: masculine, feminine, neuter
+
+
@inproceedings{dataset_cs_social_media,
+title = "Sentiment Analysis in {C}zech Social Media Using Supervised Machine Learning",
+author = "Habernal, Ivan and
+ Pt{\'a}{\v{c}}ek, Tom{\'a}{\v{s}} and
+ Steinberger, Josef",
+booktitle = "Proceedings of the 4th Workshop on Computational Approaches to Subjectivity, Sentiment and Social Media Analysis",
+month = jun,
+year = "2013",
+address = "Atlanta, Georgia",
+publisher = "Association for Computational Linguistics",
+url = "https://aclanthology.org/W13-1609",
+pages = "65--74",
+}
+
+
+
+
Dataset id: cs_news_stance
+
+
Domain: social_media
+
Language: cs
+
Language family: Indo-European
+
Genus: Slavic
+
Definite articles: no article
+
Indefinite articles: no article
+
Number of cases: 6-7
+
Order of subject, object, verb: SVO
+
Negative morphemes: negative affix
+
Polar questions: interrogative word order
+
Position of negative word wrt SOV: MorphNeg
+
Prefixing vs suffixing: weakly suffixing
+
Coding of nominal plurality: plural suffix
+
Grammatical genders: masculine, feminine, neuter
+
+
@inproceedings{dataset_cs_social_media,
+title = "Sentiment Analysis in {C}zech Social Media Using Supervised Machine Learning",
+author = "Habernal, Ivan and
+ Pt{\'a}{\v{c}}ek, Tom{\'a}{\v{s}} and
+ Steinberger, Josef",
+booktitle = "Proceedings of the 4th Workshop on Computational Approaches to Subjectivity, Sentiment and Social Media Analysis",
+month = jun,
+year = "2013",
+address = "Atlanta, Georgia",
+publisher = "Association for Computational Linguistics",
+url = "https://aclanthology.org/W13-1609",
+pages = "65--74",
+}
+
+
+
+
Dataset id: de_dai_labor
+
+
Domain: social_media
+
Language: de
+
Language family: Indo-European
+
Genus: Germanic
+
Definite articles: definite word distinct from demonstrative
+
Indefinite articles: indefinite word same as one
+
Number of cases: 4
+
Order of subject, object, verb: no dominant order
+
Negative morphemes: negative particle
+
Polar questions: interrogative word order
+
Position of negative word wrt SOV: more than one position
+
Prefixing vs suffixing: strongly suffixing
+
Coding of nominal plurality: plural suffix
+
Grammatical genders: masculine, feminine, neuter
+
+
@inproceedings{dataset_dai_labor,
+author = {Narr, Sascha and Michael Hülfenhaus and Albayrak, Sahin},
+title = {Language-Independent Twitter Sentiment Analysis},
+booktitle = {Workshop on Knowledge Discovery, Data Mining and Machine Learning (KDML-2012)},
+year = {2012},
+location = {Dortmund, Germany},
+}
+
+
+
+
Dataset id: de_ifeel
+
+
Domain: social_media
+
Language: de
+
Language family: Indo-European
+
Genus: Germanic
+
Definite articles: definite word distinct from demonstrative
+
Indefinite articles: indefinite word same as one
+
Number of cases: 4
+
Order of subject, object, verb: no dominant order
+
Negative morphemes: negative particle
+
Polar questions: interrogative word order
+
Position of negative word wrt SOV: more than one position
+
Prefixing vs suffixing: strongly suffixing
+
Coding of nominal plurality: plural suffix
+
Grammatical genders: masculine, feminine, neuter
+
+
@inproceedings{dataset_dai_labor,
+author = {Narr, Sascha and Michael Hülfenhaus and Albayrak, Sahin},
+title = {Language-Independent Twitter Sentiment Analysis},
+booktitle = {Workshop on Knowledge Discovery, Data Mining and Machine Learning (KDML-2012)},
+year = {2012},
+location = {Dortmund, Germany},
+}
+
+
+
+
Dataset id: de_multilan_amazon
+
+
Domain: reviews
+
Language: de
+
Language family: Indo-European
+
Genus: Germanic
+
Definite articles: definite word distinct from demonstrative
+
Indefinite articles: indefinite word same as one
+
Number of cases: 4
+
Order of subject, object, verb: no dominant order
+
Negative morphemes: negative particle
+
Polar questions: interrogative word order
+
Position of negative word wrt SOV: more than one position
+
Prefixing vs suffixing: strongly suffixing
+
Coding of nominal plurality: plural suffix
+
Grammatical genders: masculine, feminine, neuter
+
+
@inproceedings{dataset_multilan_amazon,
+title = "The Multilingual {A}mazon Reviews Corpus",
+author = {Keung, Phillip and
+ Lu, Yichao and
+ Szarvas, Gy{\"o}rgy and
+ Smith, Noah A.},
+booktitle = "Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP)",
+month = nov,
+year = "2020",
+address = "Online",
+publisher = "Association for Computational Linguistics",
+url = "https://aclanthology.org/2020.emnlp-main.369",
+doi = "10.18653/v1/2020.emnlp-main.369",
+pages = "4563--4568",
+}
+
+
+
+
Dataset id: de_omp
+
+
Domain: social_media
+
Language: de
+
Language family: Indo-European
+
Genus: Germanic
+
Definite articles: definite word distinct from demonstrative
+
Indefinite articles: indefinite word same as one
+
Number of cases: 4
+
Order of subject, object, verb: no dominant order
+
Negative morphemes: negative particle
+
Polar questions: interrogative word order
+
Position of negative word wrt SOV: more than one position
+
Prefixing vs suffixing: strongly suffixing
+
Coding of nominal plurality: plural suffix
+
Grammatical genders: masculine, feminine, neuter
+
+
@inproceedings{dataset_de_omp,
+title = "Academic-Industrial Perspective on the Development and Deployment of a Moderation System for a Newspaper Website",
+author = "Schabus, Dietmar and
+ Skowron, Marcin",
+booktitle = "Proceedings of the Eleventh International Conference on Language Resources and Evaluation ({LREC} 2018)",
+month = may,
+year = "2018",
+address = "Miyazaki, Japan",
+publisher = "European Language Resources Association (ELRA)",
+url = "https://aclanthology.org/L18-1253",
+}
+
+
+
+
Dataset id: de_sb10k
+
+
Domain: social_media
+
Language: de
+
Language family: Indo-European
+
Genus: Germanic
+
Definite articles: definite word distinct from demonstrative
+
Indefinite articles: indefinite word same as one
+
Number of cases: 4
+
Order of subject, object, verb: no dominant order
+
Negative morphemes: negative particle
+
Polar questions: interrogative word order
+
Position of negative word wrt SOV: more than one position
+
Prefixing vs suffixing: strongly suffixing
+
Coding of nominal plurality: plural suffix
+
Grammatical genders: masculine, feminine, neuter
+
+
@inproceedings{dataset_de_sb10k,
+title = "A {T}witter Corpus and Benchmark Resources for {G}erman Sentiment Analysis",
+author = "Cieliebak, Mark and
+ Deriu, Jan Milan and
+ Egger, Dominic and
+ Uzdilli, Fatih",
+booktitle = "Proceedings of the Fifth International Workshop on Natural Language Processing for Social Media",
+month = apr,
+year = "2017",
+address = "Valencia, Spain",
+publisher = "Association for Computational Linguistics",
+url = "https://aclanthology.org/W17-1106",
+doi = "10.18653/v1/W17-1106",
+pages = "45--51",
+abstract = "In this paper we present SB10k, a new corpus for sentiment analysis with approx. 10,000 German tweets. We use this new corpus and two existing corpora to provide state-of-the-art benchmarks for sentiment analysis in German: we implemented a CNN (based on the winning system of SemEval-2016) and a feature-based SVM and compare their performance on all three corpora. For the CNN, we also created German word embeddings trained on 300M tweets. These word embeddings were then optimized for sentiment analysis using distant-supervised learning. The new corpus, the German word embeddings (plain and optimized), and source code to re-run the benchmarks are publicly available.",
+}
+
+
+
+
Dataset id: de_twitter_sentiment
+
+
Domain: social_media
+
Language: de
+
Language family: Indo-European
+
Genus: Germanic
+
Definite articles: definite word distinct from demonstrative
+
Indefinite articles: indefinite word same as one
+
Number of cases: 4
+
Order of subject, object, verb: no dominant order
+
Negative morphemes: negative particle
+
Polar questions: interrogative word order
+
Position of negative word wrt SOV: more than one position
+
Prefixing vs suffixing: strongly suffixing
+
Coding of nominal plurality: plural suffix
+
Grammatical genders: masculine, feminine, neuter
+
+
@article{dataset_twitter_sentiment,
+doi = {10.1371/journal.pone.0155036},
+author = {Mozetič, Igor AND Grčar, Miha AND Smailović, Jasmina},
+journal = {PLOS ONE},
+publisher = {Public Library of Science},
+title = {Multilingual Twitter Sentiment Classification: The Role of Human Annotators},
+year = {2016},
+month = {05},
+volume = {11},
+url = {https://doi.org/10.1371/journal.pone.0155036},
+pages = {1-26},
+number = {5},
+}
+
+
+
+
Dataset id: en_amazon
+
+
Domain: reviews
+
Language: en
+
Language family: Indo-European
+
Genus: Germanic
+
Definite articles: definite word distinct from demonstrative
+
Indefinite articles: indefinite word distinct from one
+
Number of cases: 2
+
Order of subject, object, verb: SVO
+
Negative morphemes: negative particle
+
Polar questions: interrogative word order
+
Position of negative word wrt SOV: SNegVO
+
Prefixing vs suffixing: strongly suffixing
+
Coding of nominal plurality: plural suffix
+
Grammatical genders: no grammatical gender
+
+
@inproceedings{dataset_en_amazon,
+title = "Justifying Recommendations using Distantly-Labeled Reviews and Fine-Grained Aspects",
+author = "Ni, Jianmo and
+ Li, Jiacheng and
+ McAuley, Julian",
+booktitle = "Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP)",
+month = nov,
+year = "2019",
+address = "Hong Kong, China",
+publisher = "Association for Computational Linguistics",
+url = "https://aclanthology.org/D19-1018",
+doi = "10.18653/v1/D19-1018",
+pages = "188--197",
+}
+
+
+
+
Dataset id: en_dai_labor
+
+
Domain: social_media
+
Language: en
+
Language family: Indo-European
+
Genus: Germanic
+
Definite articles: definite word distinct from demonstrative
+
Indefinite articles: indefinite word distinct from one
+
Number of cases: 2
+
Order of subject, object, verb: SVO
+
Negative morphemes: negative particle
+
Polar questions: interrogative word order
+
Position of negative word wrt SOV: SNegVO
+
Prefixing vs suffixing: strongly suffixing
+
Coding of nominal plurality: plural suffix
+
Grammatical genders: no grammatical gender
+
+
@inproceedings{dataset_dai_labor,
+author = {Narr, Sascha and Michael Hülfenhaus and Albayrak, Sahin},
+title = {Language-Independent Twitter Sentiment Analysis},
+booktitle = {Workshop on Knowledge Discovery, Data Mining and Machine Learning (KDML-2012)},
+year = {2012},
+location = {Dortmund, Germany},
+}
+
Definite articles: definite word distinct from demonstrative
+
Indefinite articles: indefinite word distinct from one
+
Number of cases: 2
+
Order of subject, object, verb: SVO
+
Negative morphemes: negative particle
+
Polar questions: interrogative word order
+
Position of negative word wrt SOV: SNegVO
+
Prefixing vs suffixing: strongly suffixing
+
Coding of nominal plurality: plural suffix
+
Grammatical genders: no grammatical gender
+
+
@article{dataset_en_financial_phrasebank_sentences_75agree,
+author = {Malo, Pekka and Sinha, Ankur and Korhonen, Pekka and Wallenius, Jyrki and Takala, Pyry},
+title = {Good Debt or Bad Debt: Detecting Semantic Orientations in Economic Texts},
+year = {2014},
+issue_date = {April 2014},
+publisher = {John Wiley & Sons, Inc.},
+address = {USA},
+volume = {65},
+number = {4},
+issn = {2330-1635},
+url = {https://doi.org/10.1002/asi.23062},
+doi = {10.1002/asi.23062},
+journal = {Journal of the Association for Information Science and Technology},
+month = {apr},
+pages = {782–796},
+numpages = {15},
+keywords = {economics, automatic classification, linguistic analysis}
+}
+
+
+
+
Dataset id: en_multilan_amazon
+
+
Domain: reviews
+
Language: en
+
Language family: Indo-European
+
Genus: Germanic
+
Definite articles: definite word distinct from demonstrative
+
Indefinite articles: indefinite word distinct from one
+
Number of cases: 2
+
Order of subject, object, verb: SVO
+
Negative morphemes: negative particle
+
Polar questions: interrogative word order
+
Position of negative word wrt SOV: SNegVO
+
Prefixing vs suffixing: strongly suffixing
+
Coding of nominal plurality: plural suffix
+
Grammatical genders: no grammatical gender
+
+
@inproceedings{dataset_multilan_amazon,
+title = "The Multilingual {A}mazon Reviews Corpus",
+author = {Keung, Phillip and
+ Lu, Yichao and
+ Szarvas, Gy{\"o}rgy and
+ Smith, Noah A.},
+booktitle = "Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP)",
+month = nov,
+year = "2020",
+address = "Online",
+publisher = "Association for Computational Linguistics",
+url = "https://aclanthology.org/2020.emnlp-main.369",
+doi = "10.18653/v1/2020.emnlp-main.369",
+pages = "4563--4568",
+}
+
+
+
+
Dataset id: en_per_sent
+
+
Domain: news
+
Language: en
+
Language family: Indo-European
+
Genus: Germanic
+
Definite articles: definite word distinct from demonstrative
+
Indefinite articles: indefinite word distinct from one
+
Number of cases: 2
+
Order of subject, object, verb: SVO
+
Negative morphemes: negative particle
+
Polar questions: interrogative word order
+
Position of negative word wrt SOV: SNegVO
+
Prefixing vs suffixing: strongly suffixing
+
Coding of nominal plurality: plural suffix
+
Grammatical genders: no grammatical gender
+
+
@inproceedings{dataset_en_per_sent,
+title = "Author{'}s Sentiment Prediction",
+author = "Bastan, Mohaddeseh and
+ Koupaee, Mahnaz and
+ Son, Youngseo and
+ Sicoli, Richard and
+ Balasubramanian, Niranjan",
+booktitle = "Proceedings of the 28th International Conference on Computational Linguistics",
+month = dec,
+year = "2020",
+address = "Barcelona, Spain (Online)",
+publisher = "International Committee on Computational Linguistics",
+url = "https://aclanthology.org/2020.coling-main.52",
+doi = "10.18653/v1/2020.coling-main.52",
+pages = "604--615",
+}
+
+
+
+
Dataset id: en_poem_sentiment
+
+
Domain: poems
+
Language: en
+
Language family: Indo-European
+
Genus: Germanic
+
Definite articles: definite word distinct from demonstrative
+
Indefinite articles: indefinite word distinct from one
+
Number of cases: 2
+
Order of subject, object, verb: SVO
+
Negative morphemes: negative particle
+
Polar questions: interrogative word order
+
Position of negative word wrt SOV: SNegVO
+
Prefixing vs suffixing: strongly suffixing
+
Coding of nominal plurality: plural suffix
+
Grammatical genders: no grammatical gender
+
+
@inproceedings{dataset_en_poem_sentiment,
+title = "Investigating Societal Biases in a Poetry Composition System",
+author = "Sheng, Emily and
+ Uthus, David",
+booktitle = "Proceedings of the Second Workshop on Gender Bias in Natural Language Processing",
+month = dec,
+year = "2020",
+address = "Barcelona, Spain (Online)",
+publisher = "Association for Computational Linguistics",
+url = "https://aclanthology.org/2020.gebnlp-1.9",
+pages = "93--106",
+}
+
+
+
+
Dataset id: en_semeval_2017
+
+
Domain: mixed
+
Language: en
+
Language family: Indo-European
+
Genus: Germanic
+
Definite articles: definite word distinct from demonstrative
+
Indefinite articles: indefinite word distinct from one
+
Number of cases: 2
+
Order of subject, object, verb: SVO
+
Negative morphemes: negative particle
+
Polar questions: interrogative word order
+
Position of negative word wrt SOV: SNegVO
+
Prefixing vs suffixing: strongly suffixing
+
Coding of nominal plurality: plural suffix
+
Grammatical genders: no grammatical gender
+
+
@inproceedings{dataset_semeval_2017,
+title = "{S}em{E}val-2017 Task 4: Sentiment Analysis in {T}witter",
+author = "Rosenthal, Sara and
+ Farra, Noura and
+ Nakov, Preslav",
+booktitle = "Proceedings of the 11th International Workshop on Semantic Evaluation ({S}em{E}val-2017)",
+month = aug,
+year = "2017",
+address = "Vancouver, Canada",
+publisher = "Association for Computational Linguistics",
+url = "https://aclanthology.org/S17-2088",
+doi = "10.18653/v1/S17-2088",
+pages = "502--518",
+abstract = "This paper describes the fifth year of the Sentiment Analysis in Twitter task. SemEval-2017 Task 4 continues with a rerun of the subtasks of SemEval-2016 Task 4, which include identifying the overall sentiment of the tweet, sentiment towards a topic with classification on a two-point and on a five-point ordinal scale, and quantification of the distribution of sentiment towards a topic across a number of tweets: again on a two-point and on a five-point ordinal scale. Compared to 2016, we made two changes: (i) we introduced a new language, Arabic, for all subtasks, and (ii) we made available information from the profiles of the Twitter users who posted the target tweets. The task continues to be very popular, with a total of 48 teams participating this year.",
+}
+
+
+
+
Dataset id: en_sentistrength
+
+
Domain: social_media
+
Language: en
+
Language family: Indo-European
+
Genus: Germanic
+
Definite articles: definite word distinct from demonstrative
+
Indefinite articles: indefinite word distinct from one
+
Number of cases: 2
+
Order of subject, object, verb: SVO
+
Negative morphemes: negative particle
+
Polar questions: interrogative word order
+
Position of negative word wrt SOV: SNegVO
+
Prefixing vs suffixing: strongly suffixing
+
Coding of nominal plurality: plural suffix
+
Grammatical genders: no grammatical gender
+
+
@article{dataset_en_sentistrength,
+author = {Thelwall, Mike and Buckley, Kevan and Paltoglou, Georgios},
+title = {Sentiment Strength Detection for the Social Web},
+year = {2012},
+issue_date = {January 2012},
+publisher = {John Wiley \& Sons, Inc.},
+address = {USA},
+volume = {63},
+number = {1},
+issn = {1532-2882},
+url = {https://doi.org/10.1002/asi.21662},
+doi = {10.1002/asi.21662},
+abstract = {Sentiment analysis is concerned with the automatic extraction of sentiment-related
+ information from text. Although most sentiment analysis addresses commercial tass,
+ such as extracting opinions from product reviews, there is increasing interest in
+ the affective dimension of the social web, and Twitter in particular. Most sentiment
+ analysis algorithms are not ideally suited to this task because they exploit indirect
+ indicators of sentiment that can reflect genre or topic instead. Hence, such algorithms
+ used to process social web texts can identify spurious sentiment patterns caused by
+ topics rather than affective phenomena. This article assesses an improved version
+ of the algorithm SentiStrength for sentiment strength detection across the social
+ web that primarily uses direct indications of sentiment. The results from six diverse
+ social web data sets (MySpace, Twitter, YouTube, Digg, RunnersWorld, BBCForums) indicate
+ that SentiStrength 2 is successful in the sense of performing better than a baseline
+ approach for all data sets in both supervised and unsupervised cases. SentiStrength
+ is not always better than machine-learning approaches that exploit indirect indicators
+ of sentiment, however, and is particularly weaker for positive sentiment in news-related
+ discussions. Overall, the results suggest that, even unsupervised, SentiStrength is
+ robust enough to be applied to a wide variety of different social web contexts.},
+journal = {J. Am. Soc. Inf. Sci. Technol.},
+month = jan,
+pages = {163–173},
+numpages = {11}
+}
+
+
+
+
Dataset id: en_silicone_meld_s
+
+
Domain: chats
+
Language: en
+
Language family: Indo-European
+
Genus: Germanic
+
Definite articles: definite word distinct from demonstrative
+
Indefinite articles: indefinite word distinct from one
+
Number of cases: 2
+
Order of subject, object, verb: SVO
+
Negative morphemes: negative particle
+
Polar questions: interrogative word order
+
Position of negative word wrt SOV: SNegVO
+
Prefixing vs suffixing: strongly suffixing
+
Coding of nominal plurality: plural suffix
+
Grammatical genders: no grammatical gender
+
+
@inproceedings{dataset_en_silicone,
+title = "Hierarchical Pre-training for Sequence Labelling in Spoken Dialog",
+author = "Chapuis, Emile and
+ Colombo, Pierre and
+ Manica, Matteo and
+ Labeau, Matthieu and
+ Clavel, Chlo{\'e}",
+booktitle = "Findings of the Association for Computational Linguistics: EMNLP 2020",
+month = nov,
+year = "2020",
+address = "Online",
+publisher = "Association for Computational Linguistics",
+url = "https://aclanthology.org/2020.findings-emnlp.239",
+doi = "10.18653/v1/2020.findings-emnlp.239",
+pages = "2636--2648",
+}
+
+
+
+
Dataset id: en_silicone_sem
+
+
Domain: chats
+
Language: en
+
Language family: Indo-European
+
Genus: Germanic
+
Definite articles: definite word distinct from demonstrative
+
Indefinite articles: indefinite word distinct from one
+
Number of cases: 2
+
Order of subject, object, verb: SVO
+
Negative morphemes: negative particle
+
Polar questions: interrogative word order
+
Position of negative word wrt SOV: SNegVO
+
Prefixing vs suffixing: strongly suffixing
+
Coding of nominal plurality: plural suffix
+
Grammatical genders: no grammatical gender
+
+
@inproceedings{dataset_en_silicone,
+title = "Hierarchical Pre-training for Sequence Labelling in Spoken Dialog",
+author = "Chapuis, Emile and
+ Colombo, Pierre and
+ Manica, Matteo and
+ Labeau, Matthieu and
+ Clavel, Chlo{\'e}",
+booktitle = "Findings of the Association for Computational Linguistics: EMNLP 2020",
+month = nov,
+year = "2020",
+address = "Online",
+publisher = "Association for Computational Linguistics",
+url = "https://aclanthology.org/2020.findings-emnlp.239",
+doi = "10.18653/v1/2020.findings-emnlp.239",
+pages = "2636--2648",
+}
+
+
+
+
Dataset id: en_tweet_airlines
+
+
Domain: social_media
+
Language: en
+
Language family: Indo-European
+
Genus: Germanic
+
Definite articles: definite word distinct from demonstrative
+
Indefinite articles: indefinite word distinct from one
Definite articles: definite word distinct from demonstrative
+
Indefinite articles: indefinite word distinct from one
+
Number of cases: 2
+
Order of subject, object, verb: SVO
+
Negative morphemes: negative particle
+
Polar questions: interrogative word order
+
Position of negative word wrt SOV: SNegVO
+
Prefixing vs suffixing: strongly suffixing
+
Coding of nominal plurality: plural suffix
+
Grammatical genders: no grammatical gender
+
+
@article{dataset_twitter_sentiment,
+doi = {10.1371/journal.pone.0155036},
+author = {Mozetič, Igor AND Grčar, Miha AND Smailović, Jasmina},
+journal = {PLOS ONE},
+publisher = {Public Library of Science},
+title = {Multilingual Twitter Sentiment Classification: The Role of Human Annotators},
+year = {2016},
+month = {05},
+volume = {11},
+url = {https://doi.org/10.1371/journal.pone.0155036},
+pages = {1-26},
+number = {5},
+}
+
+
+
+
Dataset id: en_vader_amazon
+
+
Domain: reviews
+
Language: en
+
Language family: Indo-European
+
Genus: Germanic
+
Definite articles: definite word distinct from demonstrative
+
Indefinite articles: indefinite word distinct from one
+
Number of cases: 2
+
Order of subject, object, verb: SVO
+
Negative morphemes: negative particle
+
Polar questions: interrogative word order
+
Position of negative word wrt SOV: SNegVO
+
Prefixing vs suffixing: strongly suffixing
+
Coding of nominal plurality: plural suffix
+
Grammatical genders: no grammatical gender
+
+
@inproceedings{dataset_en_vader,
+title={{VADER}: A Parsimonious Rule-Based Model for Sentiment Analysis of Social Media Text},
+author={Clayton J. Hutto and Eric Gilbert},
+booktitle={Proceedings of the International AAAI Conference on Web and Social Media},
+year={2014},
+url={https://ojs.aaai.org/index.php/ICWSM/article/view/14550},
+month={May},
+pages={216-225},
+volume=8,
+}
+
+
+
+
Dataset id: en_vader_movie_reviews
+
+
Domain: reviews
+
Language: en
+
Language family: Indo-European
+
Genus: Germanic
+
Definite articles: definite word distinct from demonstrative
+
Indefinite articles: indefinite word distinct from one
+
Number of cases: 2
+
Order of subject, object, verb: SVO
+
Negative morphemes: negative particle
+
Polar questions: interrogative word order
+
Position of negative word wrt SOV: SNegVO
+
Prefixing vs suffixing: strongly suffixing
+
Coding of nominal plurality: plural suffix
+
Grammatical genders: no grammatical gender
+
+
@inproceedings{dataset_en_vader,
+title={{VADER}: A Parsimonious Rule-Based Model for Sentiment Analysis of Social Media Text},
+author={Clayton J. Hutto and Eric Gilbert},
+booktitle={Proceedings of the International AAAI Conference on Web and Social Media},
+year={2014},
+url={https://ojs.aaai.org/index.php/ICWSM/article/view/14550},
+month={May},
+pages={216-225},
+volume=8,
+}
+
+
+
+
Dataset id: en_vader_nyt
+
+
Domain: news
+
Language: en
+
Language family: Indo-European
+
Genus: Germanic
+
Definite articles: definite word distinct from demonstrative
+
Indefinite articles: indefinite word distinct from one
+
Number of cases: 2
+
Order of subject, object, verb: SVO
+
Negative morphemes: negative particle
+
Polar questions: interrogative word order
+
Position of negative word wrt SOV: SNegVO
+
Prefixing vs suffixing: strongly suffixing
+
Coding of nominal plurality: plural suffix
+
Grammatical genders: no grammatical gender
+
+
@inproceedings{dataset_en_vader,
+title={{VADER}: A Parsimonious Rule-Based Model for Sentiment Analysis of Social Media Text},
+author={Clayton J. Hutto and Eric Gilbert},
+booktitle={Proceedings of the International AAAI Conference on Web and Social Media},
+year={2014},
+url={https://ojs.aaai.org/index.php/ICWSM/article/view/14550},
+month={May},
+pages={216-225},
+volume=8,
+}
+
+
+
+
Dataset id: en_vader_twitter
+
+
Domain: social_media
+
Language: en
+
Language family: Indo-European
+
Genus: Germanic
+
Definite articles: definite word distinct from demonstrative
+
Indefinite articles: indefinite word distinct from one
+
Number of cases: 2
+
Order of subject, object, verb: SVO
+
Negative morphemes: negative particle
+
Polar questions: interrogative word order
+
Position of negative word wrt SOV: SNegVO
+
Prefixing vs suffixing: strongly suffixing
+
Coding of nominal plurality: plural suffix
+
Grammatical genders: no grammatical gender
+
+
@inproceedings{dataset_en_vader,
+title={{VADER}: A Parsimonious Rule-Based Model for Sentiment Analysis of Social Media Text},
+author={Clayton J. Hutto and Eric Gilbert},
+booktitle={Proceedings of the International AAAI Conference on Web and Social Media},
+year={2014},
+url={https://ojs.aaai.org/index.php/ICWSM/article/view/14550},
+month={May},
+pages={216-225},
+volume=8,
+}
+
+
+
+
Dataset id: es_muchocine
+
+
Domain: reviews
+
Language: es
+
Language family: Indo-European
+
Genus: Romance
+
Definite articles: definite word distinct from demonstrative
+
Indefinite articles: indefinite word same as one
+
Number of cases: no morphological case-making
+
Order of subject, object, verb: SVO
+
Negative morphemes: negative particle
+
Polar questions: interrogative word order
+
Position of negative word wrt SOV: SNegVO
+
Prefixing vs suffixing: strongly suffixing
+
Coding of nominal plurality: plural suffix
+
Grammatical genders: masculine, feminine
+
+
@article{dataset_es_muchocine,
+title={Experiments in sentiment classification of movie reviews in Spanish},
+author={Cruz, Fermin L and Troyano, Jose A and Enriquez, Fernando and Ortega, Javier},
+journal={Procesamiento del Lenguaje Natural},
+volume={41},
+pages={73--80},
+year={2008},
+publisher={SOC ESPANOLA PROCESAMIENTO LENGUAJE NATURAL-SEPLN DEPT LENGUAJES \& SISTEMAS~…}
+}
+
+
+
+
Dataset id: es_multilan_amazon
+
+
Domain: reviews
+
Language: es
+
Language family: Indo-European
+
Genus: Romance
+
Definite articles: definite word distinct from demonstrative
+
Indefinite articles: indefinite word same as one
+
Number of cases: no morphological case-making
+
Order of subject, object, verb: SVO
+
Negative morphemes: negative particle
+
Polar questions: interrogative word order
+
Position of negative word wrt SOV: SNegVO
+
Prefixing vs suffixing: strongly suffixing
+
Coding of nominal plurality: plural suffix
+
Grammatical genders: masculine, feminine
+
+
@inproceedings{dataset_multilan_amazon,
+title = "The Multilingual {A}mazon Reviews Corpus",
+author = {Keung, Phillip and
+ Lu, Yichao and
+ Szarvas, Gy{\"o}rgy and
+ Smith, Noah A.},
+booktitle = "Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP)",
+month = nov,
+year = "2020",
+address = "Online",
+publisher = "Association for Computational Linguistics",
+url = "https://aclanthology.org/2020.emnlp-main.369",
+doi = "10.18653/v1/2020.emnlp-main.369",
+pages = "4563--4568",
+}
+
+
+
+
Dataset id: es_paper_reviews
+
+
Domain: reviews
+
Language: es
+
Language family: Indo-European
+
Genus: Romance
+
Definite articles: definite word distinct from demonstrative
+
Indefinite articles: indefinite word same as one
+
Number of cases: no morphological case-making
+
Order of subject, object, verb: SVO
+
Negative morphemes: negative particle
+
Polar questions: interrogative word order
+
Position of negative word wrt SOV: SNegVO
+
Prefixing vs suffixing: strongly suffixing
+
Coding of nominal plurality: plural suffix
+
Grammatical genders: masculine, feminine
+
+
@article{dataset_es_paper_reviews,
+author = {Keith Norambuena, Brian and Lettura, Exequiel and Villegas, Claudio},
+year = {2019},
+month = {02},
+pages = {191-214},
+title = {Sentiment analysis and opinion mining applied to scientific paper reviews},
+volume = {23},
+journal = {Intelligent Data Analysis},
+doi = {10.3233/IDA-173807}
+}
+
+
+
+
Dataset id: es_semeval2020
+
+
Domain: social_media
+
Language: es
+
Language family: Indo-European
+
Genus: Romance
+
Definite articles: definite word distinct from demonstrative
+
Indefinite articles: indefinite word same as one
+
Number of cases: no morphological case-making
+
Order of subject, object, verb: SVO
+
Negative morphemes: negative particle
+
Polar questions: interrogative word order
+
Position of negative word wrt SOV: SNegVO
+
Prefixing vs suffixing: strongly suffixing
+
Coding of nominal plurality: plural suffix
+
Grammatical genders: masculine, feminine
+
+
@inproceedings{dataset_semeval_2020,
+title = "{S}em{E}val-2020 Task 9: Overview of Sentiment Analysis of Code-Mixed Tweets",
+author = {Patwa, Parth and
+ Aguilar, Gustavo and
+ Kar, Sudipta and
+ Pandey, Suraj and
+ PYKL, Srinivas and
+ Gamb{\"a}ck, Bj{\"o}rn and
+ Chakraborty, Tanmoy and
+ Solorio, Thamar and
+ Das, Amitava},
+booktitle = "Proceedings of the Fourteenth Workshop on Semantic Evaluation",
+month = dec,
+year = "2020",
+address = "Barcelona (online)",
+publisher = "International Committee for Computational Linguistics",
+url = "https://aclanthology.org/2020.semeval-1.100",
+doi = "10.18653/v1/2020.semeval-1.100",
+pages = "774--790",
+}
+
+
+
+
Dataset id: es_twitter_sentiment
+
+
Domain: social_media
+
Language: es
+
Language family: Indo-European
+
Genus: Romance
+
Definite articles: definite word distinct from demonstrative
+
Indefinite articles: indefinite word same as one
+
Number of cases: no morphological case-making
+
Order of subject, object, verb: SVO
+
Negative morphemes: negative particle
+
Polar questions: interrogative word order
+
Position of negative word wrt SOV: SNegVO
+
Prefixing vs suffixing: strongly suffixing
+
Coding of nominal plurality: plural suffix
+
Grammatical genders: masculine, feminine
+
+
@article{dataset_twitter_sentiment,
+doi = {10.1371/journal.pone.0155036},
+author = {Mozetič, Igor AND Grčar, Miha AND Smailović, Jasmina},
+journal = {PLOS ONE},
+publisher = {Public Library of Science},
+title = {Multilingual Twitter Sentiment Classification: The Role of Human Annotators},
+year = {2016},
+month = {05},
+volume = {11},
+url = {https://doi.org/10.1371/journal.pone.0155036},
+pages = {1-26},
+number = {5},
+}
+
+
+
+
Dataset id: fa_sentipers
+
+
Domain: reviews
+
Language: fa
+
Language family: Indo-European
+
Genus: Iranian
+
Definite articles: no article
+
Indefinite articles: indefinite word same as one
+
Number of cases: 2
+
Order of subject, object, verb: SOV
+
Negative morphemes: negative affix
+
Polar questions: question particle
+
Position of negative word wrt SOV: MorphNeg
+
Prefixing vs suffixing: weakly suffixing
+
Coding of nominal plurality: plural suffix
+
Grammatical genders: no grammatical gender
+
+
@article{dataset_fa_sentipers,
+author = {Pedram Hosseini and
+ Ali Ahmadian Ramaki and
+ Hassan Maleki and
+ Mansoureh Anvari and
+ Seyed Abolghasem Mirroshandel},
+title = {{SentiPers}: {A} Sentiment Analysis Corpus for Persian},
+journal = {Computing Research Repository},
+volume = {arXiv:1801.07737},
+note = {Version 2},
+year = {2018},
+url = {http://arxiv.org/abs/1801.07737},
+eprinttype = {arXiv},
+eprint = {1801.07737},
+timestamp = {Mon, 13 Aug 2018 16:47:47 +0200},
+biburl = {https://dblp.org/rec/journals/corr/abs-1801-07737.bib},
+bibsource = {dblp computer science bibliography, https://dblp.org}
+}
+
+
+
+
Dataset id: fr_dai_labor
+
+
Domain: social_media
+
Language: fr
+
Language family: Indo-European
+
Genus: Romance
+
Definite articles: definite word distinct from demonstrative
+
Indefinite articles: indefinite word same as one
+
Number of cases: no morphological case-making
+
Order of subject, object, verb: SVO
+
Negative morphemes: negative particle
+
Polar questions: question particle
+
Position of negative word wrt SOV: OptDoubleNeg
+
Prefixing vs suffixing: strongly suffixing
+
Coding of nominal plurality: plural suffix
+
Grammatical genders: masculine, feminine
+
+
@inproceedings{dataset_dai_labor,
+author = {Narr, Sascha and Michael Hülfenhaus and Albayrak, Sahin},
+title = {Language-Independent Twitter Sentiment Analysis},
+booktitle = {Workshop on Knowledge Discovery, Data Mining and Machine Learning (KDML-2012)},
+year = {2012},
+location = {Dortmund, Germany},
+}
+
+
+
+
Dataset id: fr_ifeel
+
+
Domain: social_media
+
Language: fr
+
Language family: Indo-European
+
Genus: Romance
+
Definite articles: definite word distinct from demonstrative
+
Indefinite articles: indefinite word same as one
+
Number of cases: no morphological case-making
+
Order of subject, object, verb: SVO
+
Negative morphemes: negative particle
+
Polar questions: question particle
+
Position of negative word wrt SOV: OptDoubleNeg
+
Prefixing vs suffixing: strongly suffixing
+
Coding of nominal plurality: plural suffix
+
Grammatical genders: masculine, feminine
+
+
@inproceedings{dataset_dai_labor,
+author = {Narr, Sascha and Michael Hülfenhaus and Albayrak, Sahin},
+title = {Language-Independent Twitter Sentiment Analysis},
+booktitle = {Workshop on Knowledge Discovery, Data Mining and Machine Learning (KDML-2012)},
+year = {2012},
+location = {Dortmund, Germany},
+}
+
+
+
+
Dataset id: fr_multilan_amazon
+
+
Domain: reviews
+
Language: fr
+
Language family: Indo-European
+
Genus: Romance
+
Definite articles: definite word distinct from demonstrative
+
Indefinite articles: indefinite word same as one
+
Number of cases: no morphological case-making
+
Order of subject, object, verb: SVO
+
Negative morphemes: negative particle
+
Polar questions: question particle
+
Position of negative word wrt SOV: OptDoubleNeg
+
Prefixing vs suffixing: strongly suffixing
+
Coding of nominal plurality: plural suffix
+
Grammatical genders: masculine, feminine
+
+
@inproceedings{dataset_multilan_amazon,
+title = "The Multilingual {A}mazon Reviews Corpus",
+author = {Keung, Phillip and
+ Lu, Yichao and
+ Szarvas, Gy{\"o}rgy and
+ Smith, Noah A.},
+booktitle = "Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP)",
+month = nov,
+year = "2020",
+address = "Online",
+publisher = "Association for Computational Linguistics",
+url = "https://aclanthology.org/2020.emnlp-main.369",
+doi = "10.18653/v1/2020.emnlp-main.369",
+pages = "4563--4568",
+}
+
+
+
+
Dataset id: he_hebrew_sentiment
+
+
Domain: social_media
+
Language: he
+
Language family: Afro-Asiatic
+
Genus: Semitic
+
Definite articles: definite affix
+
Indefinite articles: indefinite word same as one
+
Number of cases: no morphological case-making
+
Order of subject, object, verb: SVO
+
Negative morphemes: negative particle
+
Polar questions: question particle
+
Position of negative word wrt SOV: SNegVO
+
Prefixing vs suffixing: weakly suffixing
+
Coding of nominal plurality: plural suffix
+
Grammatical genders: masculine, feminine
+
+
@inproceedings{dataset_he_hebrew_sentiment,
+title = "Representations and Architectures in Neural Sentiment Analysis for Morphologically Rich Languages: A Case Study from {M}odern {H}ebrew",
+author = "Amram, Adam and
+ Ben David, Anat and
+ Tsarfaty, Reut",
+booktitle = "Proceedings of the 27th International Conference on Computational Linguistics",
+month = aug,
+year = "2018",
+address = "Santa Fe, New Mexico, USA",
+publisher = "Association for Computational Linguistics",
+url = "https://aclanthology.org/C18-1190",
+pages = "2242--2252",
+abstract = "This paper empirically studies the effects of representation choices on neural sentiment analysis for Modern Hebrew, a morphologically rich language (MRL) for which no sentiment analyzer currently exists. We study two dimensions of representational choices: (i) the granularity of the input signal (token-based vs. morpheme-based), and (ii) the level of encoding of vocabulary items (string-based vs. character-based). We hypothesise that for MRLs, languages where multiple meaning-bearing elements may be carried by a single space-delimited token, these choices will have measurable effects on task perfromance, and that these effects may vary for different architectural designs {---} fully-connected, convolutional or recurrent. Specifically, we hypothesize that morpheme-based representations will have advantages in terms of their generalization capacity and task accuracy, due to their better OOV coverage. To empirically study these effects, we develop a new sentiment analysis benchmark for Hebrew, based on 12K social media comments, and provide two instances of these data: in token-based and morpheme-based settings. Our experiments show that representation choices empirical effects vary with architecture type. While fully-connected and convolutional networks slightly prefer token-based settings, RNNs benefit from a morpheme-based representation, in accord with the hypothesis that explicit morphological information may help generalize. Our endeavour also delivers the first state-of-the-art broad-coverage sentiment analyzer for Hebrew, with over 89{\%} accuracy, alongside an established benchmark to further study the effects of linguistic representation choices on neural networks{'} task performance.",
+}
+
+
+
+
Dataset id: hi_semeval2020
+
+
Domain: social_media
+
Language: hi
+
Language family: Indo-European
+
Genus: Indic
+
Definite articles: no article
+
Indefinite articles: no article
+
Number of cases: 3
+
Order of subject, object, verb: SOV
+
Negative morphemes: negative particle
+
Polar questions: question particle
+
Position of negative word wrt SOV: SONegV
+
Prefixing vs suffixing: strongly suffixing
+
Coding of nominal plurality: plural suffix
+
Grammatical genders: masculine, feminine
+
+
@inproceedings{dataset_semeval_2020,
+title = "{S}em{E}val-2020 Task 9: Overview of Sentiment Analysis of Code-Mixed Tweets",
+author = {Patwa, Parth and
+ Aguilar, Gustavo and
+ Kar, Sudipta and
+ Pandey, Suraj and
+ PYKL, Srinivas and
+ Gamb{\"a}ck, Bj{\"o}rn and
+ Chakraborty, Tanmoy and
+ Solorio, Thamar and
+ Das, Amitava},
+booktitle = "Proceedings of the Fourteenth Workshop on Semantic Evaluation",
+month = dec,
+year = "2020",
+address = "Barcelona (online)",
+publisher = "International Committee for Computational Linguistics",
+url = "https://aclanthology.org/2020.semeval-1.100",
+doi = "10.18653/v1/2020.semeval-1.100",
+pages = "774--790",
+}
+
+
+
+
Dataset id: hr_sentiment_news_document
+
+
Domain: news
+
Language: hr
+
Language family: Indo-European
+
Genus: Slavic
+
Definite articles: no article
+
Indefinite articles: no article
+
Number of cases: 5
+
Order of subject, object, verb: SVO
+
Negative morphemes: negative particle
+
Polar questions: question particle
+
Position of negative word wrt SOV: other
+
Prefixing vs suffixing: strongly suffixing
+
Coding of nominal plurality: plural suffix
+
Grammatical genders: masculine, feminine, neuter
+
+
@Article{dataset_hr_sentiment_news_document,
+AUTHOR = {Pelicon, Andraž and Pranjić, Marko and Miljković, Dragana and Škrlj, Blaž and Pollak, Senja},
+TITLE = {Zero-Shot Learning for Cross-Lingual News Sentiment Classification},
+JOURNAL = {Applied Sciences},
+VOLUME = {10},
+YEAR = {2020},
+NUMBER = {17},
+ARTICLE-NUMBER = {5993},
+URL = {https://www.mdpi.com/2076-3417/10/17/5993},
+ISSN = {2076-3417},
+ABSTRACT = {In this paper, we address the task of zero-shot cross-lingual news sentiment classification. Given the annotated dataset of positive, neutral, and negative news in Slovene, the aim is to develop a news classification system that assigns the sentiment category not only to Slovene news, but to news in another language without any training data required. Our system is based on the multilingual BERTmodel, while we test different approaches for handling long documents and propose a novel technique for sentiment enrichment of the BERT model as an intermediate training step. With the proposed approach, we achieve state-of-the-art performance on the sentiment analysis task on Slovenian news. We evaluate the zero-shot cross-lingual capabilities of our system on a novel news sentiment test set in Croatian. The results show that the cross-lingual approach also largely outperforms the majority classifier, as well as all settings without sentiment enrichment in pre-training.},
+DOI = {10.3390/app10175993}
+}
+
+
+
+
Dataset id: hr_twitter_sentiment
+
+
Domain: social_media
+
Language: hr
+
Language family: Indo-European
+
Genus: Slavic
+
Definite articles: no article
+
Indefinite articles: no article
+
Number of cases: 5
+
Order of subject, object, verb: SVO
+
Negative morphemes: negative particle
+
Polar questions: question particle
+
Position of negative word wrt SOV: other
+
Prefixing vs suffixing: strongly suffixing
+
Coding of nominal plurality: plural suffix
+
Grammatical genders: masculine, feminine, neuter
+
+
@article{dataset_twitter_sentiment,
+doi = {10.1371/journal.pone.0155036},
+author = {Mozetič, Igor AND Grčar, Miha AND Smailović, Jasmina},
+journal = {PLOS ONE},
+publisher = {Public Library of Science},
+title = {Multilingual Twitter Sentiment Classification: The Role of Human Annotators},
+year = {2016},
+month = {05},
+volume = {11},
+url = {https://doi.org/10.1371/journal.pone.0155036},
+pages = {1-26},
+number = {5},
+}
+
+
+
+
Dataset id: hu_twitter_sentiment
+
+
Domain: social_media
+
Language: hu
+
Language family: Uralic
+
Genus: Ugric
+
Definite articles: definite word distinct from demonstrative
+
Indefinite articles: indefinite word distinct from one
+
Number of cases: 10 or more
+
Order of subject, object, verb: no dominant order
+
Negative morphemes: negative particle
+
Polar questions: question particle
+
Position of negative word wrt SOV: SNegVO
+
Prefixing vs suffixing: strongly suffixing
+
Coding of nominal plurality: plural suffix
+
Grammatical genders: no grammatical gender
+
+
@article{dataset_twitter_sentiment,
+doi = {10.1371/journal.pone.0155036},
+author = {Mozetič, Igor AND Grčar, Miha AND Smailović, Jasmina},
+journal = {PLOS ONE},
+publisher = {Public Library of Science},
+title = {Multilingual Twitter Sentiment Classification: The Role of Human Annotators},
+year = {2016},
+month = {05},
+volume = {11},
+url = {https://doi.org/10.1371/journal.pone.0155036},
+pages = {1-26},
+number = {5},
+}
+
+
+
+
Dataset id: it_evalita2016
+
+
Domain: social_media
+
Language: it
+
Language family: Indo-European
+
Genus: Romance
+
Definite articles: definite word distinct from demonstrative
+
Indefinite articles: indefinite word same as one
+
Number of cases: no morphological case-making
+
Order of subject, object, verb: SVO
+
Negative morphemes: negative particle
+
Polar questions: interrogative intonation only
+
Position of negative word wrt SOV: SNegVO
+
Prefixing vs suffixing: strongly suffixing
+
Coding of nominal plurality: plural suffix
+
Grammatical genders: masculine, feminine
+
+
@inproceedings{dataset_it_evalita2016,
+TITLE = {{Overview of the Evalita 2016 SENTIment POLarity Classification Task}},
+AUTHOR = {Barbieri, Francesco and Basile, Valerio and Croce, Danilo and Nissim, Malvina and Novielli, Nicole and Patti, Viviana},
+URL = {https://hal.inria.fr/hal-01414731},
+BOOKTITLE = {{Proceedings of Third Italian Conference on Computational Linguistics (CLiC-it 2016) \& Fifth Evaluation Campaign of Natural Language Processing and Speech Tools for Italian. Final Workshop (EVALITA 2016)}},
+ADDRESS = {Naples, Italy},
+YEAR = {2016},
+MONTH = Dec,
+KEYWORDS = {Natural language processing and web ; Social media analysis ; Sentiment analysis},
+PDF = {https://hal.inria.fr/hal-01414731/file/paper_026.pdf},
+HAL_ID = {hal-01414731},
+HAL_VERSION = {v1},
+}
+
+
+
+
Dataset id: it_multiemotions
+
+
Domain: social_media
+
Language: it
+
Language family: Indo-European
+
Genus: Romance
+
Definite articles: definite word distinct from demonstrative
+
Indefinite articles: indefinite word same as one
+
Number of cases: no morphological case-making
+
Order of subject, object, verb: SVO
+
Negative morphemes: negative particle
+
Polar questions: interrogative intonation only
+
Position of negative word wrt SOV: SNegVO
+
Prefixing vs suffixing: strongly suffixing
+
Coding of nominal plurality: plural suffix
+
Grammatical genders: masculine, feminine
+
+
@inproceedings{dataset_it_multiemotions,
+author = {Sprugnoli, Rachele},
+year = {2020},
+month = {12},
+pages = {},
+title = {MultiEmotions-It: a New Dataset for Opinion Polarity and Emotion Analysis for Italian},
+booktitle = {Proceedings of the Seventh Italian Conference on Computational Linguistics},
+}
+
+
+
+
Dataset id: ja_multilan_amazon
+
+
Domain: reviews
+
Language: ja
+
Language family: Japanese
+
Genus: Japanese
+
Definite articles: no article
+
Indefinite articles: indefinite word distinct from one
+
Number of cases: 8-9
+
Order of subject, object, verb: SOV
+
Negative morphemes: negative affix
+
Polar questions: question particle
+
Position of negative word wrt SOV: MorphNeg
+
Prefixing vs suffixing: strongly suffixing
+
Coding of nominal plurality: plural suffix
+
Grammatical genders: no grammatical gender
+
+
@inproceedings{dataset_multilan_amazon,
+title = "The Multilingual {A}mazon Reviews Corpus",
+author = {Keung, Phillip and
+ Lu, Yichao and
+ Szarvas, Gy{\"o}rgy and
+ Smith, Noah A.},
+booktitle = "Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP)",
+month = nov,
+year = "2020",
+address = "Online",
+publisher = "Association for Computational Linguistics",
+url = "https://aclanthology.org/2020.emnlp-main.369",
+doi = "10.18653/v1/2020.emnlp-main.369",
+pages = "4563--4568",
+}
+
+
+
+
Dataset id: lv_ltec_sentiment
+
+
Domain: social_media
+
Language: lv
+
Language family: Indo-European
+
Genus: Baltic
+
Definite articles: demonstrative word used as definite article
+
Indefinite articles: indefinite word same as one
+
Number of cases: 5
+
Order of subject, object, verb: SVO
+
Negative morphemes: negative affix
+
Polar questions: question particle
+
Position of negative word wrt SOV: MorphNeg
+
Prefixing vs suffixing: weakly suffixing
+
Coding of nominal plurality: plural suffix
+
Grammatical genders: masculine, feminine
+
+
@article{dataset_lv_ltec_sentiment,
+author = {Uga Sprogis and
+ Matiss Rikters},
+title = {What Can We Learn From Almost a Decade of Food Tweets},
+journal = {Computing Research Repository},
+volume = {arXiv:2007.05194},
+note = {Version 2},
+year = {2020},
+url = {https://arxiv.org/abs/2007.05194},
+eprinttype = {arXiv},
+eprint = {2007.05194},
+timestamp = {Mon, 20 Jul 2020 14:20:39 +0200},
+biburl = {https://dblp.org/rec/journals/corr/abs-2007-05194.bib},
+bibsource = {dblp computer science bibliography, https://dblp.org}
+}
+
+
+
+
Dataset id: pl_klej_allegro_reviews
+
+
Domain: reviews
+
Language: pl
+
Language family: Indo-European
+
Genus: Slavic
+
Definite articles: no article
+
Indefinite articles: no article
+
Number of cases: 6-7
+
Order of subject, object, verb: SVO
+
Negative morphemes: negative particle
+
Polar questions: question particle
+
Position of negative word wrt SOV: SNegVO
+
Prefixing vs suffixing: strongly suffixing
+
Coding of nominal plurality: plural suffix
+
Grammatical genders: masculine, feminine, neuter
+
+
@inproceedings{dataset_pl_klej_allegro_reviews,
+title = "{KLEJ}: Comprehensive Benchmark for {P}olish Language Understanding",
+author = "Rybak, Piotr and
+ Mroczkowski, Robert and
+ Tracz, Janusz and
+ Gawlik, Ireneusz",
+booktitle = "Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics",
+month = jul,
+year = "2020",
+address = "Online",
+publisher = "Association for Computational Linguistics",
+url = "https://aclanthology.org/2020.acl-main.111",
+doi = "10.18653/v1/2020.acl-main.111",
+pages = "1191--1201",
+}
+
+
+
+
Dataset id: pl_opi_lil_2012
+
+
Domain: social_media
+
Language: pl
+
Language family: Indo-European
+
Genus: Slavic
+
Definite articles: no article
+
Indefinite articles: no article
+
Number of cases: 6-7
+
Order of subject, object, verb: SVO
+
Negative morphemes: negative particle
+
Polar questions: question particle
+
Position of negative word wrt SOV: SNegVO
+
Prefixing vs suffixing: strongly suffixing
+
Coding of nominal plurality: plural suffix
+
Grammatical genders: masculine, feminine, neuter
+
+
@article{dataset_pl_opi_lil_2012,
+author = {Pawel Sobkowicz and Antoni Sobkowicz},
+title ={Two-Year Study of Emotion and Communication Patterns in a Highly Polarized Political Discussion Forum},
+journal = {Social Science Computer Review},
+volume = {30},
+number = {4},
+pages = {448-469},
+year = {2012},
+doi = {10.1177/0894439312436512}
+}
+
+
+
+
Dataset id: pl_polemo
+
+
Domain: reviews
+
Language: pl
+
Language family: Indo-European
+
Genus: Slavic
+
Definite articles: no article
+
Indefinite articles: no article
+
Number of cases: 6-7
+
Order of subject, object, verb: SVO
+
Negative morphemes: negative particle
+
Polar questions: question particle
+
Position of negative word wrt SOV: SNegVO
+
Prefixing vs suffixing: strongly suffixing
+
Coding of nominal plurality: plural suffix
+
Grammatical genders: masculine, feminine, neuter
+
+
@inproceedings{dataset_pl_polemo,
+title = "Multi-Level Sentiment Analysis of {P}ol{E}mo 2.0: Extended Corpus of Multi-Domain Consumer Reviews",
+author = "Koco{\'n}, Jan and
+ Mi{\l}kowski, Piotr and
+ Za{\'s}ko-Zieli{\'n}ska, Monika",
+booktitle = "Proceedings of the 23rd Conference on Computational Natural Language Learning (CoNLL)",
+month = nov,
+year = "2019",
+address = "Hong Kong, China",
+publisher = "Association for Computational Linguistics",
+url = "https://aclanthology.org/K19-1092",
+doi = "10.18653/v1/K19-1092",
+pages = "980--991"
+}
+
+
+
+
Dataset id: pl_twitter_sentiment
+
+
Domain: social_media
+
Language: pl
+
Language family: Indo-European
+
Genus: Slavic
+
Definite articles: no article
+
Indefinite articles: no article
+
Number of cases: 6-7
+
Order of subject, object, verb: SVO
+
Negative morphemes: negative particle
+
Polar questions: question particle
+
Position of negative word wrt SOV: SNegVO
+
Prefixing vs suffixing: strongly suffixing
+
Coding of nominal plurality: plural suffix
+
Grammatical genders: masculine, feminine, neuter
+
+
@article{dataset_twitter_sentiment,
+doi = {10.1371/journal.pone.0155036},
+author = {Mozetič, Igor AND Grčar, Miha AND Smailović, Jasmina},
+journal = {PLOS ONE},
+publisher = {Public Library of Science},
+title = {Multilingual Twitter Sentiment Classification: The Role of Human Annotators},
+year = {2016},
+month = {05},
+volume = {11},
+url = {https://doi.org/10.1371/journal.pone.0155036},
+pages = {1-26},
+number = {5},
+}
+
+
+
+
Dataset id: pt_dai_labor
+
+
Domain: social_media
+
Language: pt
+
Language family: Indo-European
+
Genus: Romance
+
Definite articles: definite word distinct from demonstrative
+
Indefinite articles: indefinite word same as one
+
Number of cases: no morphological case-making
+
Order of subject, object, verb: SVO
+
Negative morphemes: negative particle
+
Polar questions: question particle
+
Position of negative word wrt SOV: SNegVO
+
Prefixing vs suffixing: strongly suffixing
+
Coding of nominal plurality: plural suffix
+
Grammatical genders: masculine, feminine
+
+
@inproceedings{dataset_dai_labor,
+author = {Narr, Sascha and Michael Hülfenhaus and Albayrak, Sahin},
+title = {Language-Independent Twitter Sentiment Analysis},
+booktitle = {Workshop on Knowledge Discovery, Data Mining and Machine Learning (KDML-2012)},
+year = {2012},
+location = {Dortmund, Germany},
+}
+
+
+
+
Dataset id: pt_ifeel
+
+
Domain: social_media
+
Language: pt
+
Language family: Indo-European
+
Genus: Romance
+
Definite articles: definite word distinct from demonstrative
+
Indefinite articles: indefinite word same as one
+
Number of cases: no morphological case-making
+
Order of subject, object, verb: SVO
+
Negative morphemes: negative particle
+
Polar questions: question particle
+
Position of negative word wrt SOV: SNegVO
+
Prefixing vs suffixing: strongly suffixing
+
Coding of nominal plurality: plural suffix
+
Grammatical genders: masculine, feminine
+
+
@inproceedings{dataset_dai_labor,
+author = {Narr, Sascha and Michael Hülfenhaus and Albayrak, Sahin},
+title = {Language-Independent Twitter Sentiment Analysis},
+booktitle = {Workshop on Knowledge Discovery, Data Mining and Machine Learning (KDML-2012)},
+year = {2012},
+location = {Dortmund, Germany},
+}
+
+
+
+
Dataset id: pt_tweet_sent_br
+
+
Domain: social_media
+
Language: pt
+
Language family: Indo-European
+
Genus: Romance
+
Definite articles: definite word distinct from demonstrative
+
Indefinite articles: indefinite word same as one
+
Number of cases: no morphological case-making
+
Order of subject, object, verb: SVO
+
Negative morphemes: negative particle
+
Polar questions: question particle
+
Position of negative word wrt SOV: SNegVO
+
Prefixing vs suffixing: strongly suffixing
+
Coding of nominal plurality: plural suffix
+
Grammatical genders: masculine, feminine
+
+
@inproceedings{dataset_pt_tweet_sent_br,
+title = "Building a Sentiment Corpus of Tweets in {B}razilian {P}ortuguese",
+author = "Brum, Henrico and
+ Volpe Nunes, Maria das Gra{\c{c}}as",
+booktitle = "Proceedings of the Eleventh International Conference on Language Resources and Evaluation ({LREC} 2018)",
+month = may,
+year = "2018",
+address = "Miyazaki, Japan",
+publisher = "European Language Resources Association (ELRA)",
+url = "https://aclanthology.org/L18-1658",
+}
+
+
+
+
Dataset id: pt_twitter_sentiment
+
+
Domain: social_media
+
Language: pt
+
Language family: Indo-European
+
Genus: Romance
+
Definite articles: definite word distinct from demonstrative
+
Indefinite articles: indefinite word same as one
+
Number of cases: no morphological case-making
+
Order of subject, object, verb: SVO
+
Negative morphemes: negative particle
+
Polar questions: question particle
+
Position of negative word wrt SOV: SNegVO
+
Prefixing vs suffixing: strongly suffixing
+
Coding of nominal plurality: plural suffix
+
Grammatical genders: masculine, feminine
+
+
@article{dataset_twitter_sentiment,
+doi = {10.1371/journal.pone.0155036},
+author = {Mozetič, Igor AND Grčar, Miha AND Smailović, Jasmina},
+journal = {PLOS ONE},
+publisher = {Public Library of Science},
+title = {Multilingual Twitter Sentiment Classification: The Role of Human Annotators},
+year = {2016},
+month = {05},
+volume = {11},
+url = {https://doi.org/10.1371/journal.pone.0155036},
+pages = {1-26},
+number = {5},
+}
+
+
+
+
Dataset id: ru_sentiment
+
+
Domain: social_media
+
Language: ru
+
Language family: Indo-European
+
Genus: Slavic
+
Definite articles: no article
+
Indefinite articles: no article
+
Number of cases: 6-7
+
Order of subject, object, verb: SVO
+
Negative morphemes: negative particle
+
Polar questions: question particle
+
Position of negative word wrt SOV: SNegVO
+
Prefixing vs suffixing: strongly suffixing
+
Coding of nominal plurality: plural suffix
+
Grammatical genders: masculine, feminine, neuter
+
+
@inproceedings{dataset_ru_sentiment,
+title = "{R}u{S}entiment: An Enriched Sentiment Analysis Dataset for Social Media in {R}ussian",
+author = "Rogers, Anna and
+ Romanov, Alexey and
+ Rumshisky, Anna and
+ Volkova, Svitlana and
+ Gronas, Mikhail and
+ Gribov, Alex",
+booktitle = "Proceedings of the 27th International Conference on Computational Linguistics",
+month = aug,
+year = "2018",
+address = "Santa Fe, New Mexico, USA",
+publisher = "Association for Computational Linguistics",
+url = "https://aclanthology.org/C18-1064",
+pages = "755--763",
+abstract = "This paper presents RuSentiment, a new dataset for sentiment analysis of social media posts in Russian, and a new set of comprehensive annotation guidelines that are extensible to other languages. RuSentiment is currently the largest in its class for Russian, with 31,185 posts annotated with Fleiss{'} kappa of 0.58 (3 annotations per post). To diversify the dataset, 6,950 posts were pre-selected with an active learning-style strategy. We report baseline classification results, and we also release the best-performing embeddings trained on 3.2B tokens of Russian VKontakte posts.",
+}
+
+
+
+
Dataset id: ru_twitter_sentiment
+
+
Domain: social_media
+
Language: ru
+
Language family: Indo-European
+
Genus: Slavic
+
Definite articles: no article
+
Indefinite articles: no article
+
Number of cases: 6-7
+
Order of subject, object, verb: SVO
+
Negative morphemes: negative particle
+
Polar questions: question particle
+
Position of negative word wrt SOV: SNegVO
+
Prefixing vs suffixing: strongly suffixing
+
Coding of nominal plurality: plural suffix
+
Grammatical genders: masculine, feminine, neuter
+
+
@article{dataset_twitter_sentiment,
+doi = {10.1371/journal.pone.0155036},
+author = {Mozetič, Igor AND Grčar, Miha AND Smailović, Jasmina},
+journal = {PLOS ONE},
+publisher = {Public Library of Science},
+title = {Multilingual Twitter Sentiment Classification: The Role of Human Annotators},
+year = {2016},
+month = {05},
+volume = {11},
+url = {https://doi.org/10.1371/journal.pone.0155036},
+pages = {1-26},
+number = {5},
+}
+
+
+
+
Dataset id: sk_twitter_sentiment
+
+
Domain: social_media
+
Language: sk
+
Language family: Indo-European
+
Genus: Slavic
+
Definite articles: no article
+
Indefinite articles: no article
+
Number of cases: 6-7
+
Order of subject, object, verb: SVO
+
Negative morphemes: negative affix
+
Polar questions: interrogative word order
+
Position of negative word wrt SOV: MorphNeg
+
Prefixing vs suffixing: weakly suffixing
+
Coding of nominal plurality: plural suffix
+
Grammatical genders: masculine, feminine, neuter
+
+
@article{dataset_twitter_sentiment,
+doi = {10.1371/journal.pone.0155036},
+author = {Mozetič, Igor AND Grčar, Miha AND Smailović, Jasmina},
+journal = {PLOS ONE},
+publisher = {Public Library of Science},
+title = {Multilingual Twitter Sentiment Classification: The Role of Human Annotators},
+year = {2016},
+month = {05},
+volume = {11},
+url = {https://doi.org/10.1371/journal.pone.0155036},
+pages = {1-26},
+number = {5},
+}
+
+
+
+
Dataset id: sl_sentinews
+
+
Domain: news
+
Language: sl
+
Language family: Indo-European
+
Genus: Slavic
+
Definite articles: no article
+
Indefinite articles: no article
+
Number of cases: 6-7
+
Order of subject, object, verb: SVO
+
Negative morphemes: negative particle
+
Polar questions: question particle
+
Position of negative word wrt SOV: SNegVO
+
Prefixing vs suffixing: strongly suffixing
+
Coding of nominal plurality: plural suffix
+
Grammatical genders: masculine, feminine, neuter
+
+
@Article{Bučar2018,
+author={Bu{\v{c}}ar, Jo{\v{z}}e
+ and {\v{Z}}nidar{\v{s}}i{\v{c}}, Martin
+ and Povh, Janez},
+title={Annotated news corpora and a lexicon for sentiment analysis in Slovene},
+journal={Language Resources and Evaluation},
+year={2018},
+month={Sep},
+day={01},
+volume={52},
+number={3},
+pages={895-919},
+abstract={In this study, we introduce Slovene web-crawled news corpora with sentiment annotation on three levels of granularity: sentence, paragraph and document levels. We describe the methodology and tools that were required for their construction. The corpora contain more than 250,000 documents with political, business, economic and financial content from five Slovene media resources on the web. More than 10,000 of them were manually annotated as negative, neutral or positive. All corpora are publicly available under a Creative Commons copyright license. We used the annotated documents to construct a Slovene sentiment lexicon, which is the first of its kind for Slovene, and to assess the sentiment classification approaches used. The constructed corpora were also utilised to monitor within-the-document sentiment dynamics, its changes over time and relations with news topics. We show that sentiment is, on average, more explicit at the beginning of documents, and it loses sharpness towards the end of documents.},
+issn={1574-0218},
+doi={10.1007/s10579-018-9413-3},
+url={https://doi.org/10.1007/s10579-018-9413-3}
+}
+
+
+
+
Dataset id: sl_twitter_sentiment
+
+
Domain: social_media
+
Language: sl
+
Language family: Indo-European
+
Genus: Slavic
+
Definite articles: no article
+
Indefinite articles: no article
+
Number of cases: 6-7
+
Order of subject, object, verb: SVO
+
Negative morphemes: negative particle
+
Polar questions: question particle
+
Position of negative word wrt SOV: SNegVO
+
Prefixing vs suffixing: strongly suffixing
+
Coding of nominal plurality: plural suffix
+
Grammatical genders: masculine, feminine, neuter
+
+
@article{dataset_twitter_sentiment,
+doi = {10.1371/journal.pone.0155036},
+author = {Mozetič, Igor AND Grčar, Miha AND Smailović, Jasmina},
+journal = {PLOS ONE},
+publisher = {Public Library of Science},
+title = {Multilingual Twitter Sentiment Classification: The Role of Human Annotators},
+year = {2016},
+month = {05},
+volume = {11},
+url = {https://doi.org/10.1371/journal.pone.0155036},
+pages = {1-26},
+number = {5},
+}
+
+
+
+
Dataset id: sq_twitter_sentiment
+
+
Domain: social_media
+
Language: sq
+
Language family: Indo-European
+
Genus: Albanian
+
Definite articles: definite affix
+
Indefinite articles: indefinite word distinct from one
+
Number of cases: 4
+
Order of subject, object, verb: SVO
+
Negative morphemes: negative particle
+
Polar questions: question particle
+
Position of negative word wrt SOV: SNegVO
+
Prefixing vs suffixing: strongly suffixing
+
Coding of nominal plurality: plural suffix
+
Grammatical genders: masculine, feminine
+
+
@article{dataset_twitter_sentiment,
+doi = {10.1371/journal.pone.0155036},
+author = {Mozetič, Igor AND Grčar, Miha AND Smailović, Jasmina},
+journal = {PLOS ONE},
+publisher = {Public Library of Science},
+title = {Multilingual Twitter Sentiment Classification: The Role of Human Annotators},
+year = {2016},
+month = {05},
+volume = {11},
+url = {https://doi.org/10.1371/journal.pone.0155036},
+pages = {1-26},
+number = {5},
+}
+
+
+
+
Dataset id: sr_movie_reviews
+
+
Domain: reviews
+
Language: sr
+
Language family: Indo-European
+
Genus: Slavic
+
Definite articles: no article
+
Indefinite articles: no article
+
Number of cases: 5
+
Order of subject, object, verb: SVO
+
Negative morphemes: negative particle
+
Polar questions: question particle
+
Position of negative word wrt SOV: other
+
Prefixing vs suffixing: strongly suffixing
+
Coding of nominal plurality: plural suffix
+
Grammatical genders: masculine, feminine, neuter
+
+
@inproceedings{dataset_sr_serb_movie_reviews,
+title = "Reliable Baselines for Sentiment Analysis in Resource-Limited Languages: The {S}erbian Movie Review Dataset",
+author = "Batanovi{\'c}, Vuk and
+ Nikoli{\'c}, Bo{\v{s}}ko and
+ Milosavljevi{\'c}, Milan",
+booktitle = "Proceedings of the Tenth International Conference on Language Resources and Evaluation ({LREC}'16)",
+month = may,
+year = "2016",
+address = "Portoro{\v{z}}, Slovenia",
+publisher = "European Language Resources Association (ELRA)",
+url = "https://aclanthology.org/L16-1427",
+pages = "2688--2696",
+abstract = "Collecting data for sentiment analysis in resource-limited languages carries a significant risk of sample selection bias, since the small quantities of available data are most likely not representative of the whole population. Ignoring this bias leads to less robust machine learning classifiers and less reliable evaluation results. In this paper we present a dataset balancing algorithm that minimizes the sample selection bias by eliminating irrelevant systematic differences between the sentiment classes. We prove its superiority over the random sampling method and we use it to create the Serbian movie review dataset ― SerbMR ― the first balanced and topically uniform sentiment analysis dataset in Serbian. In addition, we propose an incremental way of finding the optimal combination of simple text processing options and machine learning features for sentiment classification. Several popular classifiers are used in conjunction with this evaluation approach in order to establish strong but reliable baselines for sentiment analysis in Serbian.",
+}
+
+
+
+
Dataset id: sr_senticomments
+
+
Domain: reviews
+
Language: sr
+
Language family: Indo-European
+
Genus: Slavic
+
Definite articles: no article
+
Indefinite articles: no article
+
Number of cases: 5
+
Order of subject, object, verb: SVO
+
Negative morphemes: negative particle
+
Polar questions: question particle
+
Position of negative word wrt SOV: other
+
Prefixing vs suffixing: strongly suffixing
+
Coding of nominal plurality: plural suffix
+
Grammatical genders: masculine, feminine, neuter
+
+
@article{dataset_sr_senticomments,
+doi = {10.1371/journal.pone.0242050},
+author = {Batanović, Vuk AND Cvetanović, Miloš AND Nikolić, Boško},
+journal = {PLOS ONE},
+publisher = {Public Library of Science},
+title = {A versatile framework for resource-limited sentiment articulation, annotation, and analysis of short texts},
+year = {2020},
+month = {11},
+volume = {15},
+url = {https://doi.org/10.1371/journal.pone.0242050},
+pages = {1-30},
+abstract = {Choosing a comprehensive and cost-effective way of articulating and annotating the sentiment of a text is not a trivial task, particularly when dealing with short texts, in which sentiment can be expressed through a wide variety of linguistic and rhetorical phenomena. This problem is especially conspicuous in resource-limited settings and languages, where design options are restricted either in terms of manpower and financial means required to produce appropriate sentiment analysis resources, or in terms of available language tools, or both. In this paper, we present a versatile approach to addressing this issue, based on multiple interpretations of sentiment labels that encode information regarding the polarity, subjectivity, and ambiguity of a text, as well as the presence of sarcasm or a mixture of sentiments. We demonstrate its use on Serbian, a resource-limited language, via the creation of a main sentiment analysis dataset focused on movie comments, and two smaller datasets belonging to the movie and book domains. In addition to measuring the quality of the annotation process, we propose a novel metric to validate its cost-effectiveness. Finally, the practicality of our approach is further validated by training, evaluating, and determining the optimal configurations of several different kinds of machine-learning models on a range of sentiment classification tasks using the produced dataset.},
+number = {11},
+}
+
+
+
+
Dataset id: sr_twitter_sentiment
+
+
Domain: social_media
+
Language: sr
+
Language family: Indo-European
+
Genus: Slavic
+
Definite articles: no article
+
Indefinite articles: no article
+
Number of cases: 5
+
Order of subject, object, verb: SVO
+
Negative morphemes: negative particle
+
Polar questions: question particle
+
Position of negative word wrt SOV: other
+
Prefixing vs suffixing: strongly suffixing
+
Coding of nominal plurality: plural suffix
+
Grammatical genders: masculine, feminine, neuter
+
+
@article{dataset_twitter_sentiment,
+doi = {10.1371/journal.pone.0155036},
+author = {Mozetič, Igor AND Grčar, Miha AND Smailović, Jasmina},
+journal = {PLOS ONE},
+publisher = {Public Library of Science},
+title = {Multilingual Twitter Sentiment Classification: The Role of Human Annotators},
+year = {2016},
+month = {05},
+volume = {11},
+url = {https://doi.org/10.1371/journal.pone.0155036},
+pages = {1-26},
+number = {5},
+}
+
+
+
+
Dataset id: sv_twitter_sentiment
+
+
Domain: social_media
+
Language: sv
+
Language family: Indo-European
+
Genus: Germanic
+
Definite articles: definite affix
+
Indefinite articles: indefinite word same as one
+
Number of cases: 2
+
Order of subject, object, verb: SVO
+
Negative morphemes: negative particle
+
Polar questions: interrogative word order
+
Position of negative word wrt SOV: more than one position
+
Prefixing vs suffixing: strongly suffixing
+
Coding of nominal plurality: plural suffix
+
Grammatical genders: common, neuter
+
+
@article{dataset_twitter_sentiment,
+doi = {10.1371/journal.pone.0155036},
+author = {Mozetič, Igor AND Grčar, Miha AND Smailović, Jasmina},
+journal = {PLOS ONE},
+publisher = {Public Library of Science},
+title = {Multilingual Twitter Sentiment Classification: The Role of Human Annotators},
+year = {2016},
+month = {05},
+volume = {11},
+url = {https://doi.org/10.1371/journal.pone.0155036},
+pages = {1-26},
+number = {5},
+}
+
+
+
+
Dataset id: th_wisesight_sentiment
+
+
Domain: social_media
+
Language: th
+
Language family: Tai-Kadai
+
Genus: Kam-Tai
+
Definite articles: no article
+
Indefinite articles: indefinite word distinct from one
+
Number of cases: no morphological case-making
+
Order of subject, object, verb: SVO
+
Negative morphemes: negative auxiliary verb
+
Polar questions: question particle
+
Position of negative word wrt SOV: SNegVO
+
Prefixing vs suffixing: little affixation
+
Coding of nominal plurality: mixed morphological plural
@InProceedings{dataset_ur_roman_urdu,
+title = "Performing Natural Language Processing on Roman Urdu Datasets",
+author = "Zareen Sharf and Saif Ur Rahman",
+booktitle = "International Journal of Computer Science and Network Security",
+volume = "18",
+pages = "141-148",
+year = "2018",
+url = {http://paper.ijcsns.org/07_book/201801/20180117.pdf}
+}
+
+
+
+
Dataset id: zh_hotel_reviews
+
+
Domain: reviews
+
Language: zh
+
Language family: Sino-Tibetan
+
Genus: Chinese
+
Definite articles: no article
+
Indefinite articles: indefinite word same as one
+
Number of cases: no morphological case-making
+
Order of subject, object, verb: SVO
+
Negative morphemes: negative particle
+
Polar questions: question particle
+
Position of negative word wrt SOV: SNegVO
+
Prefixing vs suffixing: little affixation
+
Coding of nominal plurality: no plural
+
Grammatical genders: noun classifiers
+
+
@inproceedings{dataset_zh_hotel_reviews,
+title = "An Empirical Study on Sentiment Classification of {C}hinese Review using Word Embedding",
+author = "Lin, Yiou and
+ Lei, Hang and
+ Wu, Jia and
+ Li, Xiaoyu",
+booktitle = "Proceedings of the 29th Pacific Asia Conference on Language, Information and Computation: Posters",
+month = oct,
+year = "2015",
+address = "Shanghai, China",
+url = "https://aclanthology.org/Y15-2030",
+pages = "258--266",
+}
+
+
+
Dataset id: zh_multilan_amazon
+
+
Domain: reviews
+
Language: zh
+
Language family: Sino-Tibetan
+
Genus: Chinese
+
Definite articles: no article
+
Indefinite articles: indefinite word same as one
+
Number of cases: no morphological case-making
+
Order of subject, object, verb: SVO
+
Negative morphemes: negative particle
+
Polar questions: question particle
+
Position of negative word wrt SOV: SNegVO
+
Prefixing vs suffixing: little affixation
+
Coding of nominal plurality: no plural
+
Grammatical genders: noun classifiers
+
+
@inproceedings{dataset_multilan_amazon,
+title = "The Multilingual {A}mazon Reviews Corpus",
+author = {Keung, Phillip and
+ Lu, Yichao and
+ Szarvas, Gy{\"o}rgy and
+ Smith, Noah A.},
+booktitle = "Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP)",
+month = nov,
+year = "2020",
+address = "Online",
+publisher = "Association for Computational Linguistics",
+url = "https://aclanthology.org/2020.emnlp-main.369",
+doi = "10.18653/v1/2020.emnlp-main.369",
+pages = "4563--4568",
+}
+
One of the key ideas behind creating our library of datasets was to prioritize ease of use for researchers. Recognizing the importance of accessibility and convenience, we chose the HuggingFace platform as the storage and distribution platform for the datasets. HuggingFace provides a user-friendly interface and a wide range of tools and resources, making it easy for researchers to access and utilize the datasets.
+
To further enhance usability, we took the initiative to gather all the necessary citations for the datasets included in our library. By unifying the citations, we aimed to simplify and expedite the process of generating citations for researchers who utilize our datasets. This step reduces the time and effort required for researchers to acknowledge the datasets’ sources properly.
+
However, it is essential to note that while we have taken steps to streamline the citation process, researchers should still independently verify the licenses of the datasets, especially if they intend to use them for purposes beyond strict academic research. Ensuring compliance with licensing requirements is crucial to maintaining ethical and legal data use standards.
+
Overall, our overarching goal in creating this unified corpus of datasets is accelerating academic sentiment analysis research. By providing a comprehensive collection of high-quality datasets and facilitating their accessibility, we aim to support researchers in exploring and advancing sentiment analysis techniques and methodologies.
+
+
Data ready to slice and dice and train a model
+
Our dataset is designed to be versatile and allows researchers to slice and dice the data for training and modeling according to their specific needs. Drawing from the field of linguistic typology, which examines the characteristics of languages, we have incorporated various linguistic features into our dataset selection process. These features include the text itself, sentiment labels, the original dataset source, domain, language, language family, genus, the presence or absence of definite and indefinite articles, the number of cases, word order, negative morphemes, polar questions, the position of negative morphemes, prefixing vs. suffixing, coding of nominal plurals, and grammatical genders. Researchers can easily access datasets that match their desired linguistic typology criteria by offering these features as filtering options in our library.
+
For instance, researchers can download datasets specific to Slavic languages with interrogative word order for polar questions or datasets from the Afro-Asiatic language family without morphological case-making. This flexibility empowers researchers to tailor their analyses and models to their linguistic interests and research questions.
The field of language typology focuses on studying the similarities and differences among languages. These differences can be categorized into phonological (sounds), syntactic (structures), lexical (vocabulary), and theoretical aspects. Linguistic typology analyzes the current state of languages, contrasting with genealogical linguistics, which examines historical relationships between languages.
+
Genealogical linguistics studies language families and genera. A language family consists of languages that share a common ancestral language, while genera are branches within a language family. The Indo-European family, for example, includes genera such as Slavic, Romance, Germanic, and Indic. Over 7000 languages are categorized into approximately 150 language families, with Indo-European, Sino-Tibetan, Turkic, Afro-Asiatic, Nilo-Saharan, Niger-Congo, and Eskimo-Aleut being some of the largest families.
+
Within linguistic typology, languages are described using various linguistic features. Our work focuses on sentiment classification and selects ten relevant features:
+
+
text: The feature text represents the actual text of the sentiment dataset. It is of type string and contains the text samples or sentences for sentiment analysis.
+
label: The feature label corresponds to the sentiment labels of the text samples. It is of type ClassLabel and has three possible values: negative, neutral, and positive. These labels indicate the sentiment or emotional polarity associated with the text.
+
original_dataset: The feature original_dataset refers to the name or identifier of the original dataset from which the text samples were extracted. It is of type string and provides information about the source dataset.
+
domain: The feature domain represents the domain or topic of the sentiment dataset. It is of type string and provides context regarding the subject matter of the text samples.
+
language: The feature language indicates the language of the text samples in the sentiment dataset. It is of type string and specifies the language in which the text is written.
+
Family: The feature Family represents the language family to which a specific language belongs. It is of type string and provides information about the broader categorization of languages into language families.
+
Genus: The feature Genus corresponds to the genus or branch within a language family. It is of type string and indicates the specific subgrouping of languages within a language family.
+
Definite article: Half of the languages do not use the definite article, which signals uniqueness or definiteness of a concept.
+
Indefinite article: Half of the languages do not use the indefinite article, with some languages using a separate article or the numeral “one.”
+
Number of cases: Languages vary greatly in the number of morphological cases used.
+
Order of subject, verb, and object: Different languages have different word orderings, with variations like SOV, SVO, VSO, VOS, OVS, and OSV.
+
Negative morphemes: Negative morphemes indicate clausal negation in declarative sentences.
+
Polar questions: Questions with yes/no answers, which can be formed using question particles, interrogative morphology, or intonation.
+
Position of the negative morpheme: The position of the negative morpheme can vary in relation to subjects and objects.
+
Prefixing vs. suffixing: Languages differ in their use of prefixes and suffixes in inflectional morphology.
+
Coding of nominal plurals: Plurals can be expressed through morphological changes or the use of plurality indicator morphemes.
+
Grammatical genders: Languages vary in the number of grammatical genders used, or may not use the concept at all.
+
+
These language features are available as filtering options in our library. Users can download specific facets of the collection, such as datasets in Slavic languages with interrogative word order for polar questions or datasets from the Afro-Asiatic language family without morphological case-making.
+
+
+
+
Datasheets for Datasets
+
The datasheets provide detailed information about the datasets, including data collection methods, annotation guidelines, and potential biases. They also specify the intended uses and potential limitations of the datasets.
+
The initial pool of sentiment datasets was gathered through an extensive search using sources such as Google Scholar, GitHub repositories, and the HuggingFace datasets library. This search yielded a total of 345 datasets.
+
To ensure the quality of the datasets, a set of quality assurance criteria was applied to manually filter the initial pool of datasets. The following criteria were used:
+
+
Strong Annotations: Datasets containing weak annotations, such as labels based on emoji occurrence or automatically generated through classification by machine learning models, were rejected. This decision was made to minimize the presence of noise in the datasets, ensuring higher quality annotations.
+
Well-Defined Annotation Protocol: Datasets without sufficient information about the annotation protocol, including whether the annotation was done manually or automatically and the number of annotators involved, were rejected. This step aimed to avoid merging datasets with contradicting annotation instructions, ensuring consistency across the selected datasets.
+
Numerical Ratings: Datasets with numerical ratings were accepted. Specifically, Likert-type 5-point scales were mapped into three class sentiment labels. Ratings 1 and 2 were mapped to “negative,” rating 3 was mapped to “neutral,” and ratings 4 and 5 were mapped to “positive.” This mapping allowed for consistent sentiment labeling across the datasets.
+
Three Classes Only: Datasets annotated with binary sentiment labels were rejected. The decision to focus on datasets with three sentiment classes (negative, neutral, and positive) was made based on the unsatisfactory performance of binary sentiment labeling in three-class settings.
+
Monolingual Datasets: In cases where a dataset contained samples in multiple languages, it was divided into independent datasets for each constituent language. This approach ensured that the corpus includes separate datasets for different languages, allowing for targeted analysis and evaluation.
+
+
By applying these quality assurance criteria, we were able to filter the initial pool of sentiment datasets and select a final set of 79 datasets that met the specified standards for inclusion in the multilingual corpus.
+
+
f"We cover {mms_dataset_df.original_dataset.nunique()} datasets in {mms_dataset_df.language.nunique()} languages."
+
+
'We cover 79 datasets in 27 languages.'
+
+
+
+
f"The classes that we cover: {mms_dataset_df.label_name.unique()}"
+
+
"The classes that we cover: ['positive' 'neutral' 'negative']"
+
+
+
+
+
Limitations
+
Despite the fact that our collection is the largest public collection of multilingual sentiment datasets, it still covers only 27 languages. The collection of datasets is highly biased towards the Indo-European family of languages, English in particular. We attribute this bias to the general culture of scientific publishing and its enforcement of English as the primary carrier of scientific discovery. Our work’s main potential negative social impact is that the models developed and trained using the provided datasets may still exhibit better performance for the major languages. This could further perpetuate the existing language disparities and inequality in sentiment analysis capabilities across different languages. Addressing this limitation and working towards more equitable representation and performance across languages is crucial to avoid reinforcing language biases and the potential marginalization of underrepresented languages. The ethical implications of such disparities should be thoroughly discussed and considered.
+
+
+
+Data Quality
+
+
+
An important limitation of our dataset collection is a significant variance in sample quality across all datasets and all languages. Above figure presents the distribution of self-confidence label-quality score for each data point computed by the cleanlab(Northcutt, Jiang, and Chuang 2021). The distribution of quality is skewed in favor of popular languages, with low-resource languages suffering from data quality issues. A related limitation is caused by an unequal distribution of data modalities across languages. For instance, our benchmark clearly shows that all models universally underperform when tested on Portuguese datasets. This is the direct result of the fact that data points for Portuguese almost exclusively represent the domain of social media. As a consequence, some combinations of filtering facets in our dataset collection produce very little data (i.e., asking for social media data in the Germanic genus of Indo-European languages will produce a significantly larger dataset than asking for news data representing Afro-Asiatic languages).
+
Finally, we acknowledge the lack of internal coherence of annotation protocols between datasets and languages. We have enforced strict quality criteria and rejected all datasets published without the annotation protocol, but we were unable, for obvious reasons, to unify annotation guidelines. The annotation of sentiment expressions and the assignment of sentiment labels are heavily subjective and, at the same time, influenced by cultural and linguistic features. Unfortunately, it is possible that semantically similar utterances will be assigned conflicting labels if they come from different datasets or modalities.
+
+
Filter examples by annotation qualitym
+
We know how imporant data quality is for the model training processes. Hence, we added cleanlab scores to each of 6M+ examples in all datasets. Now, it is enalbe to filter examples based on how good quality of data do you need for traning.
+
We can sort examples by top data quality. Cleanlab’s self confidence is a function to compute label-quality scores for classification datasets, where lower scores indicate labels less likely to be correct. Hence, for the best quality we want to have the highest scores.
Hosting: The datasets and benchmark will be hosted on a reliable and scalable cloud infrastructure to ensure accessibility and availability (HuggingFace Hub). The choice of hosting platform will be based on factors such as reliability, performance, and cost-effectiveness.
+
Licensing: We will clearly state the data license under which the datasets are released, ensuring that the terms of use are explicitly defined. We will consider licenses that facilitate research and allow for derivative works, while also addressing potential ethical considerations. See the license in repository.
+
Maintenance: We (see Dataset Curators section) are committed to providing ongoing maintenance and support for the datasets and benchmark. This includes regular updates, bug fixes, and addressing any user feedback or inquiries. We will also establish a communication channel for users to report issues or request assistance.
+
+
+
+
+
+
+
References
+
+Northcutt, Curtis, Lu Jiang, and Isaac Chuang. 2021. “Confident Learning: Estimating Uncertainty in Dataset Labels.”Journal of Artificial Intelligence Research 70: 1373–1411.
+
+
+
+
+
+
+
+
\ No newline at end of file
diff --git a/images/quality.png b/images/quality.png
new file mode 100644
index 0000000000000000000000000000000000000000..80789eefb70c6fa764109a28638d53cfd659f6eb
GIT binary patch
literal 17462
zcmeHubySt#*6xdn0VaYVN=PbFn`To6h;%oCu-O~w4rv1s1C>@urCX6kKmjob5fDKM
zrKCYh`p$*^;@or2{l*#Ne*YcEkXU=Y>s@QEna?u`R#%nZML|!2Vc0H(v$C2Pwh4z}
zWLev{!U(tj{49K{_R`jO)im>9c64?iS=kbqT`xKknTeiOBn&P7)sGnMh54-L
z%<$3ug@QSIB@*|)vtD-RD}By7?7w}QEg?<0h7_=rctRyiviLjm_Y;qkiW*yjdHZ|f
zI9_hE4lr=5qtHDKXS-r``n0;j>C=B42M!VAdr#_Y^@+o^rdkD$XtoJn7qduHbx&sr
zF$`qU-d=Djb2mqn-^s9RY_+u-jyz&NpXj?eI(=+=p|f|3%n9RjG1TXhYSx7V58xON
zFZ6Xiuj`UHkrs8|-lJht=~w-9S>v}BddcsPd+j|XW4@P$^w8yL%+<-CrSbu}9vX22
z{u52OgaO;FTiCuCkPLTEZ=Ie^Avkw)9x%{ozTOnf$z94k&DySWr$>zT0r!-0vtsIC
zu$+1N`xn;R@*gGdSKB8q)Ro|Kr0>bAi#PL4a-M#aTBNKNClK$C3d!HAVu@rvefb8L
z;?e4p;ks9-4;|~gv;0&3f!}>&t`f!b{rV@!@!=^ge`%
zlG6*fuS&ajz1p$YXKT)_!b;6;Bx!}*f`Zrk_=|TL8y5+??J533b}e4HR`Y@8-ITjc
zn
+ The most extensive open massively multilingual corpus of datasets for training sentiment models. The corpus consists of 79 manually selected from over 350 datasets reported in the scientific literature based on strict quality criteria and covers 27 languages.
+
Despite impressive advancements in multilingual corpora collection and model training, developing large-scale deployments of multilingual models still presents a significant challenge. This is particularly true for language tasks that are culture-dependent. One such example is the area of multilingual sentiment analysis, where affective markers can be subtle and deeply ensconced in culture.
+
This work presents the most extensive open massively multilingual corpus of datasets for training sentiment models. The corpus consists of 79 manually selected datasets from over 350 datasets reported in the scientific literature based on strict quality criteria. The corpus covers 27 languages representing 6 language families. Datasets can be queried using several linguistic and functional features. In addition, we present a multi-faceted sentiment classification benchmark summarizing hundreds of experiments conducted on different base models, training objectives, dataset collections, and fine-tuning strategies.
We provide not only texts and sentiment labels but we assigned many additional dimensions for datasets and languages, hence it is possible to splice and dice them as you want and need.
{'_id': 2001000,
+ 'text': 'I was a tomboy and this has such great memories for me. They fit exactly how I remember, PERFECTLY!!',
+ 'label': 2,
+ 'original_dataset': 'en_amazon',
+ 'domain': 'reviews',
+ 'language': 'en',
+ 'Family': 'Indo-European',
+ 'Genus': 'Germanic',
+ 'Definite articles': 'definite word distinct from demonstrative',
+ 'Indefinite articles': 'indefinite word distinct from one',
+ 'Number of cases': '2',
+ 'Order of subject, object, verb': 'SVO',
+ 'Negative morphemes': 'negative particle',
+ 'Polar questions': 'interrogative word order',
+ 'Position of negative word wrt SOV': 'SNegVO',
+ 'Prefixing vs suffixing': 'strongly suffixing',
+ 'Coding of nominal plurality': 'plural suffix',
+ 'Grammatical genders': 'no grammatical gender',
+ 'cleanlab_self_confidence': 0.9978116750717163}
Thus, when training a sentiment classifier using our dataset, one may download different facets of the collection. For instance, one can download all datasets in Slavic languages in which polar questions are formed using the interrogative word order or download all datasets from the Afro-Asiatic language family with no morphological case-making.
@misc{augustyniak2023massively,
+title={Massively Multilingual Corpus of Sentiment Datasets and Multi-faceted Sentiment Classification Benchmark},
+author={Łukasz Augustyniak and Szymon Woźniak and Marcin Gruza and Piotr Gramacki and Krzysztof Rajda and Mikołaj Morzy and Tomasz Kajdanowicz},
+year={2023},
+eprint={2306.07902},
+archivePrefix={arXiv},
+primaryClass={cs.CL}
+}
+
+
+
Acknowledgements
+
+
BRAND24 - https://brand24.com
+
CLARIN-PL-Biz - https://clarin.biz
+
+
+
+
Licensing Information
+
These data are released under this licensing scheme. We do not own any text from which these data and datasets have been extracted.
+
We license the actual packaging of these data under the Attribution-NonCommercial 4.0 International (CC BY-NC 4.0) https://creativecommons.org/licenses/by-nc/4.0/
+
This work is published from Poland.
+
Should you consider that our data contains material that is owned by you and should, therefore not be reproduced here, please: * Clearly identify yourself with detailed contact data such as an address, telephone number, or email address at which you can be contacted. * Clearly identify the copyrighted work claimed to be infringed. * Clearly identify the material claimed to be infringing and the information reasonably sufficient to allow us to locate the material.
+
We will comply with legitimate requests by removing the affected sources from the next release of the corpus.
+
+
+
+
+
+
+
+
+
+
+
+
\ No newline at end of file
diff --git a/robots.txt b/robots.txt
new file mode 100644
index 0000000..a915b08
--- /dev/null
+++ b/robots.txt
@@ -0,0 +1 @@
+Sitemap: https://Brand24-AI.github.io/mms_benchmark/mms_benchmark/sitemap.xml
diff --git a/search.json b/search.json
new file mode 100644
index 0000000..0e24b44
--- /dev/null
+++ b/search.json
@@ -0,0 +1,177 @@
+[
+ {
+ "objectID": "training_example.html",
+ "href": "training_example.html",
+ "title": "MMS - Example training pipeline",
+ "section": "",
+ "text": "!pip install datasets transformers==4.30.0 torch sacremoses scikit-learn evaluate accelerate\n\n\nimport os\n\nimport evaluate\nimport numpy as np\nfrom datasets import load_dataset\nfrom transformers import (\n AutoModelForSequenceClassification,\n AutoTokenizer,\n Trainer,\n TrainingArguments,\n)\n\nOur dataset is publicly available but we need to you to accept conditions. Please see this link, accept the terms\n\nmms_dataset = load_dataset(\"Brand24/mms\")\n\nDownloading and preparing dataset mms/default to /root/.cache/huggingface/datasets/Brand24___mms/default/0.2.0/70532fdd01f149ff84a280b7d9cfb661643abf4837b4f0f3aa1128064e870d65...\nDataset mms downloaded and prepared to /root/.cache/huggingface/datasets/Brand24___mms/default/0.2.0/70532fdd01f149ff84a280b7d9cfb661643abf4837b4f0f3aa1128064e870d65. Subsequent calls will reuse this data.\n\n\n\n\n\n\n\n\n\n\n\n\n\n\nThere are 14 different dimensions which differentiate obtained datasets. In addition, there is a pre-calculated cleanlab self conficence score for each sample. All of them can be used to sample examples which suit our use case best\n\nmms_dataset.column_names\n\n{'train': ['_id',\n 'text',\n 'label',\n 'original_dataset',\n 'domain',\n 'language',\n 'Family',\n 'Genus',\n 'Definite articles',\n 'Indefinite articles',\n 'Number of cases',\n 'Order of subject, object, verb',\n 'Negative morphemes',\n 'Polar questions',\n 'Position of negative word wrt SOV',\n 'Prefixing vs suffixing',\n 'Coding of nominal plurality',\n 'Grammatical genders',\n 'cleanlab_self_confidence']}\n\n\nSelect only samples in polish and coming from social media\n\npl_sm = mms_dataset[\"train\"].filter(lambda x: x[\"language\"] == \"pl\" and x[\"domain\"] == \"social_media\")\n\n\n\n\nTo achieve higher performance, we will select only samples with high self confidence score\n\npl_sm_high_confidence = pl_sm.filter(lambda x: x[\"cleanlab_self_confidence\"] > 0.6)\n\n\n\n\n\nlen(pl_sm_high_confidence)\n\n73227\n\n\nWe will use this examples to fine-tune Polish version of BERT model - HerBERT\n\ntokenizer = AutoTokenizer.from_pretrained(\"allegro/herbert-base-cased\")\n\ndef tokenize(batch):\n return tokenizer(batch[\"text\"], padding=\"max_length\", truncation=True)\n\n\ntokenized_dataset = pl_sm_high_confidence.map(tokenize, batched=True, batch_size=512)\n\n\n\n\n\nmodel = AutoModelForSequenceClassification.from_pretrained(\"allegro/herbert-base-cased\", num_labels=3)\n\nSome weights of the model checkpoint at allegro/herbert-base-cased were not used when initializing BertForSequenceClassification: ['cls.predictions.transform.dense.weight', 'cls.sso.sso_relationship.weight', 'cls.predictions.decoder.bias', 'cls.sso.sso_relationship.bias', 'cls.predictions.decoder.weight', 'cls.predictions.transform.LayerNorm.bias', 'cls.predictions.bias', 'cls.predictions.transform.LayerNorm.weight', 'cls.predictions.transform.dense.bias']\n- This IS expected if you are initializing BertForSequenceClassification from the checkpoint of a model trained on another task or with another architecture (e.g. initializing a BertForSequenceClassification model from a BertForPreTraining model).\n- This IS NOT expected if you are initializing BertForSequenceClassification from the checkpoint of a model that you expect to be exactly identical (initializing a BertForSequenceClassification model from a BertForSequenceClassification model).\nSome weights of BertForSequenceClassification were not initialized from the model checkpoint at allegro/herbert-base-cased and are newly initialized: ['classifier.weight', 'classifier.bias']\nYou should probably TRAIN this model on a down-stream task to be able to use it for predictions and inference.\n\n\n\nsplit_dataset = tokenized_dataset.train_test_split(test_size=0.1)\ntrain_dataset = split_dataset[\"train\"]\neval_dataset = split_dataset[\"test\"]\n\n\ntraining_args = TrainingArguments(\n output_dir=\"PL_SM_SENT\",\n evaluation_strategy=\"epoch\",\n num_train_epochs=1,\n)\nmetric = evaluate.load(\"accuracy\")\n\n\ndef compute_metrics(eval_pred):\n logits, labels = eval_pred\n predictions = np.argmax(logits, axis=-1)\n return metric.compute(predictions=predictions, references=labels)\n\n\ntrainer = Trainer(\n model=model,\n args=training_args,\n train_dataset=train_dataset,\n eval_dataset=eval_dataset,\n compute_metrics=compute_metrics,\n)\n\n\ntrainer.train()\n\n/opt/conda/lib/python3.10/site-packages/transformers/optimization.py:411: FutureWarning: This implementation of AdamW is deprecated and will be removed in a future version. Use the PyTorch implementation torch.optim.AdamW instead, or set `no_deprecation_warning=True` to disable this warning\n warnings.warn("
+ },
+ {
+ "objectID": "citations.html",
+ "href": "citations.html",
+ "title": "MMS Dataset Citations",
+ "section": "",
+ "text": "Domain: social_media\nLanguage: ar\nLanguage family: Afro-Asiatic\nGenus: Semitic\nDefinite articles: definite affix\nIndefinite articles: no article\nNumber of cases: 3\nOrder of subject, object, verb: SVO\nNegative morphemes: negative particle\nPolar questions: interrogative intonation only\nPosition of negative word wrt SOV: SNegVO\nPrefixing vs suffixing: weakly suffixing\nCoding of nominal plurality: mixed morphological plural\nGrammatical genders: masculine, feminine\n\n@InProceedings{dataset_ar_arsentdl,\n author = {Ramy Baly and\n Alaa Khaddaj and\n Hazem M. Hajj and\n Wassim El{-}Hajj and\n Khaled Bashir Shaban},\n title = {{ArSentD-LEV: A Multi-Topic Corpus for Target-based Sentiment Analysis in Arabic Levantine Tweets}},\n booktitle = {Proceedings of the Eleventh International Conference on Language Resources and Evaluation (LREC 2018)},\n year = {2018},\n month = {may},\n date = {7-12},\n location = {Miyazaki, Japan},\n editor = {Hend Al-Khalifa and King Saud University and KSA Walid Magdy and University of Edinburgh and UK Kareem Darwish and Qatar Computing Research Institute and Qatar Tamer Elsayed and Qatar University and Qatar},\n publisher = {European Language Resources Association (ELRA)},\n address = {Paris, France},\n isbn = {979-10-95546-25-2},\n language = {english}\n}\n\n\n\n\n\nDomain: social_media\nLanguage: ar\nLanguage family: Afro-Asiatic\nGenus: Semitic\nDefinite articles: definite affix\nIndefinite articles: no article\nNumber of cases: 3\nOrder of subject, object, verb: SVO\nNegative morphemes: negative particle\nPolar questions: interrogative intonation only\nPosition of negative word wrt SOV: SNegVO\nPrefixing vs suffixing: weakly suffixing\nCoding of nominal plurality: mixed morphological plural\nGrammatical genders: masculine, feminine\n\n@inproceedings{dataset_ar_astd,\n title = \"{ASTD}: {A}rabic Sentiment Tweets Dataset\",\n author = \"Nabil, Mahmoud and\n Aly, Mohamed and\n Atiya, Amir\",\n booktitle = \"Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing\",\n month = sep,\n year = \"2015\",\n address = \"Lisbon, Portugal\",\n publisher = \"Association for Computational Linguistics\",\n url = \"https://aclanthology.org/D15-1299\",\n doi = \"10.18653/v1/D15-1299\",\n pages = \"2515--2519\",\n}\n\n\n\n\n\nDomain: social_media\nLanguage: ar\nLanguage family: Afro-Asiatic\nGenus: Semitic\nDefinite articles: definite affix\nIndefinite articles: no article\nNumber of cases: 3\nOrder of subject, object, verb: SVO\nNegative morphemes: negative particle\nPolar questions: interrogative intonation only\nPosition of negative word wrt SOV: SNegVO\nPrefixing vs suffixing: weakly suffixing\nCoding of nominal plurality: mixed morphological plural\nGrammatical genders: masculine, feminine\n\n@inproceedings{dataset_ar_bbn,\n title = \"Sentiment after Translation: A Case-Study on {A}rabic Social Media Posts\",\n author = \"Salameh, Mohammad and\n Mohammad, Saif and\n Kiritchenko, Svetlana\",\n booktitle = \"Proceedings of the 2015 Conference of the North {A}merican Chapter of the Association for Computational Linguistics: Human Language Technologies\",\n month = may # \"{--}\" # jun,\n year = \"2015\",\n address = \"Denver, Colorado\",\n publisher = \"Association for Computational Linguistics\",\n url = \"https://aclanthology.org/N15-1078\",\n doi = \"10.3115/v1/N15-1078\",\n pages = \"767--777\",\n}\n\n\n\n\n\nDomain: reviews\nLanguage: ar\nLanguage family: Afro-Asiatic\nGenus: Semitic\nDefinite articles: definite affix\nIndefinite articles: no article\nNumber of cases: 3\nOrder of subject, object, verb: SVO\nNegative morphemes: negative particle\nPolar questions: interrogative intonation only\nPosition of negative word wrt SOV: SNegVO\nPrefixing vs suffixing: weakly suffixing\nCoding of nominal plurality: mixed morphological plural\nGrammatical genders: masculine, feminine\n\n@INPROCEEDINGS{dataset_ar_brad,\n author={Elnagar, Ashraf and Einea, Omar},\n booktitle={2016 IEEE/ACS 13th International Conference of Computer Systems and Applications (AICCSA)}, \n title={{BRAD} 1.0: Book reviews in Arabic dataset}, \n year={2016},\n volume={},\n number={},\n pages={1-8},\n doi={10.1109/AICCSA.2016.7945800}\n}\n\n\n\n\n\nDomain: reviews\nLanguage: ar\nLanguage family: Afro-Asiatic\nGenus: Semitic\nDefinite articles: definite affix\nIndefinite articles: no article\nNumber of cases: 3\nOrder of subject, object, verb: SVO\nNegative morphemes: negative particle\nPolar questions: interrogative intonation only\nPosition of negative word wrt SOV: SNegVO\nPrefixing vs suffixing: weakly suffixing\nCoding of nominal plurality: mixed morphological plural\nGrammatical genders: masculine, feminine\n\n@Book{dataset_ar_hard,\n author=\"Elnagar, Ashraf\n and Khalifa, Yasmin S.\n and Einea, Anas\",\n title={Hotel Arabic-Reviews Dataset Construction for Sentiment Analysis Applications},\n bookTitle=\"Intelligent Natural Language Processing: Trends and Applications\",\n year=\"2018\",\n publisher=\"Springer International Publishing\",\n address=\"Cham\",\n pages=\"35--52\",\n isbn=\"978-3-319-67056-0\",\n doi=\"10.1007/978-3-319-67056-0_3\",\n url=\"https://doi.org/10.1007/978-3-319-67056-0_3\"\n}\n\n\n\n\n\nDomain: reviews\nLanguage: ar\nLanguage family: Afro-Asiatic\nGenus: Semitic\nDefinite articles: definite affix\nIndefinite articles: no article\nNumber of cases: 3\nOrder of subject, object, verb: SVO\nNegative morphemes: negative particle\nPolar questions: interrogative intonation only\nPosition of negative word wrt SOV: SNegVO\nPrefixing vs suffixing: weakly suffixing\nCoding of nominal plurality: mixed morphological plural\nGrammatical genders: masculine, feminine\n\n@inproceedings{dataset_ar_labr,\n title = \"{LABR}: A Large Scale {A}rabic Book Reviews Dataset\",\n author = \"Aly, Mohamed and\n Atiya, Amir\",\n booktitle = \"Proceedings of the 51st Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers)\",\n month = aug,\n year = \"2013\",\n address = \"Sofia, Bulgaria\",\n publisher = \"Association for Computational Linguistics\",\n url = \"https://aclanthology.org/P13-2088\",\n pages = \"494--498\",\n}\n\n\n\n\n\nDomain: reviews\nLanguage: ar\nLanguage family: Afro-Asiatic\nGenus: Semitic\nDefinite articles: definite affix\nIndefinite articles: no article\nNumber of cases: 3\nOrder of subject, object, verb: SVO\nNegative morphemes: negative particle\nPolar questions: interrogative intonation only\nPosition of negative word wrt SOV: SNegVO\nPrefixing vs suffixing: weakly suffixing\nCoding of nominal plurality: mixed morphological plural\nGrammatical genders: masculine, feminine\n\n@inproceedings{dataset_ar_oclar,\n author={Al Omari, Marwan and Al-Hajj, Moustafa and Hammami, Nacereddine and Sabra, Amani},\n booktitle={2019 International Conference on Computer and Information Sciences (ICCIS)}, \n title={Sentiment Classifier: Logistic Regression for Arabic Services’ Reviews in Lebanon}, \n year={2019},\n volume={},\n number={},\n pages={1-5},\n doi={10.1109/ICCISci.2019.8716394}\n}\n\n\n\n\n\nDomain: mixed\nLanguage: ar\nLanguage family: Afro-Asiatic\nGenus: Semitic\nDefinite articles: definite affix\nIndefinite articles: no article\nNumber of cases: 3\nOrder of subject, object, verb: SVO\nNegative morphemes: negative particle\nPolar questions: interrogative intonation only\nPosition of negative word wrt SOV: SNegVO\nPrefixing vs suffixing: weakly suffixing\nCoding of nominal plurality: mixed morphological plural\nGrammatical genders: masculine, feminine\n\n@inproceedings{dataset_semeval_2017,\n title = \"{S}em{E}val-2017 Task 4: Sentiment Analysis in {T}witter\",\n author = \"Rosenthal, Sara and\n Farra, Noura and\n Nakov, Preslav\",\n booktitle = \"Proceedings of the 11th International Workshop on Semantic Evaluation ({S}em{E}val-2017)\",\n month = aug,\n year = \"2017\",\n address = \"Vancouver, Canada\",\n publisher = \"Association for Computational Linguistics\",\n url = \"https://aclanthology.org/S17-2088\",\n doi = \"10.18653/v1/S17-2088\",\n pages = \"502--518\",\n abstract = \"This paper describes the fifth year of the Sentiment Analysis in Twitter task. SemEval-2017 Task 4 continues with a rerun of the subtasks of SemEval-2016 Task 4, which include identifying the overall sentiment of the tweet, sentiment towards a topic with classification on a two-point and on a five-point ordinal scale, and quantification of the distribution of sentiment towards a topic across a number of tweets: again on a two-point and on a five-point ordinal scale. Compared to 2016, we made two changes: (i) we introduced a new language, Arabic, for all subtasks, and (ii) we made available information from the profiles of the Twitter users who posted the target tweets. The task continues to be very popular, with a total of 48 teams participating this year.\",\n}\n\n\n\n\n\nDomain: social_media\nLanguage: ar\nLanguage family: Afro-Asiatic\nGenus: Semitic\nDefinite articles: definite affix\nIndefinite articles: no article\nNumber of cases: 3\nOrder of subject, object, verb: SVO\nNegative morphemes: negative particle\nPolar questions: interrogative intonation only\nPosition of negative word wrt SOV: SNegVO\nPrefixing vs suffixing: weakly suffixing\nCoding of nominal plurality: mixed morphological plural\nGrammatical genders: masculine, feminine\n\n@inproceedings{dataset_ar_bbn,\n title = \"Sentiment after Translation: A Case-Study on {A}rabic Social Media Posts\",\n author = \"Salameh, Mohammad and\n Mohammad, Saif and\n Kiritchenko, Svetlana\",\n booktitle = \"Proceedings of the 2015 Conference of the North {A}merican Chapter of the Association for Computational Linguistics: Human Language Technologies\",\n month = may # \"{--}\" # jun,\n year = \"2015\",\n address = \"Denver, Colorado\",\n publisher = \"Association for Computational Linguistics\",\n url = \"https://aclanthology.org/N15-1078\",\n doi = \"10.3115/v1/N15-1078\",\n pages = \"767--777\",\n}\n\n\n\n\n\nDomain: social_media\nLanguage: bg\nLanguage family: Indo-European\nGenus: Slavic\nDefinite articles: definite word distinct from demonstrative\nIndefinite articles: no article\nNumber of cases: no morphological case-making\nOrder of subject, object, verb: SVO\nNegative morphemes: negative particle\nPolar questions: question particle\nPosition of negative word wrt SOV: SNegVO\nPrefixing vs suffixing: strongly suffixing\nCoding of nominal plurality: plural suffix\nGrammatical genders: masculine, feminine, neuter\n\n@article{dataset_twitter_sentiment,\n doi = {10.1371/journal.pone.0155036},\n author = {Mozetič, Igor AND Grčar, Miha AND Smailović, Jasmina},\n journal = {PLOS ONE},\n publisher = {Public Library of Science},\n title = {Multilingual Twitter Sentiment Classification: The Role of Human Annotators},\n year = {2016},\n month = {05},\n volume = {11},\n url = {https://doi.org/10.1371/journal.pone.0155036},\n pages = {1-26},\n number = {5},\n}\n\n\n\n\n\nDomain: social_media\nLanguage: bs\nLanguage family: Indo-European\nGenus: Slavic\nDefinite articles: no article\nIndefinite articles: no article\nNumber of cases: 5\nOrder of subject, object, verb: SVO\nNegative morphemes: negative particle\nPolar questions: question particle\nPosition of negative word wrt SOV: other\nPrefixing vs suffixing: strongly suffixing\nCoding of nominal plurality: plural suffix\nGrammatical genders: masculine, feminine, neuter\n\n@article{dataset_twitter_sentiment,\n doi = {10.1371/journal.pone.0155036},\n author = {Mozetič, Igor AND Grčar, Miha AND Smailović, Jasmina},\n journal = {PLOS ONE},\n publisher = {Public Library of Science},\n title = {Multilingual Twitter Sentiment Classification: The Role of Human Annotators},\n year = {2016},\n month = {05},\n volume = {11},\n url = {https://doi.org/10.1371/journal.pone.0155036},\n pages = {1-26},\n number = {5},\n}\n\n\n\n\n\nDomain: social_media\nLanguage: cs\nLanguage family: Indo-European\nGenus: Slavic\nDefinite articles: no article\nIndefinite articles: no article\nNumber of cases: 6-7\nOrder of subject, object, verb: SVO\nNegative morphemes: negative affix\nPolar questions: interrogative word order\nPosition of negative word wrt SOV: MorphNeg\nPrefixing vs suffixing: weakly suffixing\nCoding of nominal plurality: plural suffix\nGrammatical genders: masculine, feminine, neuter\n\n@inproceedings{dataset_cs_social_media,\n title = \"Sentiment Analysis in {C}zech Social Media Using Supervised Machine Learning\",\n author = \"Habernal, Ivan and\n Pt{\\'a}{\\v{c}}ek, Tom{\\'a}{\\v{s}} and\n Steinberger, Josef\",\n booktitle = \"Proceedings of the 4th Workshop on Computational Approaches to Subjectivity, Sentiment and Social Media Analysis\",\n month = jun,\n year = \"2013\",\n address = \"Atlanta, Georgia\",\n publisher = \"Association for Computational Linguistics\",\n url = \"https://aclanthology.org/W13-1609\",\n pages = \"65--74\",\n}\n\n\n\n\n\nDomain: reviews\nLanguage: cs\nLanguage family: Indo-European\nGenus: Slavic\nDefinite articles: no article\nIndefinite articles: no article\nNumber of cases: 6-7\nOrder of subject, object, verb: SVO\nNegative morphemes: negative affix\nPolar questions: interrogative word order\nPosition of negative word wrt SOV: MorphNeg\nPrefixing vs suffixing: weakly suffixing\nCoding of nominal plurality: plural suffix\nGrammatical genders: masculine, feminine, neuter\n\n@inproceedings{dataset_cs_social_media,\n title = \"Sentiment Analysis in {C}zech Social Media Using Supervised Machine Learning\",\n author = \"Habernal, Ivan and\n Pt{\\'a}{\\v{c}}ek, Tom{\\'a}{\\v{s}} and\n Steinberger, Josef\",\n booktitle = \"Proceedings of the 4th Workshop on Computational Approaches to Subjectivity, Sentiment and Social Media Analysis\",\n month = jun,\n year = \"2013\",\n address = \"Atlanta, Georgia\",\n publisher = \"Association for Computational Linguistics\",\n url = \"https://aclanthology.org/W13-1609\",\n pages = \"65--74\",\n}\n\n\n\n\n\nDomain: reviews\nLanguage: cs\nLanguage family: Indo-European\nGenus: Slavic\nDefinite articles: no article\nIndefinite articles: no article\nNumber of cases: 6-7\nOrder of subject, object, verb: SVO\nNegative morphemes: negative affix\nPolar questions: interrogative word order\nPosition of negative word wrt SOV: MorphNeg\nPrefixing vs suffixing: weakly suffixing\nCoding of nominal plurality: plural suffix\nGrammatical genders: masculine, feminine, neuter\n\n@inproceedings{dataset_cs_social_media,\n title = \"Sentiment Analysis in {C}zech Social Media Using Supervised Machine Learning\",\n author = \"Habernal, Ivan and\n Pt{\\'a}{\\v{c}}ek, Tom{\\'a}{\\v{s}} and\n Steinberger, Josef\",\n booktitle = \"Proceedings of the 4th Workshop on Computational Approaches to Subjectivity, Sentiment and Social Media Analysis\",\n month = jun,\n year = \"2013\",\n address = \"Atlanta, Georgia\",\n publisher = \"Association for Computational Linguistics\",\n url = \"https://aclanthology.org/W13-1609\",\n pages = \"65--74\",\n}\n\n\n\n\n\nDomain: social_media\nLanguage: cs\nLanguage family: Indo-European\nGenus: Slavic\nDefinite articles: no article\nIndefinite articles: no article\nNumber of cases: 6-7\nOrder of subject, object, verb: SVO\nNegative morphemes: negative affix\nPolar questions: interrogative word order\nPosition of negative word wrt SOV: MorphNeg\nPrefixing vs suffixing: weakly suffixing\nCoding of nominal plurality: plural suffix\nGrammatical genders: masculine, feminine, neuter\n\n@inproceedings{dataset_cs_social_media,\n title = \"Sentiment Analysis in {C}zech Social Media Using Supervised Machine Learning\",\n author = \"Habernal, Ivan and\n Pt{\\'a}{\\v{c}}ek, Tom{\\'a}{\\v{s}} and\n Steinberger, Josef\",\n booktitle = \"Proceedings of the 4th Workshop on Computational Approaches to Subjectivity, Sentiment and Social Media Analysis\",\n month = jun,\n year = \"2013\",\n address = \"Atlanta, Georgia\",\n publisher = \"Association for Computational Linguistics\",\n url = \"https://aclanthology.org/W13-1609\",\n pages = \"65--74\",\n}\n\n\n\n\n\nDomain: social_media\nLanguage: de\nLanguage family: Indo-European\nGenus: Germanic\nDefinite articles: definite word distinct from demonstrative\nIndefinite articles: indefinite word same as one\nNumber of cases: 4\nOrder of subject, object, verb: no dominant order\nNegative morphemes: negative particle\nPolar questions: interrogative word order\nPosition of negative word wrt SOV: more than one position\nPrefixing vs suffixing: strongly suffixing\nCoding of nominal plurality: plural suffix\nGrammatical genders: masculine, feminine, neuter\n\n@inproceedings{dataset_dai_labor,\n author = {Narr, Sascha and Michael Hülfenhaus and Albayrak, Sahin},\n title = {Language-Independent Twitter Sentiment Analysis},\n booktitle = {Workshop on Knowledge Discovery, Data Mining and Machine Learning (KDML-2012)},\n year = {2012},\n location = {Dortmund, Germany},\n}\n\n\n\n\n\nDomain: social_media\nLanguage: de\nLanguage family: Indo-European\nGenus: Germanic\nDefinite articles: definite word distinct from demonstrative\nIndefinite articles: indefinite word same as one\nNumber of cases: 4\nOrder of subject, object, verb: no dominant order\nNegative morphemes: negative particle\nPolar questions: interrogative word order\nPosition of negative word wrt SOV: more than one position\nPrefixing vs suffixing: strongly suffixing\nCoding of nominal plurality: plural suffix\nGrammatical genders: masculine, feminine, neuter\n\n@inproceedings{dataset_dai_labor,\n author = {Narr, Sascha and Michael Hülfenhaus and Albayrak, Sahin},\n title = {Language-Independent Twitter Sentiment Analysis},\n booktitle = {Workshop on Knowledge Discovery, Data Mining and Machine Learning (KDML-2012)},\n year = {2012},\n location = {Dortmund, Germany},\n}\n\n\n\n\n\nDomain: reviews\nLanguage: de\nLanguage family: Indo-European\nGenus: Germanic\nDefinite articles: definite word distinct from demonstrative\nIndefinite articles: indefinite word same as one\nNumber of cases: 4\nOrder of subject, object, verb: no dominant order\nNegative morphemes: negative particle\nPolar questions: interrogative word order\nPosition of negative word wrt SOV: more than one position\nPrefixing vs suffixing: strongly suffixing\nCoding of nominal plurality: plural suffix\nGrammatical genders: masculine, feminine, neuter\n\n@inproceedings{dataset_multilan_amazon,\n title = \"The Multilingual {A}mazon Reviews Corpus\",\n author = {Keung, Phillip and\n Lu, Yichao and\n Szarvas, Gy{\\\"o}rgy and\n Smith, Noah A.},\n booktitle = \"Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP)\",\n month = nov,\n year = \"2020\",\n address = \"Online\",\n publisher = \"Association for Computational Linguistics\",\n url = \"https://aclanthology.org/2020.emnlp-main.369\",\n doi = \"10.18653/v1/2020.emnlp-main.369\",\n pages = \"4563--4568\",\n}\n\n\n\n\n\nDomain: social_media\nLanguage: de\nLanguage family: Indo-European\nGenus: Germanic\nDefinite articles: definite word distinct from demonstrative\nIndefinite articles: indefinite word same as one\nNumber of cases: 4\nOrder of subject, object, verb: no dominant order\nNegative morphemes: negative particle\nPolar questions: interrogative word order\nPosition of negative word wrt SOV: more than one position\nPrefixing vs suffixing: strongly suffixing\nCoding of nominal plurality: plural suffix\nGrammatical genders: masculine, feminine, neuter\n\n@inproceedings{dataset_de_omp,\n title = \"Academic-Industrial Perspective on the Development and Deployment of a Moderation System for a Newspaper Website\",\n author = \"Schabus, Dietmar and\n Skowron, Marcin\",\n booktitle = \"Proceedings of the Eleventh International Conference on Language Resources and Evaluation ({LREC} 2018)\",\n month = may,\n year = \"2018\",\n address = \"Miyazaki, Japan\",\n publisher = \"European Language Resources Association (ELRA)\",\n url = \"https://aclanthology.org/L18-1253\",\n}\n\n\n\n\n\nDomain: social_media\nLanguage: de\nLanguage family: Indo-European\nGenus: Germanic\nDefinite articles: definite word distinct from demonstrative\nIndefinite articles: indefinite word same as one\nNumber of cases: 4\nOrder of subject, object, verb: no dominant order\nNegative morphemes: negative particle\nPolar questions: interrogative word order\nPosition of negative word wrt SOV: more than one position\nPrefixing vs suffixing: strongly suffixing\nCoding of nominal plurality: plural suffix\nGrammatical genders: masculine, feminine, neuter\n\n@inproceedings{dataset_de_sb10k,\n title = \"A {T}witter Corpus and Benchmark Resources for {G}erman Sentiment Analysis\",\n author = \"Cieliebak, Mark and\n Deriu, Jan Milan and\n Egger, Dominic and\n Uzdilli, Fatih\",\n booktitle = \"Proceedings of the Fifth International Workshop on Natural Language Processing for Social Media\",\n month = apr,\n year = \"2017\",\n address = \"Valencia, Spain\",\n publisher = \"Association for Computational Linguistics\",\n url = \"https://aclanthology.org/W17-1106\",\n doi = \"10.18653/v1/W17-1106\",\n pages = \"45--51\",\n abstract = \"In this paper we present SB10k, a new corpus for sentiment analysis with approx. 10,000 German tweets. We use this new corpus and two existing corpora to provide state-of-the-art benchmarks for sentiment analysis in German: we implemented a CNN (based on the winning system of SemEval-2016) and a feature-based SVM and compare their performance on all three corpora. For the CNN, we also created German word embeddings trained on 300M tweets. These word embeddings were then optimized for sentiment analysis using distant-supervised learning. The new corpus, the German word embeddings (plain and optimized), and source code to re-run the benchmarks are publicly available.\",\n}\n\n\n\n\n\nDomain: social_media\nLanguage: de\nLanguage family: Indo-European\nGenus: Germanic\nDefinite articles: definite word distinct from demonstrative\nIndefinite articles: indefinite word same as one\nNumber of cases: 4\nOrder of subject, object, verb: no dominant order\nNegative morphemes: negative particle\nPolar questions: interrogative word order\nPosition of negative word wrt SOV: more than one position\nPrefixing vs suffixing: strongly suffixing\nCoding of nominal plurality: plural suffix\nGrammatical genders: masculine, feminine, neuter\n\n@article{dataset_twitter_sentiment,\n doi = {10.1371/journal.pone.0155036},\n author = {Mozetič, Igor AND Grčar, Miha AND Smailović, Jasmina},\n journal = {PLOS ONE},\n publisher = {Public Library of Science},\n title = {Multilingual Twitter Sentiment Classification: The Role of Human Annotators},\n year = {2016},\n month = {05},\n volume = {11},\n url = {https://doi.org/10.1371/journal.pone.0155036},\n pages = {1-26},\n number = {5},\n}\n\n\n\n\n\nDomain: reviews\nLanguage: en\nLanguage family: Indo-European\nGenus: Germanic\nDefinite articles: definite word distinct from demonstrative\nIndefinite articles: indefinite word distinct from one\nNumber of cases: 2\nOrder of subject, object, verb: SVO\nNegative morphemes: negative particle\nPolar questions: interrogative word order\nPosition of negative word wrt SOV: SNegVO\nPrefixing vs suffixing: strongly suffixing\nCoding of nominal plurality: plural suffix\nGrammatical genders: no grammatical gender\n\n@inproceedings{dataset_en_amazon,\n title = \"Justifying Recommendations using Distantly-Labeled Reviews and Fine-Grained Aspects\",\n author = \"Ni, Jianmo and\n Li, Jiacheng and\n McAuley, Julian\",\n booktitle = \"Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP)\",\n month = nov,\n year = \"2019\",\n address = \"Hong Kong, China\",\n publisher = \"Association for Computational Linguistics\",\n url = \"https://aclanthology.org/D19-1018\",\n doi = \"10.18653/v1/D19-1018\",\n pages = \"188--197\",\n}\n\n\n\n\n\nDomain: social_media\nLanguage: en\nLanguage family: Indo-European\nGenus: Germanic\nDefinite articles: definite word distinct from demonstrative\nIndefinite articles: indefinite word distinct from one\nNumber of cases: 2\nOrder of subject, object, verb: SVO\nNegative morphemes: negative particle\nPolar questions: interrogative word order\nPosition of negative word wrt SOV: SNegVO\nPrefixing vs suffixing: strongly suffixing\nCoding of nominal plurality: plural suffix\nGrammatical genders: no grammatical gender\n\n@inproceedings{dataset_dai_labor,\n author = {Narr, Sascha and Michael Hülfenhaus and Albayrak, Sahin},\n title = {Language-Independent Twitter Sentiment Analysis},\n booktitle = {Workshop on Knowledge Discovery, Data Mining and Machine Learning (KDML-2012)},\n year = {2012},\n location = {Dortmund, Germany},\n}\n\n\n\n\n\nDomain: news\nLanguage: en\nLanguage family: Indo-European\nGenus: Germanic\nDefinite articles: definite word distinct from demonstrative\nIndefinite articles: indefinite word distinct from one\nNumber of cases: 2\nOrder of subject, object, verb: SVO\nNegative morphemes: negative particle\nPolar questions: interrogative word order\nPosition of negative word wrt SOV: SNegVO\nPrefixing vs suffixing: strongly suffixing\nCoding of nominal plurality: plural suffix\nGrammatical genders: no grammatical gender\n\n@article{dataset_en_financial_phrasebank_sentences_75agree,\n author = {Malo, Pekka and Sinha, Ankur and Korhonen, Pekka and Wallenius, Jyrki and Takala, Pyry},\n title = {Good Debt or Bad Debt: Detecting Semantic Orientations in Economic Texts},\n year = {2014},\n issue_date = {April 2014},\n publisher = {John Wiley & Sons, Inc.},\n address = {USA},\n volume = {65},\n number = {4},\n issn = {2330-1635},\n url = {https://doi.org/10.1002/asi.23062},\n doi = {10.1002/asi.23062},\n journal = {Journal of the Association for Information Science and Technology},\n month = {apr},\n pages = {782–796},\n numpages = {15},\n keywords = {economics, automatic classification, linguistic analysis}\n}\n\n\n\n\n\nDomain: reviews\nLanguage: en\nLanguage family: Indo-European\nGenus: Germanic\nDefinite articles: definite word distinct from demonstrative\nIndefinite articles: indefinite word distinct from one\nNumber of cases: 2\nOrder of subject, object, verb: SVO\nNegative morphemes: negative particle\nPolar questions: interrogative word order\nPosition of negative word wrt SOV: SNegVO\nPrefixing vs suffixing: strongly suffixing\nCoding of nominal plurality: plural suffix\nGrammatical genders: no grammatical gender\n\n@inproceedings{dataset_multilan_amazon,\n title = \"The Multilingual {A}mazon Reviews Corpus\",\n author = {Keung, Phillip and\n Lu, Yichao and\n Szarvas, Gy{\\\"o}rgy and\n Smith, Noah A.},\n booktitle = \"Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP)\",\n month = nov,\n year = \"2020\",\n address = \"Online\",\n publisher = \"Association for Computational Linguistics\",\n url = \"https://aclanthology.org/2020.emnlp-main.369\",\n doi = \"10.18653/v1/2020.emnlp-main.369\",\n pages = \"4563--4568\",\n}\n\n\n\n\n\nDomain: news\nLanguage: en\nLanguage family: Indo-European\nGenus: Germanic\nDefinite articles: definite word distinct from demonstrative\nIndefinite articles: indefinite word distinct from one\nNumber of cases: 2\nOrder of subject, object, verb: SVO\nNegative morphemes: negative particle\nPolar questions: interrogative word order\nPosition of negative word wrt SOV: SNegVO\nPrefixing vs suffixing: strongly suffixing\nCoding of nominal plurality: plural suffix\nGrammatical genders: no grammatical gender\n\n@inproceedings{dataset_en_per_sent,\n title = \"Author{'}s Sentiment Prediction\",\n author = \"Bastan, Mohaddeseh and\n Koupaee, Mahnaz and\n Son, Youngseo and\n Sicoli, Richard and\n Balasubramanian, Niranjan\",\n booktitle = \"Proceedings of the 28th International Conference on Computational Linguistics\",\n month = dec,\n year = \"2020\",\n address = \"Barcelona, Spain (Online)\",\n publisher = \"International Committee on Computational Linguistics\",\n url = \"https://aclanthology.org/2020.coling-main.52\",\n doi = \"10.18653/v1/2020.coling-main.52\",\n pages = \"604--615\",\n}\n\n\n\n\n\nDomain: poems\nLanguage: en\nLanguage family: Indo-European\nGenus: Germanic\nDefinite articles: definite word distinct from demonstrative\nIndefinite articles: indefinite word distinct from one\nNumber of cases: 2\nOrder of subject, object, verb: SVO\nNegative morphemes: negative particle\nPolar questions: interrogative word order\nPosition of negative word wrt SOV: SNegVO\nPrefixing vs suffixing: strongly suffixing\nCoding of nominal plurality: plural suffix\nGrammatical genders: no grammatical gender\n\n@inproceedings{dataset_en_poem_sentiment,\n title = \"Investigating Societal Biases in a Poetry Composition System\",\n author = \"Sheng, Emily and\n Uthus, David\",\n booktitle = \"Proceedings of the Second Workshop on Gender Bias in Natural Language Processing\",\n month = dec,\n year = \"2020\",\n address = \"Barcelona, Spain (Online)\",\n publisher = \"Association for Computational Linguistics\",\n url = \"https://aclanthology.org/2020.gebnlp-1.9\",\n pages = \"93--106\",\n}\n\n\n\n\n\nDomain: mixed\nLanguage: en\nLanguage family: Indo-European\nGenus: Germanic\nDefinite articles: definite word distinct from demonstrative\nIndefinite articles: indefinite word distinct from one\nNumber of cases: 2\nOrder of subject, object, verb: SVO\nNegative morphemes: negative particle\nPolar questions: interrogative word order\nPosition of negative word wrt SOV: SNegVO\nPrefixing vs suffixing: strongly suffixing\nCoding of nominal plurality: plural suffix\nGrammatical genders: no grammatical gender\n\n@inproceedings{dataset_semeval_2017,\n title = \"{S}em{E}val-2017 Task 4: Sentiment Analysis in {T}witter\",\n author = \"Rosenthal, Sara and\n Farra, Noura and\n Nakov, Preslav\",\n booktitle = \"Proceedings of the 11th International Workshop on Semantic Evaluation ({S}em{E}val-2017)\",\n month = aug,\n year = \"2017\",\n address = \"Vancouver, Canada\",\n publisher = \"Association for Computational Linguistics\",\n url = \"https://aclanthology.org/S17-2088\",\n doi = \"10.18653/v1/S17-2088\",\n pages = \"502--518\",\n abstract = \"This paper describes the fifth year of the Sentiment Analysis in Twitter task. SemEval-2017 Task 4 continues with a rerun of the subtasks of SemEval-2016 Task 4, which include identifying the overall sentiment of the tweet, sentiment towards a topic with classification on a two-point and on a five-point ordinal scale, and quantification of the distribution of sentiment towards a topic across a number of tweets: again on a two-point and on a five-point ordinal scale. Compared to 2016, we made two changes: (i) we introduced a new language, Arabic, for all subtasks, and (ii) we made available information from the profiles of the Twitter users who posted the target tweets. The task continues to be very popular, with a total of 48 teams participating this year.\",\n}\n\n\n\n\n\nDomain: social_media\nLanguage: en\nLanguage family: Indo-European\nGenus: Germanic\nDefinite articles: definite word distinct from demonstrative\nIndefinite articles: indefinite word distinct from one\nNumber of cases: 2\nOrder of subject, object, verb: SVO\nNegative morphemes: negative particle\nPolar questions: interrogative word order\nPosition of negative word wrt SOV: SNegVO\nPrefixing vs suffixing: strongly suffixing\nCoding of nominal plurality: plural suffix\nGrammatical genders: no grammatical gender\n\n@article{dataset_en_sentistrength,\n author = {Thelwall, Mike and Buckley, Kevan and Paltoglou, Georgios},\n title = {Sentiment Strength Detection for the Social Web},\n year = {2012},\n issue_date = {January 2012},\n publisher = {John Wiley \\& Sons, Inc.},\n address = {USA},\n volume = {63},\n number = {1},\n issn = {1532-2882},\n url = {https://doi.org/10.1002/asi.21662},\n doi = {10.1002/asi.21662},\n abstract = {Sentiment analysis is concerned with the automatic extraction of sentiment-related\n information from text. Although most sentiment analysis addresses commercial tass,\n such as extracting opinions from product reviews, there is increasing interest in\n the affective dimension of the social web, and Twitter in particular. Most sentiment\n analysis algorithms are not ideally suited to this task because they exploit indirect\n indicators of sentiment that can reflect genre or topic instead. Hence, such algorithms\n used to process social web texts can identify spurious sentiment patterns caused by\n topics rather than affective phenomena. This article assesses an improved version\n of the algorithm SentiStrength for sentiment strength detection across the social\n web that primarily uses direct indications of sentiment. The results from six diverse\n social web data sets (MySpace, Twitter, YouTube, Digg, RunnersWorld, BBCForums) indicate\n that SentiStrength 2 is successful in the sense of performing better than a baseline\n approach for all data sets in both supervised and unsupervised cases. SentiStrength\n is not always better than machine-learning approaches that exploit indirect indicators\n of sentiment, however, and is particularly weaker for positive sentiment in news-related\n discussions. Overall, the results suggest that, even unsupervised, SentiStrength is\n robust enough to be applied to a wide variety of different social web contexts.},\n journal = {J. Am. Soc. Inf. Sci. Technol.},\n month = jan,\n pages = {163–173},\n numpages = {11}\n}\n\n\n\n\n\nDomain: chats\nLanguage: en\nLanguage family: Indo-European\nGenus: Germanic\nDefinite articles: definite word distinct from demonstrative\nIndefinite articles: indefinite word distinct from one\nNumber of cases: 2\nOrder of subject, object, verb: SVO\nNegative morphemes: negative particle\nPolar questions: interrogative word order\nPosition of negative word wrt SOV: SNegVO\nPrefixing vs suffixing: strongly suffixing\nCoding of nominal plurality: plural suffix\nGrammatical genders: no grammatical gender\n\n@inproceedings{dataset_en_silicone,\n title = \"Hierarchical Pre-training for Sequence Labelling in Spoken Dialog\",\n author = \"Chapuis, Emile and\n Colombo, Pierre and\n Manica, Matteo and\n Labeau, Matthieu and\n Clavel, Chlo{\\'e}\",\n booktitle = \"Findings of the Association for Computational Linguistics: EMNLP 2020\",\n month = nov,\n year = \"2020\",\n address = \"Online\",\n publisher = \"Association for Computational Linguistics\",\n url = \"https://aclanthology.org/2020.findings-emnlp.239\",\n doi = \"10.18653/v1/2020.findings-emnlp.239\",\n pages = \"2636--2648\",\n}\n\n\n\n\n\nDomain: chats\nLanguage: en\nLanguage family: Indo-European\nGenus: Germanic\nDefinite articles: definite word distinct from demonstrative\nIndefinite articles: indefinite word distinct from one\nNumber of cases: 2\nOrder of subject, object, verb: SVO\nNegative morphemes: negative particle\nPolar questions: interrogative word order\nPosition of negative word wrt SOV: SNegVO\nPrefixing vs suffixing: strongly suffixing\nCoding of nominal plurality: plural suffix\nGrammatical genders: no grammatical gender\n\n@inproceedings{dataset_en_silicone,\n title = \"Hierarchical Pre-training for Sequence Labelling in Spoken Dialog\",\n author = \"Chapuis, Emile and\n Colombo, Pierre and\n Manica, Matteo and\n Labeau, Matthieu and\n Clavel, Chlo{\\'e}\",\n booktitle = \"Findings of the Association for Computational Linguistics: EMNLP 2020\",\n month = nov,\n year = \"2020\",\n address = \"Online\",\n publisher = \"Association for Computational Linguistics\",\n url = \"https://aclanthology.org/2020.findings-emnlp.239\",\n doi = \"10.18653/v1/2020.findings-emnlp.239\",\n pages = \"2636--2648\",\n}\n\n\n\n\n\nDomain: social_media\nLanguage: en\nLanguage family: Indo-European\nGenus: Germanic\nDefinite articles: definite word distinct from demonstrative\nIndefinite articles: indefinite word distinct from one\nNumber of cases: 2\nOrder of subject, object, verb: SVO\nNegative morphemes: negative particle\nPolar questions: interrogative word order\nPosition of negative word wrt SOV: SNegVO\nPrefixing vs suffixing: strongly suffixing\nCoding of nominal plurality: plural suffix\nGrammatical genders: no grammatical gender\n\n@misc{dataset_en_tweet_airlines,\n url={https://www.kaggle.com/crowdflower/twitter-airline-sentiment},\n author={Crowdflower Inc.},\n title={Twitter US Airline Sentiment},\n year={2015}\n}\n\n\n\n\n\nDomain: social_media\nLanguage: en\nLanguage family: Indo-European\nGenus: Germanic\nDefinite articles: definite word distinct from demonstrative\nIndefinite articles: indefinite word distinct from one\nNumber of cases: 2\nOrder of subject, object, verb: SVO\nNegative morphemes: negative particle\nPolar questions: interrogative word order\nPosition of negative word wrt SOV: SNegVO\nPrefixing vs suffixing: strongly suffixing\nCoding of nominal plurality: plural suffix\nGrammatical genders: no grammatical gender\n\n@article{dataset_en_tweets_sanders,\n title={{Sanders-Twitter Sentiment Corpus}},\n author={Sanders, Niek J},\n journal={Sanders Analytics LLC},\n year={2011}\n}\n\n\n\n\n\nDomain: social_media\nLanguage: en\nLanguage family: Indo-European\nGenus: Germanic\nDefinite articles: definite word distinct from demonstrative\nIndefinite articles: indefinite word distinct from one\nNumber of cases: 2\nOrder of subject, object, verb: SVO\nNegative morphemes: negative particle\nPolar questions: interrogative word order\nPosition of negative word wrt SOV: SNegVO\nPrefixing vs suffixing: strongly suffixing\nCoding of nominal plurality: plural suffix\nGrammatical genders: no grammatical gender\n\n@article{dataset_twitter_sentiment,\n doi = {10.1371/journal.pone.0155036},\n author = {Mozetič, Igor AND Grčar, Miha AND Smailović, Jasmina},\n journal = {PLOS ONE},\n publisher = {Public Library of Science},\n title = {Multilingual Twitter Sentiment Classification: The Role of Human Annotators},\n year = {2016},\n month = {05},\n volume = {11},\n url = {https://doi.org/10.1371/journal.pone.0155036},\n pages = {1-26},\n number = {5},\n}\n\n\n\n\n\nDomain: reviews\nLanguage: en\nLanguage family: Indo-European\nGenus: Germanic\nDefinite articles: definite word distinct from demonstrative\nIndefinite articles: indefinite word distinct from one\nNumber of cases: 2\nOrder of subject, object, verb: SVO\nNegative morphemes: negative particle\nPolar questions: interrogative word order\nPosition of negative word wrt SOV: SNegVO\nPrefixing vs suffixing: strongly suffixing\nCoding of nominal plurality: plural suffix\nGrammatical genders: no grammatical gender\n\n@inproceedings{dataset_en_vader,\n title={{VADER}: A Parsimonious Rule-Based Model for Sentiment Analysis of Social Media Text},\n author={Clayton J. Hutto and Eric Gilbert},\n booktitle={Proceedings of the International AAAI Conference on Web and Social Media},\n year={2014},\n url={https://ojs.aaai.org/index.php/ICWSM/article/view/14550},\n month={May}, \n pages={216-225},\n volume=8,\n}\n\n\n\n\n\nDomain: reviews\nLanguage: en\nLanguage family: Indo-European\nGenus: Germanic\nDefinite articles: definite word distinct from demonstrative\nIndefinite articles: indefinite word distinct from one\nNumber of cases: 2\nOrder of subject, object, verb: SVO\nNegative morphemes: negative particle\nPolar questions: interrogative word order\nPosition of negative word wrt SOV: SNegVO\nPrefixing vs suffixing: strongly suffixing\nCoding of nominal plurality: plural suffix\nGrammatical genders: no grammatical gender\n\n@inproceedings{dataset_en_vader,\n title={{VADER}: A Parsimonious Rule-Based Model for Sentiment Analysis of Social Media Text},\n author={Clayton J. Hutto and Eric Gilbert},\n booktitle={Proceedings of the International AAAI Conference on Web and Social Media},\n year={2014},\n url={https://ojs.aaai.org/index.php/ICWSM/article/view/14550},\n month={May}, \n pages={216-225},\n volume=8,\n}\n\n\n\n\n\nDomain: news\nLanguage: en\nLanguage family: Indo-European\nGenus: Germanic\nDefinite articles: definite word distinct from demonstrative\nIndefinite articles: indefinite word distinct from one\nNumber of cases: 2\nOrder of subject, object, verb: SVO\nNegative morphemes: negative particle\nPolar questions: interrogative word order\nPosition of negative word wrt SOV: SNegVO\nPrefixing vs suffixing: strongly suffixing\nCoding of nominal plurality: plural suffix\nGrammatical genders: no grammatical gender\n\n@inproceedings{dataset_en_vader,\n title={{VADER}: A Parsimonious Rule-Based Model for Sentiment Analysis of Social Media Text},\n author={Clayton J. Hutto and Eric Gilbert},\n booktitle={Proceedings of the International AAAI Conference on Web and Social Media},\n year={2014},\n url={https://ojs.aaai.org/index.php/ICWSM/article/view/14550},\n month={May}, \n pages={216-225},\n volume=8,\n}\n\n\n\n\n\nDomain: social_media\nLanguage: en\nLanguage family: Indo-European\nGenus: Germanic\nDefinite articles: definite word distinct from demonstrative\nIndefinite articles: indefinite word distinct from one\nNumber of cases: 2\nOrder of subject, object, verb: SVO\nNegative morphemes: negative particle\nPolar questions: interrogative word order\nPosition of negative word wrt SOV: SNegVO\nPrefixing vs suffixing: strongly suffixing\nCoding of nominal plurality: plural suffix\nGrammatical genders: no grammatical gender\n\n@inproceedings{dataset_en_vader,\n title={{VADER}: A Parsimonious Rule-Based Model for Sentiment Analysis of Social Media Text},\n author={Clayton J. Hutto and Eric Gilbert},\n booktitle={Proceedings of the International AAAI Conference on Web and Social Media},\n year={2014},\n url={https://ojs.aaai.org/index.php/ICWSM/article/view/14550},\n month={May}, \n pages={216-225},\n volume=8,\n}\n\n\n\n\n\nDomain: reviews\nLanguage: es\nLanguage family: Indo-European\nGenus: Romance\nDefinite articles: definite word distinct from demonstrative\nIndefinite articles: indefinite word same as one\nNumber of cases: no morphological case-making\nOrder of subject, object, verb: SVO\nNegative morphemes: negative particle\nPolar questions: interrogative word order\nPosition of negative word wrt SOV: SNegVO\nPrefixing vs suffixing: strongly suffixing\nCoding of nominal plurality: plural suffix\nGrammatical genders: masculine, feminine\n\n@article{dataset_es_muchocine,\n title={Experiments in sentiment classification of movie reviews in Spanish},\n author={Cruz, Fermin L and Troyano, Jose A and Enriquez, Fernando and Ortega, Javier},\n journal={Procesamiento del Lenguaje Natural},\n volume={41},\n pages={73--80},\n year={2008},\n publisher={SOC ESPANOLA PROCESAMIENTO LENGUAJE NATURAL-SEPLN DEPT LENGUAJES \\& SISTEMAS~…}\n}\n\n\n\n\n\nDomain: reviews\nLanguage: es\nLanguage family: Indo-European\nGenus: Romance\nDefinite articles: definite word distinct from demonstrative\nIndefinite articles: indefinite word same as one\nNumber of cases: no morphological case-making\nOrder of subject, object, verb: SVO\nNegative morphemes: negative particle\nPolar questions: interrogative word order\nPosition of negative word wrt SOV: SNegVO\nPrefixing vs suffixing: strongly suffixing\nCoding of nominal plurality: plural suffix\nGrammatical genders: masculine, feminine\n\n@inproceedings{dataset_multilan_amazon,\n title = \"The Multilingual {A}mazon Reviews Corpus\",\n author = {Keung, Phillip and\n Lu, Yichao and\n Szarvas, Gy{\\\"o}rgy and\n Smith, Noah A.},\n booktitle = \"Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP)\",\n month = nov,\n year = \"2020\",\n address = \"Online\",\n publisher = \"Association for Computational Linguistics\",\n url = \"https://aclanthology.org/2020.emnlp-main.369\",\n doi = \"10.18653/v1/2020.emnlp-main.369\",\n pages = \"4563--4568\",\n}\n\n\n\n\n\nDomain: reviews\nLanguage: es\nLanguage family: Indo-European\nGenus: Romance\nDefinite articles: definite word distinct from demonstrative\nIndefinite articles: indefinite word same as one\nNumber of cases: no morphological case-making\nOrder of subject, object, verb: SVO\nNegative morphemes: negative particle\nPolar questions: interrogative word order\nPosition of negative word wrt SOV: SNegVO\nPrefixing vs suffixing: strongly suffixing\nCoding of nominal plurality: plural suffix\nGrammatical genders: masculine, feminine\n\n@article{dataset_es_paper_reviews,\n author = {Keith Norambuena, Brian and Lettura, Exequiel and Villegas, Claudio},\n year = {2019},\n month = {02},\n pages = {191-214},\n title = {Sentiment analysis and opinion mining applied to scientific paper reviews},\n volume = {23},\n journal = {Intelligent Data Analysis},\n doi = {10.3233/IDA-173807}\n}\n\n\n\n\n\nDomain: social_media\nLanguage: es\nLanguage family: Indo-European\nGenus: Romance\nDefinite articles: definite word distinct from demonstrative\nIndefinite articles: indefinite word same as one\nNumber of cases: no morphological case-making\nOrder of subject, object, verb: SVO\nNegative morphemes: negative particle\nPolar questions: interrogative word order\nPosition of negative word wrt SOV: SNegVO\nPrefixing vs suffixing: strongly suffixing\nCoding of nominal plurality: plural suffix\nGrammatical genders: masculine, feminine\n\n@inproceedings{dataset_semeval_2020,\n title = \"{S}em{E}val-2020 Task 9: Overview of Sentiment Analysis of Code-Mixed Tweets\",\n author = {Patwa, Parth and\n Aguilar, Gustavo and\n Kar, Sudipta and\n Pandey, Suraj and\n PYKL, Srinivas and\n Gamb{\\\"a}ck, Bj{\\\"o}rn and\n Chakraborty, Tanmoy and\n Solorio, Thamar and\n Das, Amitava},\n booktitle = \"Proceedings of the Fourteenth Workshop on Semantic Evaluation\",\n month = dec,\n year = \"2020\",\n address = \"Barcelona (online)\",\n publisher = \"International Committee for Computational Linguistics\",\n url = \"https://aclanthology.org/2020.semeval-1.100\",\n doi = \"10.18653/v1/2020.semeval-1.100\",\n pages = \"774--790\",\n}\n\n\n\n\n\nDomain: social_media\nLanguage: es\nLanguage family: Indo-European\nGenus: Romance\nDefinite articles: definite word distinct from demonstrative\nIndefinite articles: indefinite word same as one\nNumber of cases: no morphological case-making\nOrder of subject, object, verb: SVO\nNegative morphemes: negative particle\nPolar questions: interrogative word order\nPosition of negative word wrt SOV: SNegVO\nPrefixing vs suffixing: strongly suffixing\nCoding of nominal plurality: plural suffix\nGrammatical genders: masculine, feminine\n\n@article{dataset_twitter_sentiment,\n doi = {10.1371/journal.pone.0155036},\n author = {Mozetič, Igor AND Grčar, Miha AND Smailović, Jasmina},\n journal = {PLOS ONE},\n publisher = {Public Library of Science},\n title = {Multilingual Twitter Sentiment Classification: The Role of Human Annotators},\n year = {2016},\n month = {05},\n volume = {11},\n url = {https://doi.org/10.1371/journal.pone.0155036},\n pages = {1-26},\n number = {5},\n}\n\n\n\n\n\nDomain: reviews\nLanguage: fa\nLanguage family: Indo-European\nGenus: Iranian\nDefinite articles: no article\nIndefinite articles: indefinite word same as one\nNumber of cases: 2\nOrder of subject, object, verb: SOV\nNegative morphemes: negative affix\nPolar questions: question particle\nPosition of negative word wrt SOV: MorphNeg\nPrefixing vs suffixing: weakly suffixing\nCoding of nominal plurality: plural suffix\nGrammatical genders: no grammatical gender\n\n@article{dataset_fa_sentipers,\n author = {Pedram Hosseini and\n Ali Ahmadian Ramaki and\n Hassan Maleki and\n Mansoureh Anvari and\n Seyed Abolghasem Mirroshandel},\n title = {{SentiPers}: {A} Sentiment Analysis Corpus for Persian},\n journal = {Computing Research Repository},\n volume = {arXiv:1801.07737},\n note = {Version 2},\n year = {2018},\n url = {http://arxiv.org/abs/1801.07737},\n eprinttype = {arXiv},\n eprint = {1801.07737},\n timestamp = {Mon, 13 Aug 2018 16:47:47 +0200},\n biburl = {https://dblp.org/rec/journals/corr/abs-1801-07737.bib},\n bibsource = {dblp computer science bibliography, https://dblp.org}\n}\n\n\n\n\n\nDomain: social_media\nLanguage: fr\nLanguage family: Indo-European\nGenus: Romance\nDefinite articles: definite word distinct from demonstrative\nIndefinite articles: indefinite word same as one\nNumber of cases: no morphological case-making\nOrder of subject, object, verb: SVO\nNegative morphemes: negative particle\nPolar questions: question particle\nPosition of negative word wrt SOV: OptDoubleNeg\nPrefixing vs suffixing: strongly suffixing\nCoding of nominal plurality: plural suffix\nGrammatical genders: masculine, feminine\n\n@inproceedings{dataset_dai_labor,\n author = {Narr, Sascha and Michael Hülfenhaus and Albayrak, Sahin},\n title = {Language-Independent Twitter Sentiment Analysis},\n booktitle = {Workshop on Knowledge Discovery, Data Mining and Machine Learning (KDML-2012)},\n year = {2012},\n location = {Dortmund, Germany},\n}\n\n\n\n\n\nDomain: social_media\nLanguage: fr\nLanguage family: Indo-European\nGenus: Romance\nDefinite articles: definite word distinct from demonstrative\nIndefinite articles: indefinite word same as one\nNumber of cases: no morphological case-making\nOrder of subject, object, verb: SVO\nNegative morphemes: negative particle\nPolar questions: question particle\nPosition of negative word wrt SOV: OptDoubleNeg\nPrefixing vs suffixing: strongly suffixing\nCoding of nominal plurality: plural suffix\nGrammatical genders: masculine, feminine\n\n@inproceedings{dataset_dai_labor,\n author = {Narr, Sascha and Michael Hülfenhaus and Albayrak, Sahin},\n title = {Language-Independent Twitter Sentiment Analysis},\n booktitle = {Workshop on Knowledge Discovery, Data Mining and Machine Learning (KDML-2012)},\n year = {2012},\n location = {Dortmund, Germany},\n}\n\n\n\n\n\nDomain: reviews\nLanguage: fr\nLanguage family: Indo-European\nGenus: Romance\nDefinite articles: definite word distinct from demonstrative\nIndefinite articles: indefinite word same as one\nNumber of cases: no morphological case-making\nOrder of subject, object, verb: SVO\nNegative morphemes: negative particle\nPolar questions: question particle\nPosition of negative word wrt SOV: OptDoubleNeg\nPrefixing vs suffixing: strongly suffixing\nCoding of nominal plurality: plural suffix\nGrammatical genders: masculine, feminine\n\n@inproceedings{dataset_multilan_amazon,\n title = \"The Multilingual {A}mazon Reviews Corpus\",\n author = {Keung, Phillip and\n Lu, Yichao and\n Szarvas, Gy{\\\"o}rgy and\n Smith, Noah A.},\n booktitle = \"Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP)\",\n month = nov,\n year = \"2020\",\n address = \"Online\",\n publisher = \"Association for Computational Linguistics\",\n url = \"https://aclanthology.org/2020.emnlp-main.369\",\n doi = \"10.18653/v1/2020.emnlp-main.369\",\n pages = \"4563--4568\",\n}\n\n\n\n\n\nDomain: social_media\nLanguage: he\nLanguage family: Afro-Asiatic\nGenus: Semitic\nDefinite articles: definite affix\nIndefinite articles: indefinite word same as one\nNumber of cases: no morphological case-making\nOrder of subject, object, verb: SVO\nNegative morphemes: negative particle\nPolar questions: question particle\nPosition of negative word wrt SOV: SNegVO\nPrefixing vs suffixing: weakly suffixing\nCoding of nominal plurality: plural suffix\nGrammatical genders: masculine, feminine\n\n@inproceedings{dataset_he_hebrew_sentiment,\n title = \"Representations and Architectures in Neural Sentiment Analysis for Morphologically Rich Languages: A Case Study from {M}odern {H}ebrew\",\n author = \"Amram, Adam and\n Ben David, Anat and\n Tsarfaty, Reut\",\n booktitle = \"Proceedings of the 27th International Conference on Computational Linguistics\",\n month = aug,\n year = \"2018\",\n address = \"Santa Fe, New Mexico, USA\",\n publisher = \"Association for Computational Linguistics\",\n url = \"https://aclanthology.org/C18-1190\",\n pages = \"2242--2252\",\n abstract = \"This paper empirically studies the effects of representation choices on neural sentiment analysis for Modern Hebrew, a morphologically rich language (MRL) for which no sentiment analyzer currently exists. We study two dimensions of representational choices: (i) the granularity of the input signal (token-based vs. morpheme-based), and (ii) the level of encoding of vocabulary items (string-based vs. character-based). We hypothesise that for MRLs, languages where multiple meaning-bearing elements may be carried by a single space-delimited token, these choices will have measurable effects on task perfromance, and that these effects may vary for different architectural designs {---} fully-connected, convolutional or recurrent. Specifically, we hypothesize that morpheme-based representations will have advantages in terms of their generalization capacity and task accuracy, due to their better OOV coverage. To empirically study these effects, we develop a new sentiment analysis benchmark for Hebrew, based on 12K social media comments, and provide two instances of these data: in token-based and morpheme-based settings. Our experiments show that representation choices empirical effects vary with architecture type. While fully-connected and convolutional networks slightly prefer token-based settings, RNNs benefit from a morpheme-based representation, in accord with the hypothesis that explicit morphological information may help generalize. Our endeavour also delivers the first state-of-the-art broad-coverage sentiment analyzer for Hebrew, with over 89{\\%} accuracy, alongside an established benchmark to further study the effects of linguistic representation choices on neural networks{'} task performance.\",\n}\n\n\n\n\n\nDomain: social_media\nLanguage: hi\nLanguage family: Indo-European\nGenus: Indic\nDefinite articles: no article\nIndefinite articles: no article\nNumber of cases: 3\nOrder of subject, object, verb: SOV\nNegative morphemes: negative particle\nPolar questions: question particle\nPosition of negative word wrt SOV: SONegV\nPrefixing vs suffixing: strongly suffixing\nCoding of nominal plurality: plural suffix\nGrammatical genders: masculine, feminine\n\n@inproceedings{dataset_semeval_2020,\n title = \"{S}em{E}val-2020 Task 9: Overview of Sentiment Analysis of Code-Mixed Tweets\",\n author = {Patwa, Parth and\n Aguilar, Gustavo and\n Kar, Sudipta and\n Pandey, Suraj and\n PYKL, Srinivas and\n Gamb{\\\"a}ck, Bj{\\\"o}rn and\n Chakraborty, Tanmoy and\n Solorio, Thamar and\n Das, Amitava},\n booktitle = \"Proceedings of the Fourteenth Workshop on Semantic Evaluation\",\n month = dec,\n year = \"2020\",\n address = \"Barcelona (online)\",\n publisher = \"International Committee for Computational Linguistics\",\n url = \"https://aclanthology.org/2020.semeval-1.100\",\n doi = \"10.18653/v1/2020.semeval-1.100\",\n pages = \"774--790\",\n}\n\n\n\n\n\nDomain: news\nLanguage: hr\nLanguage family: Indo-European\nGenus: Slavic\nDefinite articles: no article\nIndefinite articles: no article\nNumber of cases: 5\nOrder of subject, object, verb: SVO\nNegative morphemes: negative particle\nPolar questions: question particle\nPosition of negative word wrt SOV: other\nPrefixing vs suffixing: strongly suffixing\nCoding of nominal plurality: plural suffix\nGrammatical genders: masculine, feminine, neuter\n\n@Article{dataset_hr_sentiment_news_document,\n AUTHOR = {Pelicon, Andraž and Pranjić, Marko and Miljković, Dragana and Škrlj, Blaž and Pollak, Senja},\n TITLE = {Zero-Shot Learning for Cross-Lingual News Sentiment Classification},\n JOURNAL = {Applied Sciences},\n VOLUME = {10},\n YEAR = {2020},\n NUMBER = {17},\n ARTICLE-NUMBER = {5993},\n URL = {https://www.mdpi.com/2076-3417/10/17/5993},\n ISSN = {2076-3417},\n ABSTRACT = {In this paper, we address the task of zero-shot cross-lingual news sentiment classification. Given the annotated dataset of positive, neutral, and negative news in Slovene, the aim is to develop a news classification system that assigns the sentiment category not only to Slovene news, but to news in another language without any training data required. Our system is based on the multilingual BERTmodel, while we test different approaches for handling long documents and propose a novel technique for sentiment enrichment of the BERT model as an intermediate training step. With the proposed approach, we achieve state-of-the-art performance on the sentiment analysis task on Slovenian news. We evaluate the zero-shot cross-lingual capabilities of our system on a novel news sentiment test set in Croatian. The results show that the cross-lingual approach also largely outperforms the majority classifier, as well as all settings without sentiment enrichment in pre-training.},\n DOI = {10.3390/app10175993}\n}\n\n\n\n\n\nDomain: social_media\nLanguage: hr\nLanguage family: Indo-European\nGenus: Slavic\nDefinite articles: no article\nIndefinite articles: no article\nNumber of cases: 5\nOrder of subject, object, verb: SVO\nNegative morphemes: negative particle\nPolar questions: question particle\nPosition of negative word wrt SOV: other\nPrefixing vs suffixing: strongly suffixing\nCoding of nominal plurality: plural suffix\nGrammatical genders: masculine, feminine, neuter\n\n@article{dataset_twitter_sentiment,\n doi = {10.1371/journal.pone.0155036},\n author = {Mozetič, Igor AND Grčar, Miha AND Smailović, Jasmina},\n journal = {PLOS ONE},\n publisher = {Public Library of Science},\n title = {Multilingual Twitter Sentiment Classification: The Role of Human Annotators},\n year = {2016},\n month = {05},\n volume = {11},\n url = {https://doi.org/10.1371/journal.pone.0155036},\n pages = {1-26},\n number = {5},\n}\n\n\n\n\n\nDomain: social_media\nLanguage: hu\nLanguage family: Uralic\nGenus: Ugric\nDefinite articles: definite word distinct from demonstrative\nIndefinite articles: indefinite word distinct from one\nNumber of cases: 10 or more\nOrder of subject, object, verb: no dominant order\nNegative morphemes: negative particle\nPolar questions: question particle\nPosition of negative word wrt SOV: SNegVO\nPrefixing vs suffixing: strongly suffixing\nCoding of nominal plurality: plural suffix\nGrammatical genders: no grammatical gender\n\n@article{dataset_twitter_sentiment,\n doi = {10.1371/journal.pone.0155036},\n author = {Mozetič, Igor AND Grčar, Miha AND Smailović, Jasmina},\n journal = {PLOS ONE},\n publisher = {Public Library of Science},\n title = {Multilingual Twitter Sentiment Classification: The Role of Human Annotators},\n year = {2016},\n month = {05},\n volume = {11},\n url = {https://doi.org/10.1371/journal.pone.0155036},\n pages = {1-26},\n number = {5},\n}\n\n\n\n\n\nDomain: social_media\nLanguage: it\nLanguage family: Indo-European\nGenus: Romance\nDefinite articles: definite word distinct from demonstrative\nIndefinite articles: indefinite word same as one\nNumber of cases: no morphological case-making\nOrder of subject, object, verb: SVO\nNegative morphemes: negative particle\nPolar questions: interrogative intonation only\nPosition of negative word wrt SOV: SNegVO\nPrefixing vs suffixing: strongly suffixing\nCoding of nominal plurality: plural suffix\nGrammatical genders: masculine, feminine\n\n@inproceedings{dataset_it_evalita2016,\n TITLE = {{Overview of the Evalita 2016 SENTIment POLarity Classification Task}},\n AUTHOR = {Barbieri, Francesco and Basile, Valerio and Croce, Danilo and Nissim, Malvina and Novielli, Nicole and Patti, Viviana},\n URL = {https://hal.inria.fr/hal-01414731},\n BOOKTITLE = {{Proceedings of Third Italian Conference on Computational Linguistics (CLiC-it 2016) \\& Fifth Evaluation Campaign of Natural Language Processing and Speech Tools for Italian. Final Workshop (EVALITA 2016)}},\n ADDRESS = {Naples, Italy},\n YEAR = {2016},\n MONTH = Dec,\n KEYWORDS = {Natural language processing and web ; Social media analysis ; Sentiment analysis},\n PDF = {https://hal.inria.fr/hal-01414731/file/paper_026.pdf},\n HAL_ID = {hal-01414731},\n HAL_VERSION = {v1},\n}\n\n\n\n\n\nDomain: social_media\nLanguage: it\nLanguage family: Indo-European\nGenus: Romance\nDefinite articles: definite word distinct from demonstrative\nIndefinite articles: indefinite word same as one\nNumber of cases: no morphological case-making\nOrder of subject, object, verb: SVO\nNegative morphemes: negative particle\nPolar questions: interrogative intonation only\nPosition of negative word wrt SOV: SNegVO\nPrefixing vs suffixing: strongly suffixing\nCoding of nominal plurality: plural suffix\nGrammatical genders: masculine, feminine\n\n@inproceedings{dataset_it_multiemotions,\n author = {Sprugnoli, Rachele},\n year = {2020},\n month = {12},\n pages = {},\n title = {MultiEmotions-It: a New Dataset for Opinion Polarity and Emotion Analysis for Italian},\n booktitle = {Proceedings of the Seventh Italian Conference on Computational Linguistics},\n}\n\n\n\n\n\nDomain: reviews\nLanguage: ja\nLanguage family: Japanese\nGenus: Japanese\nDefinite articles: no article\nIndefinite articles: indefinite word distinct from one\nNumber of cases: 8-9\nOrder of subject, object, verb: SOV\nNegative morphemes: negative affix\nPolar questions: question particle\nPosition of negative word wrt SOV: MorphNeg\nPrefixing vs suffixing: strongly suffixing\nCoding of nominal plurality: plural suffix\nGrammatical genders: no grammatical gender\n\n@inproceedings{dataset_multilan_amazon,\n title = \"The Multilingual {A}mazon Reviews Corpus\",\n author = {Keung, Phillip and\n Lu, Yichao and\n Szarvas, Gy{\\\"o}rgy and\n Smith, Noah A.},\n booktitle = \"Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP)\",\n month = nov,\n year = \"2020\",\n address = \"Online\",\n publisher = \"Association for Computational Linguistics\",\n url = \"https://aclanthology.org/2020.emnlp-main.369\",\n doi = \"10.18653/v1/2020.emnlp-main.369\",\n pages = \"4563--4568\",\n}\n\n\n\n\n\nDomain: social_media\nLanguage: lv\nLanguage family: Indo-European\nGenus: Baltic\nDefinite articles: demonstrative word used as definite article\nIndefinite articles: indefinite word same as one\nNumber of cases: 5\nOrder of subject, object, verb: SVO\nNegative morphemes: negative affix\nPolar questions: question particle\nPosition of negative word wrt SOV: MorphNeg\nPrefixing vs suffixing: weakly suffixing\nCoding of nominal plurality: plural suffix\nGrammatical genders: masculine, feminine\n\n@article{dataset_lv_ltec_sentiment,\n author = {Uga Sprogis and\n Matiss Rikters},\n title = {What Can We Learn From Almost a Decade of Food Tweets},\n journal = {Computing Research Repository},\n volume = {arXiv:2007.05194},\n note = {Version 2},\n year = {2020},\n url = {https://arxiv.org/abs/2007.05194},\n eprinttype = {arXiv},\n eprint = {2007.05194},\n timestamp = {Mon, 20 Jul 2020 14:20:39 +0200},\n biburl = {https://dblp.org/rec/journals/corr/abs-2007-05194.bib},\n bibsource = {dblp computer science bibliography, https://dblp.org}\n}\n\n\n\n\n\nDomain: reviews\nLanguage: pl\nLanguage family: Indo-European\nGenus: Slavic\nDefinite articles: no article\nIndefinite articles: no article\nNumber of cases: 6-7\nOrder of subject, object, verb: SVO\nNegative morphemes: negative particle\nPolar questions: question particle\nPosition of negative word wrt SOV: SNegVO\nPrefixing vs suffixing: strongly suffixing\nCoding of nominal plurality: plural suffix\nGrammatical genders: masculine, feminine, neuter\n\n@inproceedings{dataset_pl_klej_allegro_reviews,\n title = \"{KLEJ}: Comprehensive Benchmark for {P}olish Language Understanding\",\n author = \"Rybak, Piotr and\n Mroczkowski, Robert and\n Tracz, Janusz and\n Gawlik, Ireneusz\",\n booktitle = \"Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics\",\n month = jul,\n year = \"2020\",\n address = \"Online\",\n publisher = \"Association for Computational Linguistics\",\n url = \"https://aclanthology.org/2020.acl-main.111\",\n doi = \"10.18653/v1/2020.acl-main.111\",\n pages = \"1191--1201\",\n}\n\n\n\n\n\nDomain: social_media\nLanguage: pl\nLanguage family: Indo-European\nGenus: Slavic\nDefinite articles: no article\nIndefinite articles: no article\nNumber of cases: 6-7\nOrder of subject, object, verb: SVO\nNegative morphemes: negative particle\nPolar questions: question particle\nPosition of negative word wrt SOV: SNegVO\nPrefixing vs suffixing: strongly suffixing\nCoding of nominal plurality: plural suffix\nGrammatical genders: masculine, feminine, neuter\n\n@article{dataset_pl_opi_lil_2012,\n author = {Pawel Sobkowicz and Antoni Sobkowicz},\n title ={Two-Year Study of Emotion and Communication Patterns in a Highly Polarized Political Discussion Forum},\n journal = {Social Science Computer Review},\n volume = {30},\n number = {4},\n pages = {448-469},\n year = {2012},\n doi = {10.1177/0894439312436512}\n}\n\n\n\n\n\nDomain: reviews\nLanguage: pl\nLanguage family: Indo-European\nGenus: Slavic\nDefinite articles: no article\nIndefinite articles: no article\nNumber of cases: 6-7\nOrder of subject, object, verb: SVO\nNegative morphemes: negative particle\nPolar questions: question particle\nPosition of negative word wrt SOV: SNegVO\nPrefixing vs suffixing: strongly suffixing\nCoding of nominal plurality: plural suffix\nGrammatical genders: masculine, feminine, neuter\n\n@inproceedings{dataset_pl_polemo,\n title = \"Multi-Level Sentiment Analysis of {P}ol{E}mo 2.0: Extended Corpus of Multi-Domain Consumer Reviews\",\n author = \"Koco{\\'n}, Jan and\n Mi{\\l}kowski, Piotr and\n Za{\\'s}ko-Zieli{\\'n}ska, Monika\",\n booktitle = \"Proceedings of the 23rd Conference on Computational Natural Language Learning (CoNLL)\",\n month = nov,\n year = \"2019\",\n address = \"Hong Kong, China\",\n publisher = \"Association for Computational Linguistics\",\n url = \"https://aclanthology.org/K19-1092\",\n doi = \"10.18653/v1/K19-1092\",\n pages = \"980--991\"\n}\n\n\n\n\n\nDomain: social_media\nLanguage: pl\nLanguage family: Indo-European\nGenus: Slavic\nDefinite articles: no article\nIndefinite articles: no article\nNumber of cases: 6-7\nOrder of subject, object, verb: SVO\nNegative morphemes: negative particle\nPolar questions: question particle\nPosition of negative word wrt SOV: SNegVO\nPrefixing vs suffixing: strongly suffixing\nCoding of nominal plurality: plural suffix\nGrammatical genders: masculine, feminine, neuter\n\n@article{dataset_twitter_sentiment,\n doi = {10.1371/journal.pone.0155036},\n author = {Mozetič, Igor AND Grčar, Miha AND Smailović, Jasmina},\n journal = {PLOS ONE},\n publisher = {Public Library of Science},\n title = {Multilingual Twitter Sentiment Classification: The Role of Human Annotators},\n year = {2016},\n month = {05},\n volume = {11},\n url = {https://doi.org/10.1371/journal.pone.0155036},\n pages = {1-26},\n number = {5},\n}\n\n\n\n\n\nDomain: social_media\nLanguage: pt\nLanguage family: Indo-European\nGenus: Romance\nDefinite articles: definite word distinct from demonstrative\nIndefinite articles: indefinite word same as one\nNumber of cases: no morphological case-making\nOrder of subject, object, verb: SVO\nNegative morphemes: negative particle\nPolar questions: question particle\nPosition of negative word wrt SOV: SNegVO\nPrefixing vs suffixing: strongly suffixing\nCoding of nominal plurality: plural suffix\nGrammatical genders: masculine, feminine\n\n@inproceedings{dataset_dai_labor,\n author = {Narr, Sascha and Michael Hülfenhaus and Albayrak, Sahin},\n title = {Language-Independent Twitter Sentiment Analysis},\n booktitle = {Workshop on Knowledge Discovery, Data Mining and Machine Learning (KDML-2012)},\n year = {2012},\n location = {Dortmund, Germany},\n}\n\n\n\n\n\nDomain: social_media\nLanguage: pt\nLanguage family: Indo-European\nGenus: Romance\nDefinite articles: definite word distinct from demonstrative\nIndefinite articles: indefinite word same as one\nNumber of cases: no morphological case-making\nOrder of subject, object, verb: SVO\nNegative morphemes: negative particle\nPolar questions: question particle\nPosition of negative word wrt SOV: SNegVO\nPrefixing vs suffixing: strongly suffixing\nCoding of nominal plurality: plural suffix\nGrammatical genders: masculine, feminine\n\n@inproceedings{dataset_dai_labor,\n author = {Narr, Sascha and Michael Hülfenhaus and Albayrak, Sahin},\n title = {Language-Independent Twitter Sentiment Analysis},\n booktitle = {Workshop on Knowledge Discovery, Data Mining and Machine Learning (KDML-2012)},\n year = {2012},\n location = {Dortmund, Germany},\n}\n\n\n\n\n\nDomain: social_media\nLanguage: pt\nLanguage family: Indo-European\nGenus: Romance\nDefinite articles: definite word distinct from demonstrative\nIndefinite articles: indefinite word same as one\nNumber of cases: no morphological case-making\nOrder of subject, object, verb: SVO\nNegative morphemes: negative particle\nPolar questions: question particle\nPosition of negative word wrt SOV: SNegVO\nPrefixing vs suffixing: strongly suffixing\nCoding of nominal plurality: plural suffix\nGrammatical genders: masculine, feminine\n\n@inproceedings{dataset_pt_tweet_sent_br,\n title = \"Building a Sentiment Corpus of Tweets in {B}razilian {P}ortuguese\",\n author = \"Brum, Henrico and\n Volpe Nunes, Maria das Gra{\\c{c}}as\",\n booktitle = \"Proceedings of the Eleventh International Conference on Language Resources and Evaluation ({LREC} 2018)\",\n month = may,\n year = \"2018\",\n address = \"Miyazaki, Japan\",\n publisher = \"European Language Resources Association (ELRA)\",\n url = \"https://aclanthology.org/L18-1658\",\n}\n\n\n\n\n\nDomain: social_media\nLanguage: pt\nLanguage family: Indo-European\nGenus: Romance\nDefinite articles: definite word distinct from demonstrative\nIndefinite articles: indefinite word same as one\nNumber of cases: no morphological case-making\nOrder of subject, object, verb: SVO\nNegative morphemes: negative particle\nPolar questions: question particle\nPosition of negative word wrt SOV: SNegVO\nPrefixing vs suffixing: strongly suffixing\nCoding of nominal plurality: plural suffix\nGrammatical genders: masculine, feminine\n\n@article{dataset_twitter_sentiment,\n doi = {10.1371/journal.pone.0155036},\n author = {Mozetič, Igor AND Grčar, Miha AND Smailović, Jasmina},\n journal = {PLOS ONE},\n publisher = {Public Library of Science},\n title = {Multilingual Twitter Sentiment Classification: The Role of Human Annotators},\n year = {2016},\n month = {05},\n volume = {11},\n url = {https://doi.org/10.1371/journal.pone.0155036},\n pages = {1-26},\n number = {5},\n}\n\n\n\n\n\nDomain: social_media\nLanguage: ru\nLanguage family: Indo-European\nGenus: Slavic\nDefinite articles: no article\nIndefinite articles: no article\nNumber of cases: 6-7\nOrder of subject, object, verb: SVO\nNegative morphemes: negative particle\nPolar questions: question particle\nPosition of negative word wrt SOV: SNegVO\nPrefixing vs suffixing: strongly suffixing\nCoding of nominal plurality: plural suffix\nGrammatical genders: masculine, feminine, neuter\n\n@inproceedings{dataset_ru_sentiment,\n title = \"{R}u{S}entiment: An Enriched Sentiment Analysis Dataset for Social Media in {R}ussian\",\n author = \"Rogers, Anna and\n Romanov, Alexey and\n Rumshisky, Anna and\n Volkova, Svitlana and\n Gronas, Mikhail and\n Gribov, Alex\",\n booktitle = \"Proceedings of the 27th International Conference on Computational Linguistics\",\n month = aug,\n year = \"2018\",\n address = \"Santa Fe, New Mexico, USA\",\n publisher = \"Association for Computational Linguistics\",\n url = \"https://aclanthology.org/C18-1064\",\n pages = \"755--763\",\n abstract = \"This paper presents RuSentiment, a new dataset for sentiment analysis of social media posts in Russian, and a new set of comprehensive annotation guidelines that are extensible to other languages. RuSentiment is currently the largest in its class for Russian, with 31,185 posts annotated with Fleiss{'} kappa of 0.58 (3 annotations per post). To diversify the dataset, 6,950 posts were pre-selected with an active learning-style strategy. We report baseline classification results, and we also release the best-performing embeddings trained on 3.2B tokens of Russian VKontakte posts.\",\n}\n\n\n\n\n\nDomain: social_media\nLanguage: ru\nLanguage family: Indo-European\nGenus: Slavic\nDefinite articles: no article\nIndefinite articles: no article\nNumber of cases: 6-7\nOrder of subject, object, verb: SVO\nNegative morphemes: negative particle\nPolar questions: question particle\nPosition of negative word wrt SOV: SNegVO\nPrefixing vs suffixing: strongly suffixing\nCoding of nominal plurality: plural suffix\nGrammatical genders: masculine, feminine, neuter\n\n@article{dataset_twitter_sentiment,\n doi = {10.1371/journal.pone.0155036},\n author = {Mozetič, Igor AND Grčar, Miha AND Smailović, Jasmina},\n journal = {PLOS ONE},\n publisher = {Public Library of Science},\n title = {Multilingual Twitter Sentiment Classification: The Role of Human Annotators},\n year = {2016},\n month = {05},\n volume = {11},\n url = {https://doi.org/10.1371/journal.pone.0155036},\n pages = {1-26},\n number = {5},\n}\n\n\n\n\n\nDomain: social_media\nLanguage: sk\nLanguage family: Indo-European\nGenus: Slavic\nDefinite articles: no article\nIndefinite articles: no article\nNumber of cases: 6-7\nOrder of subject, object, verb: SVO\nNegative morphemes: negative affix\nPolar questions: interrogative word order\nPosition of negative word wrt SOV: MorphNeg\nPrefixing vs suffixing: weakly suffixing\nCoding of nominal plurality: plural suffix\nGrammatical genders: masculine, feminine, neuter\n\n@article{dataset_twitter_sentiment,\n doi = {10.1371/journal.pone.0155036},\n author = {Mozetič, Igor AND Grčar, Miha AND Smailović, Jasmina},\n journal = {PLOS ONE},\n publisher = {Public Library of Science},\n title = {Multilingual Twitter Sentiment Classification: The Role of Human Annotators},\n year = {2016},\n month = {05},\n volume = {11},\n url = {https://doi.org/10.1371/journal.pone.0155036},\n pages = {1-26},\n number = {5},\n}\n\n\n\n\n\nDomain: news\nLanguage: sl\nLanguage family: Indo-European\nGenus: Slavic\nDefinite articles: no article\nIndefinite articles: no article\nNumber of cases: 6-7\nOrder of subject, object, verb: SVO\nNegative morphemes: negative particle\nPolar questions: question particle\nPosition of negative word wrt SOV: SNegVO\nPrefixing vs suffixing: strongly suffixing\nCoding of nominal plurality: plural suffix\nGrammatical genders: masculine, feminine, neuter\n\n@Article{Bučar2018,\n author={Bu{\\v{c}}ar, Jo{\\v{z}}e\n and {\\v{Z}}nidar{\\v{s}}i{\\v{c}}, Martin\n and Povh, Janez},\n title={Annotated news corpora and a lexicon for sentiment analysis in Slovene},\n journal={Language Resources and Evaluation},\n year={2018},\n month={Sep},\n day={01},\n volume={52},\n number={3},\n pages={895-919},\n abstract={In this study, we introduce Slovene web-crawled news corpora with sentiment annotation on three levels of granularity: sentence, paragraph and document levels. We describe the methodology and tools that were required for their construction. The corpora contain more than 250,000 documents with political, business, economic and financial content from five Slovene media resources on the web. More than 10,000 of them were manually annotated as negative, neutral or positive. All corpora are publicly available under a Creative Commons copyright license. We used the annotated documents to construct a Slovene sentiment lexicon, which is the first of its kind for Slovene, and to assess the sentiment classification approaches used. The constructed corpora were also utilised to monitor within-the-document sentiment dynamics, its changes over time and relations with news topics. We show that sentiment is, on average, more explicit at the beginning of documents, and it loses sharpness towards the end of documents.},\n issn={1574-0218},\n doi={10.1007/s10579-018-9413-3},\n url={https://doi.org/10.1007/s10579-018-9413-3}\n}\n\n\n\n\n\nDomain: social_media\nLanguage: sl\nLanguage family: Indo-European\nGenus: Slavic\nDefinite articles: no article\nIndefinite articles: no article\nNumber of cases: 6-7\nOrder of subject, object, verb: SVO\nNegative morphemes: negative particle\nPolar questions: question particle\nPosition of negative word wrt SOV: SNegVO\nPrefixing vs suffixing: strongly suffixing\nCoding of nominal plurality: plural suffix\nGrammatical genders: masculine, feminine, neuter\n\n@article{dataset_twitter_sentiment,\n doi = {10.1371/journal.pone.0155036},\n author = {Mozetič, Igor AND Grčar, Miha AND Smailović, Jasmina},\n journal = {PLOS ONE},\n publisher = {Public Library of Science},\n title = {Multilingual Twitter Sentiment Classification: The Role of Human Annotators},\n year = {2016},\n month = {05},\n volume = {11},\n url = {https://doi.org/10.1371/journal.pone.0155036},\n pages = {1-26},\n number = {5},\n}\n\n\n\n\n\nDomain: social_media\nLanguage: sq\nLanguage family: Indo-European\nGenus: Albanian\nDefinite articles: definite affix\nIndefinite articles: indefinite word distinct from one\nNumber of cases: 4\nOrder of subject, object, verb: SVO\nNegative morphemes: negative particle\nPolar questions: question particle\nPosition of negative word wrt SOV: SNegVO\nPrefixing vs suffixing: strongly suffixing\nCoding of nominal plurality: plural suffix\nGrammatical genders: masculine, feminine\n\n@article{dataset_twitter_sentiment,\n doi = {10.1371/journal.pone.0155036},\n author = {Mozetič, Igor AND Grčar, Miha AND Smailović, Jasmina},\n journal = {PLOS ONE},\n publisher = {Public Library of Science},\n title = {Multilingual Twitter Sentiment Classification: The Role of Human Annotators},\n year = {2016},\n month = {05},\n volume = {11},\n url = {https://doi.org/10.1371/journal.pone.0155036},\n pages = {1-26},\n number = {5},\n}\n\n\n\n\n\nDomain: reviews\nLanguage: sr\nLanguage family: Indo-European\nGenus: Slavic\nDefinite articles: no article\nIndefinite articles: no article\nNumber of cases: 5\nOrder of subject, object, verb: SVO\nNegative morphemes: negative particle\nPolar questions: question particle\nPosition of negative word wrt SOV: other\nPrefixing vs suffixing: strongly suffixing\nCoding of nominal plurality: plural suffix\nGrammatical genders: masculine, feminine, neuter\n\n@inproceedings{dataset_sr_serb_movie_reviews,\n title = \"Reliable Baselines for Sentiment Analysis in Resource-Limited Languages: The {S}erbian Movie Review Dataset\",\n author = \"Batanovi{\\'c}, Vuk and\n Nikoli{\\'c}, Bo{\\v{s}}ko and\n Milosavljevi{\\'c}, Milan\",\n booktitle = \"Proceedings of the Tenth International Conference on Language Resources and Evaluation ({LREC}'16)\",\n month = may,\n year = \"2016\",\n address = \"Portoro{\\v{z}}, Slovenia\",\n publisher = \"European Language Resources Association (ELRA)\",\n url = \"https://aclanthology.org/L16-1427\",\n pages = \"2688--2696\",\n abstract = \"Collecting data for sentiment analysis in resource-limited languages carries a significant risk of sample selection bias, since the small quantities of available data are most likely not representative of the whole population. Ignoring this bias leads to less robust machine learning classifiers and less reliable evaluation results. In this paper we present a dataset balancing algorithm that minimizes the sample selection bias by eliminating irrelevant systematic differences between the sentiment classes. We prove its superiority over the random sampling method and we use it to create the Serbian movie review dataset ― SerbMR ― the first balanced and topically uniform sentiment analysis dataset in Serbian. In addition, we propose an incremental way of finding the optimal combination of simple text processing options and machine learning features for sentiment classification. Several popular classifiers are used in conjunction with this evaluation approach in order to establish strong but reliable baselines for sentiment analysis in Serbian.\",\n}\n\n\n\n\n\nDomain: reviews\nLanguage: sr\nLanguage family: Indo-European\nGenus: Slavic\nDefinite articles: no article\nIndefinite articles: no article\nNumber of cases: 5\nOrder of subject, object, verb: SVO\nNegative morphemes: negative particle\nPolar questions: question particle\nPosition of negative word wrt SOV: other\nPrefixing vs suffixing: strongly suffixing\nCoding of nominal plurality: plural suffix\nGrammatical genders: masculine, feminine, neuter\n\n@article{dataset_sr_senticomments,\n doi = {10.1371/journal.pone.0242050},\n author = {Batanović, Vuk AND Cvetanović, Miloš AND Nikolić, Boško},\n journal = {PLOS ONE},\n publisher = {Public Library of Science},\n title = {A versatile framework for resource-limited sentiment articulation, annotation, and analysis of short texts},\n year = {2020},\n month = {11},\n volume = {15},\n url = {https://doi.org/10.1371/journal.pone.0242050},\n pages = {1-30},\n abstract = {Choosing a comprehensive and cost-effective way of articulating and annotating the sentiment of a text is not a trivial task, particularly when dealing with short texts, in which sentiment can be expressed through a wide variety of linguistic and rhetorical phenomena. This problem is especially conspicuous in resource-limited settings and languages, where design options are restricted either in terms of manpower and financial means required to produce appropriate sentiment analysis resources, or in terms of available language tools, or both. In this paper, we present a versatile approach to addressing this issue, based on multiple interpretations of sentiment labels that encode information regarding the polarity, subjectivity, and ambiguity of a text, as well as the presence of sarcasm or a mixture of sentiments. We demonstrate its use on Serbian, a resource-limited language, via the creation of a main sentiment analysis dataset focused on movie comments, and two smaller datasets belonging to the movie and book domains. In addition to measuring the quality of the annotation process, we propose a novel metric to validate its cost-effectiveness. Finally, the practicality of our approach is further validated by training, evaluating, and determining the optimal configurations of several different kinds of machine-learning models on a range of sentiment classification tasks using the produced dataset.},\n number = {11},\n}\n\n\n\n\n\nDomain: social_media\nLanguage: sr\nLanguage family: Indo-European\nGenus: Slavic\nDefinite articles: no article\nIndefinite articles: no article\nNumber of cases: 5\nOrder of subject, object, verb: SVO\nNegative morphemes: negative particle\nPolar questions: question particle\nPosition of negative word wrt SOV: other\nPrefixing vs suffixing: strongly suffixing\nCoding of nominal plurality: plural suffix\nGrammatical genders: masculine, feminine, neuter\n\n@article{dataset_twitter_sentiment,\n doi = {10.1371/journal.pone.0155036},\n author = {Mozetič, Igor AND Grčar, Miha AND Smailović, Jasmina},\n journal = {PLOS ONE},\n publisher = {Public Library of Science},\n title = {Multilingual Twitter Sentiment Classification: The Role of Human Annotators},\n year = {2016},\n month = {05},\n volume = {11},\n url = {https://doi.org/10.1371/journal.pone.0155036},\n pages = {1-26},\n number = {5},\n}\n\n\n\n\n\nDomain: social_media\nLanguage: sv\nLanguage family: Indo-European\nGenus: Germanic\nDefinite articles: definite affix\nIndefinite articles: indefinite word same as one\nNumber of cases: 2\nOrder of subject, object, verb: SVO\nNegative morphemes: negative particle\nPolar questions: interrogative word order\nPosition of negative word wrt SOV: more than one position\nPrefixing vs suffixing: strongly suffixing\nCoding of nominal plurality: plural suffix\nGrammatical genders: common, neuter\n\n@article{dataset_twitter_sentiment,\n doi = {10.1371/journal.pone.0155036},\n author = {Mozetič, Igor AND Grčar, Miha AND Smailović, Jasmina},\n journal = {PLOS ONE},\n publisher = {Public Library of Science},\n title = {Multilingual Twitter Sentiment Classification: The Role of Human Annotators},\n year = {2016},\n month = {05},\n volume = {11},\n url = {https://doi.org/10.1371/journal.pone.0155036},\n pages = {1-26},\n number = {5},\n}\n\n\n\n\n\nDomain: social_media\nLanguage: th\nLanguage family: Tai-Kadai\nGenus: Kam-Tai\nDefinite articles: no article\nIndefinite articles: indefinite word distinct from one\nNumber of cases: no morphological case-making\nOrder of subject, object, verb: SVO\nNegative morphemes: negative auxiliary verb\nPolar questions: question particle\nPosition of negative word wrt SOV: SNegVO\nPrefixing vs suffixing: little affixation\nCoding of nominal plurality: mixed morphological plural\nGrammatical genders: noun classifiers\n\n@misc{dataset_th_wisesight_sentiment,\n author = {Suriyawongkul, Arthit and\n Chuangsuwanich, Ekapol and\n Chormai, Pattarawat and\n Polpanumas, Charin},\n title = {PyThaiNLP/wisesight-sentiment: First release (v1.0)},\n month = sep,\n year = 2019,\n publisher = {Zenodo},\n version = {v1.0},\n doi = {10.5281/zenodo.3457447},\n url = {https://doi.org/10.5281/zenodo.3457447},\n note = {Zenodo}\n}\n\n\n\n\n\nDomain: reviews\nLanguage: th\nLanguage family: Tai-Kadai\nGenus: Kam-Tai\nDefinite articles: no article\nIndefinite articles: indefinite word distinct from one\nNumber of cases: no morphological case-making\nOrder of subject, object, verb: SVO\nNegative morphemes: negative auxiliary verb\nPolar questions: question particle\nPosition of negative word wrt SOV: SNegVO\nPrefixing vs suffixing: little affixation\nCoding of nominal plurality: mixed morphological plural\nGrammatical genders: noun classifiers\n\n@misc{dataset_th_wongnai_reviews,\n author = {Ekkalak Thongthanomkul and Tanapol Nearunchorn and Yuwat Chuesathuchon},\n title = {wongnai-corpus},\n year = {2019},\n publisher = {GitHub},\n journal = {GitHub repository},\n howpublished = {\\url{https://github.com/wongnai/wongnai-corpus}}\n}\n\n\n\n\n\nDomain: mixed\nLanguage: ur\nLanguage family: Indo-European\nGenus: Indic\nDefinite articles: no article\nIndefinite articles: no article\nNumber of cases: 2\nOrder of subject, object, verb: SOV\nNegative morphemes: negative affix\nPolar questions: question particle\nPosition of negative word wrt SOV: SONegV\nPrefixing vs suffixing: strongly suffixing\nCoding of nominal plurality: plural suffix\nGrammatical genders: masculine, feminine\n\n@InProceedings{dataset_ur_roman_urdu,\n title = \"Performing Natural Language Processing on Roman Urdu Datasets\",\n author = \"Zareen Sharf and Saif Ur Rahman\",\n booktitle = \"International Journal of Computer Science and Network Security\",\n volume = \"18\",\n pages = \"141-148\",\n year = \"2018\",\n url = {http://paper.ijcsns.org/07_book/201801/20180117.pdf}\n}\n\n\n\n\n\nDomain: reviews\nLanguage: zh\nLanguage family: Sino-Tibetan\nGenus: Chinese\nDefinite articles: no article\nIndefinite articles: indefinite word same as one\nNumber of cases: no morphological case-making\nOrder of subject, object, verb: SVO\nNegative morphemes: negative particle\nPolar questions: question particle\nPosition of negative word wrt SOV: SNegVO\nPrefixing vs suffixing: little affixation\nCoding of nominal plurality: no plural\nGrammatical genders: noun classifiers\n\n@inproceedings{dataset_zh_hotel_reviews,\n title = \"An Empirical Study on Sentiment Classification of {C}hinese Review using Word Embedding\",\n author = \"Lin, Yiou and\n Lei, Hang and\n Wu, Jia and\n Li, Xiaoyu\",\n booktitle = \"Proceedings of the 29th Pacific Asia Conference on Language, Information and Computation: Posters\",\n month = oct,\n year = \"2015\",\n address = \"Shanghai, China\",\n url = \"https://aclanthology.org/Y15-2030\",\n pages = \"258--266\",\n}\n\n\n\n\nDomain: reviews\nLanguage: zh\nLanguage family: Sino-Tibetan\nGenus: Chinese\nDefinite articles: no article\nIndefinite articles: indefinite word same as one\nNumber of cases: no morphological case-making\nOrder of subject, object, verb: SVO\nNegative morphemes: negative particle\nPolar questions: question particle\nPosition of negative word wrt SOV: SNegVO\nPrefixing vs suffixing: little affixation\nCoding of nominal plurality: no plural\nGrammatical genders: noun classifiers\n\n@inproceedings{dataset_multilan_amazon,\n title = \"The Multilingual {A}mazon Reviews Corpus\",\n author = {Keung, Phillip and\n Lu, Yichao and\n Szarvas, Gy{\\\"o}rgy and\n Smith, Noah A.},\n booktitle = \"Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP)\",\n month = nov,\n year = \"2020\",\n address = \"Online\",\n publisher = \"Association for Computational Linguistics\",\n url = \"https://aclanthology.org/2020.emnlp-main.369\",\n doi = \"10.18653/v1/2020.emnlp-main.369\",\n pages = \"4563--4568\",\n}"
+ },
+ {
+ "objectID": "citations.html#citations",
+ "href": "citations.html#citations",
+ "title": "MMS Dataset Citations",
+ "section": "",
+ "text": "Domain: social_media\nLanguage: ar\nLanguage family: Afro-Asiatic\nGenus: Semitic\nDefinite articles: definite affix\nIndefinite articles: no article\nNumber of cases: 3\nOrder of subject, object, verb: SVO\nNegative morphemes: negative particle\nPolar questions: interrogative intonation only\nPosition of negative word wrt SOV: SNegVO\nPrefixing vs suffixing: weakly suffixing\nCoding of nominal plurality: mixed morphological plural\nGrammatical genders: masculine, feminine\n\n@InProceedings{dataset_ar_arsentdl,\n author = {Ramy Baly and\n Alaa Khaddaj and\n Hazem M. Hajj and\n Wassim El{-}Hajj and\n Khaled Bashir Shaban},\n title = {{ArSentD-LEV: A Multi-Topic Corpus for Target-based Sentiment Analysis in Arabic Levantine Tweets}},\n booktitle = {Proceedings of the Eleventh International Conference on Language Resources and Evaluation (LREC 2018)},\n year = {2018},\n month = {may},\n date = {7-12},\n location = {Miyazaki, Japan},\n editor = {Hend Al-Khalifa and King Saud University and KSA Walid Magdy and University of Edinburgh and UK Kareem Darwish and Qatar Computing Research Institute and Qatar Tamer Elsayed and Qatar University and Qatar},\n publisher = {European Language Resources Association (ELRA)},\n address = {Paris, France},\n isbn = {979-10-95546-25-2},\n language = {english}\n}\n\n\n\n\n\nDomain: social_media\nLanguage: ar\nLanguage family: Afro-Asiatic\nGenus: Semitic\nDefinite articles: definite affix\nIndefinite articles: no article\nNumber of cases: 3\nOrder of subject, object, verb: SVO\nNegative morphemes: negative particle\nPolar questions: interrogative intonation only\nPosition of negative word wrt SOV: SNegVO\nPrefixing vs suffixing: weakly suffixing\nCoding of nominal plurality: mixed morphological plural\nGrammatical genders: masculine, feminine\n\n@inproceedings{dataset_ar_astd,\n title = \"{ASTD}: {A}rabic Sentiment Tweets Dataset\",\n author = \"Nabil, Mahmoud and\n Aly, Mohamed and\n Atiya, Amir\",\n booktitle = \"Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing\",\n month = sep,\n year = \"2015\",\n address = \"Lisbon, Portugal\",\n publisher = \"Association for Computational Linguistics\",\n url = \"https://aclanthology.org/D15-1299\",\n doi = \"10.18653/v1/D15-1299\",\n pages = \"2515--2519\",\n}\n\n\n\n\n\nDomain: social_media\nLanguage: ar\nLanguage family: Afro-Asiatic\nGenus: Semitic\nDefinite articles: definite affix\nIndefinite articles: no article\nNumber of cases: 3\nOrder of subject, object, verb: SVO\nNegative morphemes: negative particle\nPolar questions: interrogative intonation only\nPosition of negative word wrt SOV: SNegVO\nPrefixing vs suffixing: weakly suffixing\nCoding of nominal plurality: mixed morphological plural\nGrammatical genders: masculine, feminine\n\n@inproceedings{dataset_ar_bbn,\n title = \"Sentiment after Translation: A Case-Study on {A}rabic Social Media Posts\",\n author = \"Salameh, Mohammad and\n Mohammad, Saif and\n Kiritchenko, Svetlana\",\n booktitle = \"Proceedings of the 2015 Conference of the North {A}merican Chapter of the Association for Computational Linguistics: Human Language Technologies\",\n month = may # \"{--}\" # jun,\n year = \"2015\",\n address = \"Denver, Colorado\",\n publisher = \"Association for Computational Linguistics\",\n url = \"https://aclanthology.org/N15-1078\",\n doi = \"10.3115/v1/N15-1078\",\n pages = \"767--777\",\n}\n\n\n\n\n\nDomain: reviews\nLanguage: ar\nLanguage family: Afro-Asiatic\nGenus: Semitic\nDefinite articles: definite affix\nIndefinite articles: no article\nNumber of cases: 3\nOrder of subject, object, verb: SVO\nNegative morphemes: negative particle\nPolar questions: interrogative intonation only\nPosition of negative word wrt SOV: SNegVO\nPrefixing vs suffixing: weakly suffixing\nCoding of nominal plurality: mixed morphological plural\nGrammatical genders: masculine, feminine\n\n@INPROCEEDINGS{dataset_ar_brad,\n author={Elnagar, Ashraf and Einea, Omar},\n booktitle={2016 IEEE/ACS 13th International Conference of Computer Systems and Applications (AICCSA)}, \n title={{BRAD} 1.0: Book reviews in Arabic dataset}, \n year={2016},\n volume={},\n number={},\n pages={1-8},\n doi={10.1109/AICCSA.2016.7945800}\n}\n\n\n\n\n\nDomain: reviews\nLanguage: ar\nLanguage family: Afro-Asiatic\nGenus: Semitic\nDefinite articles: definite affix\nIndefinite articles: no article\nNumber of cases: 3\nOrder of subject, object, verb: SVO\nNegative morphemes: negative particle\nPolar questions: interrogative intonation only\nPosition of negative word wrt SOV: SNegVO\nPrefixing vs suffixing: weakly suffixing\nCoding of nominal plurality: mixed morphological plural\nGrammatical genders: masculine, feminine\n\n@Book{dataset_ar_hard,\n author=\"Elnagar, Ashraf\n and Khalifa, Yasmin S.\n and Einea, Anas\",\n title={Hotel Arabic-Reviews Dataset Construction for Sentiment Analysis Applications},\n bookTitle=\"Intelligent Natural Language Processing: Trends and Applications\",\n year=\"2018\",\n publisher=\"Springer International Publishing\",\n address=\"Cham\",\n pages=\"35--52\",\n isbn=\"978-3-319-67056-0\",\n doi=\"10.1007/978-3-319-67056-0_3\",\n url=\"https://doi.org/10.1007/978-3-319-67056-0_3\"\n}\n\n\n\n\n\nDomain: reviews\nLanguage: ar\nLanguage family: Afro-Asiatic\nGenus: Semitic\nDefinite articles: definite affix\nIndefinite articles: no article\nNumber of cases: 3\nOrder of subject, object, verb: SVO\nNegative morphemes: negative particle\nPolar questions: interrogative intonation only\nPosition of negative word wrt SOV: SNegVO\nPrefixing vs suffixing: weakly suffixing\nCoding of nominal plurality: mixed morphological plural\nGrammatical genders: masculine, feminine\n\n@inproceedings{dataset_ar_labr,\n title = \"{LABR}: A Large Scale {A}rabic Book Reviews Dataset\",\n author = \"Aly, Mohamed and\n Atiya, Amir\",\n booktitle = \"Proceedings of the 51st Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers)\",\n month = aug,\n year = \"2013\",\n address = \"Sofia, Bulgaria\",\n publisher = \"Association for Computational Linguistics\",\n url = \"https://aclanthology.org/P13-2088\",\n pages = \"494--498\",\n}\n\n\n\n\n\nDomain: reviews\nLanguage: ar\nLanguage family: Afro-Asiatic\nGenus: Semitic\nDefinite articles: definite affix\nIndefinite articles: no article\nNumber of cases: 3\nOrder of subject, object, verb: SVO\nNegative morphemes: negative particle\nPolar questions: interrogative intonation only\nPosition of negative word wrt SOV: SNegVO\nPrefixing vs suffixing: weakly suffixing\nCoding of nominal plurality: mixed morphological plural\nGrammatical genders: masculine, feminine\n\n@inproceedings{dataset_ar_oclar,\n author={Al Omari, Marwan and Al-Hajj, Moustafa and Hammami, Nacereddine and Sabra, Amani},\n booktitle={2019 International Conference on Computer and Information Sciences (ICCIS)}, \n title={Sentiment Classifier: Logistic Regression for Arabic Services’ Reviews in Lebanon}, \n year={2019},\n volume={},\n number={},\n pages={1-5},\n doi={10.1109/ICCISci.2019.8716394}\n}\n\n\n\n\n\nDomain: mixed\nLanguage: ar\nLanguage family: Afro-Asiatic\nGenus: Semitic\nDefinite articles: definite affix\nIndefinite articles: no article\nNumber of cases: 3\nOrder of subject, object, verb: SVO\nNegative morphemes: negative particle\nPolar questions: interrogative intonation only\nPosition of negative word wrt SOV: SNegVO\nPrefixing vs suffixing: weakly suffixing\nCoding of nominal plurality: mixed morphological plural\nGrammatical genders: masculine, feminine\n\n@inproceedings{dataset_semeval_2017,\n title = \"{S}em{E}val-2017 Task 4: Sentiment Analysis in {T}witter\",\n author = \"Rosenthal, Sara and\n Farra, Noura and\n Nakov, Preslav\",\n booktitle = \"Proceedings of the 11th International Workshop on Semantic Evaluation ({S}em{E}val-2017)\",\n month = aug,\n year = \"2017\",\n address = \"Vancouver, Canada\",\n publisher = \"Association for Computational Linguistics\",\n url = \"https://aclanthology.org/S17-2088\",\n doi = \"10.18653/v1/S17-2088\",\n pages = \"502--518\",\n abstract = \"This paper describes the fifth year of the Sentiment Analysis in Twitter task. SemEval-2017 Task 4 continues with a rerun of the subtasks of SemEval-2016 Task 4, which include identifying the overall sentiment of the tweet, sentiment towards a topic with classification on a two-point and on a five-point ordinal scale, and quantification of the distribution of sentiment towards a topic across a number of tweets: again on a two-point and on a five-point ordinal scale. Compared to 2016, we made two changes: (i) we introduced a new language, Arabic, for all subtasks, and (ii) we made available information from the profiles of the Twitter users who posted the target tweets. The task continues to be very popular, with a total of 48 teams participating this year.\",\n}\n\n\n\n\n\nDomain: social_media\nLanguage: ar\nLanguage family: Afro-Asiatic\nGenus: Semitic\nDefinite articles: definite affix\nIndefinite articles: no article\nNumber of cases: 3\nOrder of subject, object, verb: SVO\nNegative morphemes: negative particle\nPolar questions: interrogative intonation only\nPosition of negative word wrt SOV: SNegVO\nPrefixing vs suffixing: weakly suffixing\nCoding of nominal plurality: mixed morphological plural\nGrammatical genders: masculine, feminine\n\n@inproceedings{dataset_ar_bbn,\n title = \"Sentiment after Translation: A Case-Study on {A}rabic Social Media Posts\",\n author = \"Salameh, Mohammad and\n Mohammad, Saif and\n Kiritchenko, Svetlana\",\n booktitle = \"Proceedings of the 2015 Conference of the North {A}merican Chapter of the Association for Computational Linguistics: Human Language Technologies\",\n month = may # \"{--}\" # jun,\n year = \"2015\",\n address = \"Denver, Colorado\",\n publisher = \"Association for Computational Linguistics\",\n url = \"https://aclanthology.org/N15-1078\",\n doi = \"10.3115/v1/N15-1078\",\n pages = \"767--777\",\n}\n\n\n\n\n\nDomain: social_media\nLanguage: bg\nLanguage family: Indo-European\nGenus: Slavic\nDefinite articles: definite word distinct from demonstrative\nIndefinite articles: no article\nNumber of cases: no morphological case-making\nOrder of subject, object, verb: SVO\nNegative morphemes: negative particle\nPolar questions: question particle\nPosition of negative word wrt SOV: SNegVO\nPrefixing vs suffixing: strongly suffixing\nCoding of nominal plurality: plural suffix\nGrammatical genders: masculine, feminine, neuter\n\n@article{dataset_twitter_sentiment,\n doi = {10.1371/journal.pone.0155036},\n author = {Mozetič, Igor AND Grčar, Miha AND Smailović, Jasmina},\n journal = {PLOS ONE},\n publisher = {Public Library of Science},\n title = {Multilingual Twitter Sentiment Classification: The Role of Human Annotators},\n year = {2016},\n month = {05},\n volume = {11},\n url = {https://doi.org/10.1371/journal.pone.0155036},\n pages = {1-26},\n number = {5},\n}\n\n\n\n\n\nDomain: social_media\nLanguage: bs\nLanguage family: Indo-European\nGenus: Slavic\nDefinite articles: no article\nIndefinite articles: no article\nNumber of cases: 5\nOrder of subject, object, verb: SVO\nNegative morphemes: negative particle\nPolar questions: question particle\nPosition of negative word wrt SOV: other\nPrefixing vs suffixing: strongly suffixing\nCoding of nominal plurality: plural suffix\nGrammatical genders: masculine, feminine, neuter\n\n@article{dataset_twitter_sentiment,\n doi = {10.1371/journal.pone.0155036},\n author = {Mozetič, Igor AND Grčar, Miha AND Smailović, Jasmina},\n journal = {PLOS ONE},\n publisher = {Public Library of Science},\n title = {Multilingual Twitter Sentiment Classification: The Role of Human Annotators},\n year = {2016},\n month = {05},\n volume = {11},\n url = {https://doi.org/10.1371/journal.pone.0155036},\n pages = {1-26},\n number = {5},\n}\n\n\n\n\n\nDomain: social_media\nLanguage: cs\nLanguage family: Indo-European\nGenus: Slavic\nDefinite articles: no article\nIndefinite articles: no article\nNumber of cases: 6-7\nOrder of subject, object, verb: SVO\nNegative morphemes: negative affix\nPolar questions: interrogative word order\nPosition of negative word wrt SOV: MorphNeg\nPrefixing vs suffixing: weakly suffixing\nCoding of nominal plurality: plural suffix\nGrammatical genders: masculine, feminine, neuter\n\n@inproceedings{dataset_cs_social_media,\n title = \"Sentiment Analysis in {C}zech Social Media Using Supervised Machine Learning\",\n author = \"Habernal, Ivan and\n Pt{\\'a}{\\v{c}}ek, Tom{\\'a}{\\v{s}} and\n Steinberger, Josef\",\n booktitle = \"Proceedings of the 4th Workshop on Computational Approaches to Subjectivity, Sentiment and Social Media Analysis\",\n month = jun,\n year = \"2013\",\n address = \"Atlanta, Georgia\",\n publisher = \"Association for Computational Linguistics\",\n url = \"https://aclanthology.org/W13-1609\",\n pages = \"65--74\",\n}\n\n\n\n\n\nDomain: reviews\nLanguage: cs\nLanguage family: Indo-European\nGenus: Slavic\nDefinite articles: no article\nIndefinite articles: no article\nNumber of cases: 6-7\nOrder of subject, object, verb: SVO\nNegative morphemes: negative affix\nPolar questions: interrogative word order\nPosition of negative word wrt SOV: MorphNeg\nPrefixing vs suffixing: weakly suffixing\nCoding of nominal plurality: plural suffix\nGrammatical genders: masculine, feminine, neuter\n\n@inproceedings{dataset_cs_social_media,\n title = \"Sentiment Analysis in {C}zech Social Media Using Supervised Machine Learning\",\n author = \"Habernal, Ivan and\n Pt{\\'a}{\\v{c}}ek, Tom{\\'a}{\\v{s}} and\n Steinberger, Josef\",\n booktitle = \"Proceedings of the 4th Workshop on Computational Approaches to Subjectivity, Sentiment and Social Media Analysis\",\n month = jun,\n year = \"2013\",\n address = \"Atlanta, Georgia\",\n publisher = \"Association for Computational Linguistics\",\n url = \"https://aclanthology.org/W13-1609\",\n pages = \"65--74\",\n}\n\n\n\n\n\nDomain: reviews\nLanguage: cs\nLanguage family: Indo-European\nGenus: Slavic\nDefinite articles: no article\nIndefinite articles: no article\nNumber of cases: 6-7\nOrder of subject, object, verb: SVO\nNegative morphemes: negative affix\nPolar questions: interrogative word order\nPosition of negative word wrt SOV: MorphNeg\nPrefixing vs suffixing: weakly suffixing\nCoding of nominal plurality: plural suffix\nGrammatical genders: masculine, feminine, neuter\n\n@inproceedings{dataset_cs_social_media,\n title = \"Sentiment Analysis in {C}zech Social Media Using Supervised Machine Learning\",\n author = \"Habernal, Ivan and\n Pt{\\'a}{\\v{c}}ek, Tom{\\'a}{\\v{s}} and\n Steinberger, Josef\",\n booktitle = \"Proceedings of the 4th Workshop on Computational Approaches to Subjectivity, Sentiment and Social Media Analysis\",\n month = jun,\n year = \"2013\",\n address = \"Atlanta, Georgia\",\n publisher = \"Association for Computational Linguistics\",\n url = \"https://aclanthology.org/W13-1609\",\n pages = \"65--74\",\n}\n\n\n\n\n\nDomain: social_media\nLanguage: cs\nLanguage family: Indo-European\nGenus: Slavic\nDefinite articles: no article\nIndefinite articles: no article\nNumber of cases: 6-7\nOrder of subject, object, verb: SVO\nNegative morphemes: negative affix\nPolar questions: interrogative word order\nPosition of negative word wrt SOV: MorphNeg\nPrefixing vs suffixing: weakly suffixing\nCoding of nominal plurality: plural suffix\nGrammatical genders: masculine, feminine, neuter\n\n@inproceedings{dataset_cs_social_media,\n title = \"Sentiment Analysis in {C}zech Social Media Using Supervised Machine Learning\",\n author = \"Habernal, Ivan and\n Pt{\\'a}{\\v{c}}ek, Tom{\\'a}{\\v{s}} and\n Steinberger, Josef\",\n booktitle = \"Proceedings of the 4th Workshop on Computational Approaches to Subjectivity, Sentiment and Social Media Analysis\",\n month = jun,\n year = \"2013\",\n address = \"Atlanta, Georgia\",\n publisher = \"Association for Computational Linguistics\",\n url = \"https://aclanthology.org/W13-1609\",\n pages = \"65--74\",\n}\n\n\n\n\n\nDomain: social_media\nLanguage: de\nLanguage family: Indo-European\nGenus: Germanic\nDefinite articles: definite word distinct from demonstrative\nIndefinite articles: indefinite word same as one\nNumber of cases: 4\nOrder of subject, object, verb: no dominant order\nNegative morphemes: negative particle\nPolar questions: interrogative word order\nPosition of negative word wrt SOV: more than one position\nPrefixing vs suffixing: strongly suffixing\nCoding of nominal plurality: plural suffix\nGrammatical genders: masculine, feminine, neuter\n\n@inproceedings{dataset_dai_labor,\n author = {Narr, Sascha and Michael Hülfenhaus and Albayrak, Sahin},\n title = {Language-Independent Twitter Sentiment Analysis},\n booktitle = {Workshop on Knowledge Discovery, Data Mining and Machine Learning (KDML-2012)},\n year = {2012},\n location = {Dortmund, Germany},\n}\n\n\n\n\n\nDomain: social_media\nLanguage: de\nLanguage family: Indo-European\nGenus: Germanic\nDefinite articles: definite word distinct from demonstrative\nIndefinite articles: indefinite word same as one\nNumber of cases: 4\nOrder of subject, object, verb: no dominant order\nNegative morphemes: negative particle\nPolar questions: interrogative word order\nPosition of negative word wrt SOV: more than one position\nPrefixing vs suffixing: strongly suffixing\nCoding of nominal plurality: plural suffix\nGrammatical genders: masculine, feminine, neuter\n\n@inproceedings{dataset_dai_labor,\n author = {Narr, Sascha and Michael Hülfenhaus and Albayrak, Sahin},\n title = {Language-Independent Twitter Sentiment Analysis},\n booktitle = {Workshop on Knowledge Discovery, Data Mining and Machine Learning (KDML-2012)},\n year = {2012},\n location = {Dortmund, Germany},\n}\n\n\n\n\n\nDomain: reviews\nLanguage: de\nLanguage family: Indo-European\nGenus: Germanic\nDefinite articles: definite word distinct from demonstrative\nIndefinite articles: indefinite word same as one\nNumber of cases: 4\nOrder of subject, object, verb: no dominant order\nNegative morphemes: negative particle\nPolar questions: interrogative word order\nPosition of negative word wrt SOV: more than one position\nPrefixing vs suffixing: strongly suffixing\nCoding of nominal plurality: plural suffix\nGrammatical genders: masculine, feminine, neuter\n\n@inproceedings{dataset_multilan_amazon,\n title = \"The Multilingual {A}mazon Reviews Corpus\",\n author = {Keung, Phillip and\n Lu, Yichao and\n Szarvas, Gy{\\\"o}rgy and\n Smith, Noah A.},\n booktitle = \"Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP)\",\n month = nov,\n year = \"2020\",\n address = \"Online\",\n publisher = \"Association for Computational Linguistics\",\n url = \"https://aclanthology.org/2020.emnlp-main.369\",\n doi = \"10.18653/v1/2020.emnlp-main.369\",\n pages = \"4563--4568\",\n}\n\n\n\n\n\nDomain: social_media\nLanguage: de\nLanguage family: Indo-European\nGenus: Germanic\nDefinite articles: definite word distinct from demonstrative\nIndefinite articles: indefinite word same as one\nNumber of cases: 4\nOrder of subject, object, verb: no dominant order\nNegative morphemes: negative particle\nPolar questions: interrogative word order\nPosition of negative word wrt SOV: more than one position\nPrefixing vs suffixing: strongly suffixing\nCoding of nominal plurality: plural suffix\nGrammatical genders: masculine, feminine, neuter\n\n@inproceedings{dataset_de_omp,\n title = \"Academic-Industrial Perspective on the Development and Deployment of a Moderation System for a Newspaper Website\",\n author = \"Schabus, Dietmar and\n Skowron, Marcin\",\n booktitle = \"Proceedings of the Eleventh International Conference on Language Resources and Evaluation ({LREC} 2018)\",\n month = may,\n year = \"2018\",\n address = \"Miyazaki, Japan\",\n publisher = \"European Language Resources Association (ELRA)\",\n url = \"https://aclanthology.org/L18-1253\",\n}\n\n\n\n\n\nDomain: social_media\nLanguage: de\nLanguage family: Indo-European\nGenus: Germanic\nDefinite articles: definite word distinct from demonstrative\nIndefinite articles: indefinite word same as one\nNumber of cases: 4\nOrder of subject, object, verb: no dominant order\nNegative morphemes: negative particle\nPolar questions: interrogative word order\nPosition of negative word wrt SOV: more than one position\nPrefixing vs suffixing: strongly suffixing\nCoding of nominal plurality: plural suffix\nGrammatical genders: masculine, feminine, neuter\n\n@inproceedings{dataset_de_sb10k,\n title = \"A {T}witter Corpus and Benchmark Resources for {G}erman Sentiment Analysis\",\n author = \"Cieliebak, Mark and\n Deriu, Jan Milan and\n Egger, Dominic and\n Uzdilli, Fatih\",\n booktitle = \"Proceedings of the Fifth International Workshop on Natural Language Processing for Social Media\",\n month = apr,\n year = \"2017\",\n address = \"Valencia, Spain\",\n publisher = \"Association for Computational Linguistics\",\n url = \"https://aclanthology.org/W17-1106\",\n doi = \"10.18653/v1/W17-1106\",\n pages = \"45--51\",\n abstract = \"In this paper we present SB10k, a new corpus for sentiment analysis with approx. 10,000 German tweets. We use this new corpus and two existing corpora to provide state-of-the-art benchmarks for sentiment analysis in German: we implemented a CNN (based on the winning system of SemEval-2016) and a feature-based SVM and compare their performance on all three corpora. For the CNN, we also created German word embeddings trained on 300M tweets. These word embeddings were then optimized for sentiment analysis using distant-supervised learning. The new corpus, the German word embeddings (plain and optimized), and source code to re-run the benchmarks are publicly available.\",\n}\n\n\n\n\n\nDomain: social_media\nLanguage: de\nLanguage family: Indo-European\nGenus: Germanic\nDefinite articles: definite word distinct from demonstrative\nIndefinite articles: indefinite word same as one\nNumber of cases: 4\nOrder of subject, object, verb: no dominant order\nNegative morphemes: negative particle\nPolar questions: interrogative word order\nPosition of negative word wrt SOV: more than one position\nPrefixing vs suffixing: strongly suffixing\nCoding of nominal plurality: plural suffix\nGrammatical genders: masculine, feminine, neuter\n\n@article{dataset_twitter_sentiment,\n doi = {10.1371/journal.pone.0155036},\n author = {Mozetič, Igor AND Grčar, Miha AND Smailović, Jasmina},\n journal = {PLOS ONE},\n publisher = {Public Library of Science},\n title = {Multilingual Twitter Sentiment Classification: The Role of Human Annotators},\n year = {2016},\n month = {05},\n volume = {11},\n url = {https://doi.org/10.1371/journal.pone.0155036},\n pages = {1-26},\n number = {5},\n}\n\n\n\n\n\nDomain: reviews\nLanguage: en\nLanguage family: Indo-European\nGenus: Germanic\nDefinite articles: definite word distinct from demonstrative\nIndefinite articles: indefinite word distinct from one\nNumber of cases: 2\nOrder of subject, object, verb: SVO\nNegative morphemes: negative particle\nPolar questions: interrogative word order\nPosition of negative word wrt SOV: SNegVO\nPrefixing vs suffixing: strongly suffixing\nCoding of nominal plurality: plural suffix\nGrammatical genders: no grammatical gender\n\n@inproceedings{dataset_en_amazon,\n title = \"Justifying Recommendations using Distantly-Labeled Reviews and Fine-Grained Aspects\",\n author = \"Ni, Jianmo and\n Li, Jiacheng and\n McAuley, Julian\",\n booktitle = \"Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP)\",\n month = nov,\n year = \"2019\",\n address = \"Hong Kong, China\",\n publisher = \"Association for Computational Linguistics\",\n url = \"https://aclanthology.org/D19-1018\",\n doi = \"10.18653/v1/D19-1018\",\n pages = \"188--197\",\n}\n\n\n\n\n\nDomain: social_media\nLanguage: en\nLanguage family: Indo-European\nGenus: Germanic\nDefinite articles: definite word distinct from demonstrative\nIndefinite articles: indefinite word distinct from one\nNumber of cases: 2\nOrder of subject, object, verb: SVO\nNegative morphemes: negative particle\nPolar questions: interrogative word order\nPosition of negative word wrt SOV: SNegVO\nPrefixing vs suffixing: strongly suffixing\nCoding of nominal plurality: plural suffix\nGrammatical genders: no grammatical gender\n\n@inproceedings{dataset_dai_labor,\n author = {Narr, Sascha and Michael Hülfenhaus and Albayrak, Sahin},\n title = {Language-Independent Twitter Sentiment Analysis},\n booktitle = {Workshop on Knowledge Discovery, Data Mining and Machine Learning (KDML-2012)},\n year = {2012},\n location = {Dortmund, Germany},\n}\n\n\n\n\n\nDomain: news\nLanguage: en\nLanguage family: Indo-European\nGenus: Germanic\nDefinite articles: definite word distinct from demonstrative\nIndefinite articles: indefinite word distinct from one\nNumber of cases: 2\nOrder of subject, object, verb: SVO\nNegative morphemes: negative particle\nPolar questions: interrogative word order\nPosition of negative word wrt SOV: SNegVO\nPrefixing vs suffixing: strongly suffixing\nCoding of nominal plurality: plural suffix\nGrammatical genders: no grammatical gender\n\n@article{dataset_en_financial_phrasebank_sentences_75agree,\n author = {Malo, Pekka and Sinha, Ankur and Korhonen, Pekka and Wallenius, Jyrki and Takala, Pyry},\n title = {Good Debt or Bad Debt: Detecting Semantic Orientations in Economic Texts},\n year = {2014},\n issue_date = {April 2014},\n publisher = {John Wiley & Sons, Inc.},\n address = {USA},\n volume = {65},\n number = {4},\n issn = {2330-1635},\n url = {https://doi.org/10.1002/asi.23062},\n doi = {10.1002/asi.23062},\n journal = {Journal of the Association for Information Science and Technology},\n month = {apr},\n pages = {782–796},\n numpages = {15},\n keywords = {economics, automatic classification, linguistic analysis}\n}\n\n\n\n\n\nDomain: reviews\nLanguage: en\nLanguage family: Indo-European\nGenus: Germanic\nDefinite articles: definite word distinct from demonstrative\nIndefinite articles: indefinite word distinct from one\nNumber of cases: 2\nOrder of subject, object, verb: SVO\nNegative morphemes: negative particle\nPolar questions: interrogative word order\nPosition of negative word wrt SOV: SNegVO\nPrefixing vs suffixing: strongly suffixing\nCoding of nominal plurality: plural suffix\nGrammatical genders: no grammatical gender\n\n@inproceedings{dataset_multilan_amazon,\n title = \"The Multilingual {A}mazon Reviews Corpus\",\n author = {Keung, Phillip and\n Lu, Yichao and\n Szarvas, Gy{\\\"o}rgy and\n Smith, Noah A.},\n booktitle = \"Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP)\",\n month = nov,\n year = \"2020\",\n address = \"Online\",\n publisher = \"Association for Computational Linguistics\",\n url = \"https://aclanthology.org/2020.emnlp-main.369\",\n doi = \"10.18653/v1/2020.emnlp-main.369\",\n pages = \"4563--4568\",\n}\n\n\n\n\n\nDomain: news\nLanguage: en\nLanguage family: Indo-European\nGenus: Germanic\nDefinite articles: definite word distinct from demonstrative\nIndefinite articles: indefinite word distinct from one\nNumber of cases: 2\nOrder of subject, object, verb: SVO\nNegative morphemes: negative particle\nPolar questions: interrogative word order\nPosition of negative word wrt SOV: SNegVO\nPrefixing vs suffixing: strongly suffixing\nCoding of nominal plurality: plural suffix\nGrammatical genders: no grammatical gender\n\n@inproceedings{dataset_en_per_sent,\n title = \"Author{'}s Sentiment Prediction\",\n author = \"Bastan, Mohaddeseh and\n Koupaee, Mahnaz and\n Son, Youngseo and\n Sicoli, Richard and\n Balasubramanian, Niranjan\",\n booktitle = \"Proceedings of the 28th International Conference on Computational Linguistics\",\n month = dec,\n year = \"2020\",\n address = \"Barcelona, Spain (Online)\",\n publisher = \"International Committee on Computational Linguistics\",\n url = \"https://aclanthology.org/2020.coling-main.52\",\n doi = \"10.18653/v1/2020.coling-main.52\",\n pages = \"604--615\",\n}\n\n\n\n\n\nDomain: poems\nLanguage: en\nLanguage family: Indo-European\nGenus: Germanic\nDefinite articles: definite word distinct from demonstrative\nIndefinite articles: indefinite word distinct from one\nNumber of cases: 2\nOrder of subject, object, verb: SVO\nNegative morphemes: negative particle\nPolar questions: interrogative word order\nPosition of negative word wrt SOV: SNegVO\nPrefixing vs suffixing: strongly suffixing\nCoding of nominal plurality: plural suffix\nGrammatical genders: no grammatical gender\n\n@inproceedings{dataset_en_poem_sentiment,\n title = \"Investigating Societal Biases in a Poetry Composition System\",\n author = \"Sheng, Emily and\n Uthus, David\",\n booktitle = \"Proceedings of the Second Workshop on Gender Bias in Natural Language Processing\",\n month = dec,\n year = \"2020\",\n address = \"Barcelona, Spain (Online)\",\n publisher = \"Association for Computational Linguistics\",\n url = \"https://aclanthology.org/2020.gebnlp-1.9\",\n pages = \"93--106\",\n}\n\n\n\n\n\nDomain: mixed\nLanguage: en\nLanguage family: Indo-European\nGenus: Germanic\nDefinite articles: definite word distinct from demonstrative\nIndefinite articles: indefinite word distinct from one\nNumber of cases: 2\nOrder of subject, object, verb: SVO\nNegative morphemes: negative particle\nPolar questions: interrogative word order\nPosition of negative word wrt SOV: SNegVO\nPrefixing vs suffixing: strongly suffixing\nCoding of nominal plurality: plural suffix\nGrammatical genders: no grammatical gender\n\n@inproceedings{dataset_semeval_2017,\n title = \"{S}em{E}val-2017 Task 4: Sentiment Analysis in {T}witter\",\n author = \"Rosenthal, Sara and\n Farra, Noura and\n Nakov, Preslav\",\n booktitle = \"Proceedings of the 11th International Workshop on Semantic Evaluation ({S}em{E}val-2017)\",\n month = aug,\n year = \"2017\",\n address = \"Vancouver, Canada\",\n publisher = \"Association for Computational Linguistics\",\n url = \"https://aclanthology.org/S17-2088\",\n doi = \"10.18653/v1/S17-2088\",\n pages = \"502--518\",\n abstract = \"This paper describes the fifth year of the Sentiment Analysis in Twitter task. SemEval-2017 Task 4 continues with a rerun of the subtasks of SemEval-2016 Task 4, which include identifying the overall sentiment of the tweet, sentiment towards a topic with classification on a two-point and on a five-point ordinal scale, and quantification of the distribution of sentiment towards a topic across a number of tweets: again on a two-point and on a five-point ordinal scale. Compared to 2016, we made two changes: (i) we introduced a new language, Arabic, for all subtasks, and (ii) we made available information from the profiles of the Twitter users who posted the target tweets. The task continues to be very popular, with a total of 48 teams participating this year.\",\n}\n\n\n\n\n\nDomain: social_media\nLanguage: en\nLanguage family: Indo-European\nGenus: Germanic\nDefinite articles: definite word distinct from demonstrative\nIndefinite articles: indefinite word distinct from one\nNumber of cases: 2\nOrder of subject, object, verb: SVO\nNegative morphemes: negative particle\nPolar questions: interrogative word order\nPosition of negative word wrt SOV: SNegVO\nPrefixing vs suffixing: strongly suffixing\nCoding of nominal plurality: plural suffix\nGrammatical genders: no grammatical gender\n\n@article{dataset_en_sentistrength,\n author = {Thelwall, Mike and Buckley, Kevan and Paltoglou, Georgios},\n title = {Sentiment Strength Detection for the Social Web},\n year = {2012},\n issue_date = {January 2012},\n publisher = {John Wiley \\& Sons, Inc.},\n address = {USA},\n volume = {63},\n number = {1},\n issn = {1532-2882},\n url = {https://doi.org/10.1002/asi.21662},\n doi = {10.1002/asi.21662},\n abstract = {Sentiment analysis is concerned with the automatic extraction of sentiment-related\n information from text. Although most sentiment analysis addresses commercial tass,\n such as extracting opinions from product reviews, there is increasing interest in\n the affective dimension of the social web, and Twitter in particular. Most sentiment\n analysis algorithms are not ideally suited to this task because they exploit indirect\n indicators of sentiment that can reflect genre or topic instead. Hence, such algorithms\n used to process social web texts can identify spurious sentiment patterns caused by\n topics rather than affective phenomena. This article assesses an improved version\n of the algorithm SentiStrength for sentiment strength detection across the social\n web that primarily uses direct indications of sentiment. The results from six diverse\n social web data sets (MySpace, Twitter, YouTube, Digg, RunnersWorld, BBCForums) indicate\n that SentiStrength 2 is successful in the sense of performing better than a baseline\n approach for all data sets in both supervised and unsupervised cases. SentiStrength\n is not always better than machine-learning approaches that exploit indirect indicators\n of sentiment, however, and is particularly weaker for positive sentiment in news-related\n discussions. Overall, the results suggest that, even unsupervised, SentiStrength is\n robust enough to be applied to a wide variety of different social web contexts.},\n journal = {J. Am. Soc. Inf. Sci. Technol.},\n month = jan,\n pages = {163–173},\n numpages = {11}\n}\n\n\n\n\n\nDomain: chats\nLanguage: en\nLanguage family: Indo-European\nGenus: Germanic\nDefinite articles: definite word distinct from demonstrative\nIndefinite articles: indefinite word distinct from one\nNumber of cases: 2\nOrder of subject, object, verb: SVO\nNegative morphemes: negative particle\nPolar questions: interrogative word order\nPosition of negative word wrt SOV: SNegVO\nPrefixing vs suffixing: strongly suffixing\nCoding of nominal plurality: plural suffix\nGrammatical genders: no grammatical gender\n\n@inproceedings{dataset_en_silicone,\n title = \"Hierarchical Pre-training for Sequence Labelling in Spoken Dialog\",\n author = \"Chapuis, Emile and\n Colombo, Pierre and\n Manica, Matteo and\n Labeau, Matthieu and\n Clavel, Chlo{\\'e}\",\n booktitle = \"Findings of the Association for Computational Linguistics: EMNLP 2020\",\n month = nov,\n year = \"2020\",\n address = \"Online\",\n publisher = \"Association for Computational Linguistics\",\n url = \"https://aclanthology.org/2020.findings-emnlp.239\",\n doi = \"10.18653/v1/2020.findings-emnlp.239\",\n pages = \"2636--2648\",\n}\n\n\n\n\n\nDomain: chats\nLanguage: en\nLanguage family: Indo-European\nGenus: Germanic\nDefinite articles: definite word distinct from demonstrative\nIndefinite articles: indefinite word distinct from one\nNumber of cases: 2\nOrder of subject, object, verb: SVO\nNegative morphemes: negative particle\nPolar questions: interrogative word order\nPosition of negative word wrt SOV: SNegVO\nPrefixing vs suffixing: strongly suffixing\nCoding of nominal plurality: plural suffix\nGrammatical genders: no grammatical gender\n\n@inproceedings{dataset_en_silicone,\n title = \"Hierarchical Pre-training for Sequence Labelling in Spoken Dialog\",\n author = \"Chapuis, Emile and\n Colombo, Pierre and\n Manica, Matteo and\n Labeau, Matthieu and\n Clavel, Chlo{\\'e}\",\n booktitle = \"Findings of the Association for Computational Linguistics: EMNLP 2020\",\n month = nov,\n year = \"2020\",\n address = \"Online\",\n publisher = \"Association for Computational Linguistics\",\n url = \"https://aclanthology.org/2020.findings-emnlp.239\",\n doi = \"10.18653/v1/2020.findings-emnlp.239\",\n pages = \"2636--2648\",\n}\n\n\n\n\n\nDomain: social_media\nLanguage: en\nLanguage family: Indo-European\nGenus: Germanic\nDefinite articles: definite word distinct from demonstrative\nIndefinite articles: indefinite word distinct from one\nNumber of cases: 2\nOrder of subject, object, verb: SVO\nNegative morphemes: negative particle\nPolar questions: interrogative word order\nPosition of negative word wrt SOV: SNegVO\nPrefixing vs suffixing: strongly suffixing\nCoding of nominal plurality: plural suffix\nGrammatical genders: no grammatical gender\n\n@misc{dataset_en_tweet_airlines,\n url={https://www.kaggle.com/crowdflower/twitter-airline-sentiment},\n author={Crowdflower Inc.},\n title={Twitter US Airline Sentiment},\n year={2015}\n}\n\n\n\n\n\nDomain: social_media\nLanguage: en\nLanguage family: Indo-European\nGenus: Germanic\nDefinite articles: definite word distinct from demonstrative\nIndefinite articles: indefinite word distinct from one\nNumber of cases: 2\nOrder of subject, object, verb: SVO\nNegative morphemes: negative particle\nPolar questions: interrogative word order\nPosition of negative word wrt SOV: SNegVO\nPrefixing vs suffixing: strongly suffixing\nCoding of nominal plurality: plural suffix\nGrammatical genders: no grammatical gender\n\n@article{dataset_en_tweets_sanders,\n title={{Sanders-Twitter Sentiment Corpus}},\n author={Sanders, Niek J},\n journal={Sanders Analytics LLC},\n year={2011}\n}\n\n\n\n\n\nDomain: social_media\nLanguage: en\nLanguage family: Indo-European\nGenus: Germanic\nDefinite articles: definite word distinct from demonstrative\nIndefinite articles: indefinite word distinct from one\nNumber of cases: 2\nOrder of subject, object, verb: SVO\nNegative morphemes: negative particle\nPolar questions: interrogative word order\nPosition of negative word wrt SOV: SNegVO\nPrefixing vs suffixing: strongly suffixing\nCoding of nominal plurality: plural suffix\nGrammatical genders: no grammatical gender\n\n@article{dataset_twitter_sentiment,\n doi = {10.1371/journal.pone.0155036},\n author = {Mozetič, Igor AND Grčar, Miha AND Smailović, Jasmina},\n journal = {PLOS ONE},\n publisher = {Public Library of Science},\n title = {Multilingual Twitter Sentiment Classification: The Role of Human Annotators},\n year = {2016},\n month = {05},\n volume = {11},\n url = {https://doi.org/10.1371/journal.pone.0155036},\n pages = {1-26},\n number = {5},\n}\n\n\n\n\n\nDomain: reviews\nLanguage: en\nLanguage family: Indo-European\nGenus: Germanic\nDefinite articles: definite word distinct from demonstrative\nIndefinite articles: indefinite word distinct from one\nNumber of cases: 2\nOrder of subject, object, verb: SVO\nNegative morphemes: negative particle\nPolar questions: interrogative word order\nPosition of negative word wrt SOV: SNegVO\nPrefixing vs suffixing: strongly suffixing\nCoding of nominal plurality: plural suffix\nGrammatical genders: no grammatical gender\n\n@inproceedings{dataset_en_vader,\n title={{VADER}: A Parsimonious Rule-Based Model for Sentiment Analysis of Social Media Text},\n author={Clayton J. Hutto and Eric Gilbert},\n booktitle={Proceedings of the International AAAI Conference on Web and Social Media},\n year={2014},\n url={https://ojs.aaai.org/index.php/ICWSM/article/view/14550},\n month={May}, \n pages={216-225},\n volume=8,\n}\n\n\n\n\n\nDomain: reviews\nLanguage: en\nLanguage family: Indo-European\nGenus: Germanic\nDefinite articles: definite word distinct from demonstrative\nIndefinite articles: indefinite word distinct from one\nNumber of cases: 2\nOrder of subject, object, verb: SVO\nNegative morphemes: negative particle\nPolar questions: interrogative word order\nPosition of negative word wrt SOV: SNegVO\nPrefixing vs suffixing: strongly suffixing\nCoding of nominal plurality: plural suffix\nGrammatical genders: no grammatical gender\n\n@inproceedings{dataset_en_vader,\n title={{VADER}: A Parsimonious Rule-Based Model for Sentiment Analysis of Social Media Text},\n author={Clayton J. Hutto and Eric Gilbert},\n booktitle={Proceedings of the International AAAI Conference on Web and Social Media},\n year={2014},\n url={https://ojs.aaai.org/index.php/ICWSM/article/view/14550},\n month={May}, \n pages={216-225},\n volume=8,\n}\n\n\n\n\n\nDomain: news\nLanguage: en\nLanguage family: Indo-European\nGenus: Germanic\nDefinite articles: definite word distinct from demonstrative\nIndefinite articles: indefinite word distinct from one\nNumber of cases: 2\nOrder of subject, object, verb: SVO\nNegative morphemes: negative particle\nPolar questions: interrogative word order\nPosition of negative word wrt SOV: SNegVO\nPrefixing vs suffixing: strongly suffixing\nCoding of nominal plurality: plural suffix\nGrammatical genders: no grammatical gender\n\n@inproceedings{dataset_en_vader,\n title={{VADER}: A Parsimonious Rule-Based Model for Sentiment Analysis of Social Media Text},\n author={Clayton J. Hutto and Eric Gilbert},\n booktitle={Proceedings of the International AAAI Conference on Web and Social Media},\n year={2014},\n url={https://ojs.aaai.org/index.php/ICWSM/article/view/14550},\n month={May}, \n pages={216-225},\n volume=8,\n}\n\n\n\n\n\nDomain: social_media\nLanguage: en\nLanguage family: Indo-European\nGenus: Germanic\nDefinite articles: definite word distinct from demonstrative\nIndefinite articles: indefinite word distinct from one\nNumber of cases: 2\nOrder of subject, object, verb: SVO\nNegative morphemes: negative particle\nPolar questions: interrogative word order\nPosition of negative word wrt SOV: SNegVO\nPrefixing vs suffixing: strongly suffixing\nCoding of nominal plurality: plural suffix\nGrammatical genders: no grammatical gender\n\n@inproceedings{dataset_en_vader,\n title={{VADER}: A Parsimonious Rule-Based Model for Sentiment Analysis of Social Media Text},\n author={Clayton J. Hutto and Eric Gilbert},\n booktitle={Proceedings of the International AAAI Conference on Web and Social Media},\n year={2014},\n url={https://ojs.aaai.org/index.php/ICWSM/article/view/14550},\n month={May}, \n pages={216-225},\n volume=8,\n}\n\n\n\n\n\nDomain: reviews\nLanguage: es\nLanguage family: Indo-European\nGenus: Romance\nDefinite articles: definite word distinct from demonstrative\nIndefinite articles: indefinite word same as one\nNumber of cases: no morphological case-making\nOrder of subject, object, verb: SVO\nNegative morphemes: negative particle\nPolar questions: interrogative word order\nPosition of negative word wrt SOV: SNegVO\nPrefixing vs suffixing: strongly suffixing\nCoding of nominal plurality: plural suffix\nGrammatical genders: masculine, feminine\n\n@article{dataset_es_muchocine,\n title={Experiments in sentiment classification of movie reviews in Spanish},\n author={Cruz, Fermin L and Troyano, Jose A and Enriquez, Fernando and Ortega, Javier},\n journal={Procesamiento del Lenguaje Natural},\n volume={41},\n pages={73--80},\n year={2008},\n publisher={SOC ESPANOLA PROCESAMIENTO LENGUAJE NATURAL-SEPLN DEPT LENGUAJES \\& SISTEMAS~…}\n}\n\n\n\n\n\nDomain: reviews\nLanguage: es\nLanguage family: Indo-European\nGenus: Romance\nDefinite articles: definite word distinct from demonstrative\nIndefinite articles: indefinite word same as one\nNumber of cases: no morphological case-making\nOrder of subject, object, verb: SVO\nNegative morphemes: negative particle\nPolar questions: interrogative word order\nPosition of negative word wrt SOV: SNegVO\nPrefixing vs suffixing: strongly suffixing\nCoding of nominal plurality: plural suffix\nGrammatical genders: masculine, feminine\n\n@inproceedings{dataset_multilan_amazon,\n title = \"The Multilingual {A}mazon Reviews Corpus\",\n author = {Keung, Phillip and\n Lu, Yichao and\n Szarvas, Gy{\\\"o}rgy and\n Smith, Noah A.},\n booktitle = \"Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP)\",\n month = nov,\n year = \"2020\",\n address = \"Online\",\n publisher = \"Association for Computational Linguistics\",\n url = \"https://aclanthology.org/2020.emnlp-main.369\",\n doi = \"10.18653/v1/2020.emnlp-main.369\",\n pages = \"4563--4568\",\n}\n\n\n\n\n\nDomain: reviews\nLanguage: es\nLanguage family: Indo-European\nGenus: Romance\nDefinite articles: definite word distinct from demonstrative\nIndefinite articles: indefinite word same as one\nNumber of cases: no morphological case-making\nOrder of subject, object, verb: SVO\nNegative morphemes: negative particle\nPolar questions: interrogative word order\nPosition of negative word wrt SOV: SNegVO\nPrefixing vs suffixing: strongly suffixing\nCoding of nominal plurality: plural suffix\nGrammatical genders: masculine, feminine\n\n@article{dataset_es_paper_reviews,\n author = {Keith Norambuena, Brian and Lettura, Exequiel and Villegas, Claudio},\n year = {2019},\n month = {02},\n pages = {191-214},\n title = {Sentiment analysis and opinion mining applied to scientific paper reviews},\n volume = {23},\n journal = {Intelligent Data Analysis},\n doi = {10.3233/IDA-173807}\n}\n\n\n\n\n\nDomain: social_media\nLanguage: es\nLanguage family: Indo-European\nGenus: Romance\nDefinite articles: definite word distinct from demonstrative\nIndefinite articles: indefinite word same as one\nNumber of cases: no morphological case-making\nOrder of subject, object, verb: SVO\nNegative morphemes: negative particle\nPolar questions: interrogative word order\nPosition of negative word wrt SOV: SNegVO\nPrefixing vs suffixing: strongly suffixing\nCoding of nominal plurality: plural suffix\nGrammatical genders: masculine, feminine\n\n@inproceedings{dataset_semeval_2020,\n title = \"{S}em{E}val-2020 Task 9: Overview of Sentiment Analysis of Code-Mixed Tweets\",\n author = {Patwa, Parth and\n Aguilar, Gustavo and\n Kar, Sudipta and\n Pandey, Suraj and\n PYKL, Srinivas and\n Gamb{\\\"a}ck, Bj{\\\"o}rn and\n Chakraborty, Tanmoy and\n Solorio, Thamar and\n Das, Amitava},\n booktitle = \"Proceedings of the Fourteenth Workshop on Semantic Evaluation\",\n month = dec,\n year = \"2020\",\n address = \"Barcelona (online)\",\n publisher = \"International Committee for Computational Linguistics\",\n url = \"https://aclanthology.org/2020.semeval-1.100\",\n doi = \"10.18653/v1/2020.semeval-1.100\",\n pages = \"774--790\",\n}\n\n\n\n\n\nDomain: social_media\nLanguage: es\nLanguage family: Indo-European\nGenus: Romance\nDefinite articles: definite word distinct from demonstrative\nIndefinite articles: indefinite word same as one\nNumber of cases: no morphological case-making\nOrder of subject, object, verb: SVO\nNegative morphemes: negative particle\nPolar questions: interrogative word order\nPosition of negative word wrt SOV: SNegVO\nPrefixing vs suffixing: strongly suffixing\nCoding of nominal plurality: plural suffix\nGrammatical genders: masculine, feminine\n\n@article{dataset_twitter_sentiment,\n doi = {10.1371/journal.pone.0155036},\n author = {Mozetič, Igor AND Grčar, Miha AND Smailović, Jasmina},\n journal = {PLOS ONE},\n publisher = {Public Library of Science},\n title = {Multilingual Twitter Sentiment Classification: The Role of Human Annotators},\n year = {2016},\n month = {05},\n volume = {11},\n url = {https://doi.org/10.1371/journal.pone.0155036},\n pages = {1-26},\n number = {5},\n}\n\n\n\n\n\nDomain: reviews\nLanguage: fa\nLanguage family: Indo-European\nGenus: Iranian\nDefinite articles: no article\nIndefinite articles: indefinite word same as one\nNumber of cases: 2\nOrder of subject, object, verb: SOV\nNegative morphemes: negative affix\nPolar questions: question particle\nPosition of negative word wrt SOV: MorphNeg\nPrefixing vs suffixing: weakly suffixing\nCoding of nominal plurality: plural suffix\nGrammatical genders: no grammatical gender\n\n@article{dataset_fa_sentipers,\n author = {Pedram Hosseini and\n Ali Ahmadian Ramaki and\n Hassan Maleki and\n Mansoureh Anvari and\n Seyed Abolghasem Mirroshandel},\n title = {{SentiPers}: {A} Sentiment Analysis Corpus for Persian},\n journal = {Computing Research Repository},\n volume = {arXiv:1801.07737},\n note = {Version 2},\n year = {2018},\n url = {http://arxiv.org/abs/1801.07737},\n eprinttype = {arXiv},\n eprint = {1801.07737},\n timestamp = {Mon, 13 Aug 2018 16:47:47 +0200},\n biburl = {https://dblp.org/rec/journals/corr/abs-1801-07737.bib},\n bibsource = {dblp computer science bibliography, https://dblp.org}\n}\n\n\n\n\n\nDomain: social_media\nLanguage: fr\nLanguage family: Indo-European\nGenus: Romance\nDefinite articles: definite word distinct from demonstrative\nIndefinite articles: indefinite word same as one\nNumber of cases: no morphological case-making\nOrder of subject, object, verb: SVO\nNegative morphemes: negative particle\nPolar questions: question particle\nPosition of negative word wrt SOV: OptDoubleNeg\nPrefixing vs suffixing: strongly suffixing\nCoding of nominal plurality: plural suffix\nGrammatical genders: masculine, feminine\n\n@inproceedings{dataset_dai_labor,\n author = {Narr, Sascha and Michael Hülfenhaus and Albayrak, Sahin},\n title = {Language-Independent Twitter Sentiment Analysis},\n booktitle = {Workshop on Knowledge Discovery, Data Mining and Machine Learning (KDML-2012)},\n year = {2012},\n location = {Dortmund, Germany},\n}\n\n\n\n\n\nDomain: social_media\nLanguage: fr\nLanguage family: Indo-European\nGenus: Romance\nDefinite articles: definite word distinct from demonstrative\nIndefinite articles: indefinite word same as one\nNumber of cases: no morphological case-making\nOrder of subject, object, verb: SVO\nNegative morphemes: negative particle\nPolar questions: question particle\nPosition of negative word wrt SOV: OptDoubleNeg\nPrefixing vs suffixing: strongly suffixing\nCoding of nominal plurality: plural suffix\nGrammatical genders: masculine, feminine\n\n@inproceedings{dataset_dai_labor,\n author = {Narr, Sascha and Michael Hülfenhaus and Albayrak, Sahin},\n title = {Language-Independent Twitter Sentiment Analysis},\n booktitle = {Workshop on Knowledge Discovery, Data Mining and Machine Learning (KDML-2012)},\n year = {2012},\n location = {Dortmund, Germany},\n}\n\n\n\n\n\nDomain: reviews\nLanguage: fr\nLanguage family: Indo-European\nGenus: Romance\nDefinite articles: definite word distinct from demonstrative\nIndefinite articles: indefinite word same as one\nNumber of cases: no morphological case-making\nOrder of subject, object, verb: SVO\nNegative morphemes: negative particle\nPolar questions: question particle\nPosition of negative word wrt SOV: OptDoubleNeg\nPrefixing vs suffixing: strongly suffixing\nCoding of nominal plurality: plural suffix\nGrammatical genders: masculine, feminine\n\n@inproceedings{dataset_multilan_amazon,\n title = \"The Multilingual {A}mazon Reviews Corpus\",\n author = {Keung, Phillip and\n Lu, Yichao and\n Szarvas, Gy{\\\"o}rgy and\n Smith, Noah A.},\n booktitle = \"Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP)\",\n month = nov,\n year = \"2020\",\n address = \"Online\",\n publisher = \"Association for Computational Linguistics\",\n url = \"https://aclanthology.org/2020.emnlp-main.369\",\n doi = \"10.18653/v1/2020.emnlp-main.369\",\n pages = \"4563--4568\",\n}\n\n\n\n\n\nDomain: social_media\nLanguage: he\nLanguage family: Afro-Asiatic\nGenus: Semitic\nDefinite articles: definite affix\nIndefinite articles: indefinite word same as one\nNumber of cases: no morphological case-making\nOrder of subject, object, verb: SVO\nNegative morphemes: negative particle\nPolar questions: question particle\nPosition of negative word wrt SOV: SNegVO\nPrefixing vs suffixing: weakly suffixing\nCoding of nominal plurality: plural suffix\nGrammatical genders: masculine, feminine\n\n@inproceedings{dataset_he_hebrew_sentiment,\n title = \"Representations and Architectures in Neural Sentiment Analysis for Morphologically Rich Languages: A Case Study from {M}odern {H}ebrew\",\n author = \"Amram, Adam and\n Ben David, Anat and\n Tsarfaty, Reut\",\n booktitle = \"Proceedings of the 27th International Conference on Computational Linguistics\",\n month = aug,\n year = \"2018\",\n address = \"Santa Fe, New Mexico, USA\",\n publisher = \"Association for Computational Linguistics\",\n url = \"https://aclanthology.org/C18-1190\",\n pages = \"2242--2252\",\n abstract = \"This paper empirically studies the effects of representation choices on neural sentiment analysis for Modern Hebrew, a morphologically rich language (MRL) for which no sentiment analyzer currently exists. We study two dimensions of representational choices: (i) the granularity of the input signal (token-based vs. morpheme-based), and (ii) the level of encoding of vocabulary items (string-based vs. character-based). We hypothesise that for MRLs, languages where multiple meaning-bearing elements may be carried by a single space-delimited token, these choices will have measurable effects on task perfromance, and that these effects may vary for different architectural designs {---} fully-connected, convolutional or recurrent. Specifically, we hypothesize that morpheme-based representations will have advantages in terms of their generalization capacity and task accuracy, due to their better OOV coverage. To empirically study these effects, we develop a new sentiment analysis benchmark for Hebrew, based on 12K social media comments, and provide two instances of these data: in token-based and morpheme-based settings. Our experiments show that representation choices empirical effects vary with architecture type. While fully-connected and convolutional networks slightly prefer token-based settings, RNNs benefit from a morpheme-based representation, in accord with the hypothesis that explicit morphological information may help generalize. Our endeavour also delivers the first state-of-the-art broad-coverage sentiment analyzer for Hebrew, with over 89{\\%} accuracy, alongside an established benchmark to further study the effects of linguistic representation choices on neural networks{'} task performance.\",\n}\n\n\n\n\n\nDomain: social_media\nLanguage: hi\nLanguage family: Indo-European\nGenus: Indic\nDefinite articles: no article\nIndefinite articles: no article\nNumber of cases: 3\nOrder of subject, object, verb: SOV\nNegative morphemes: negative particle\nPolar questions: question particle\nPosition of negative word wrt SOV: SONegV\nPrefixing vs suffixing: strongly suffixing\nCoding of nominal plurality: plural suffix\nGrammatical genders: masculine, feminine\n\n@inproceedings{dataset_semeval_2020,\n title = \"{S}em{E}val-2020 Task 9: Overview of Sentiment Analysis of Code-Mixed Tweets\",\n author = {Patwa, Parth and\n Aguilar, Gustavo and\n Kar, Sudipta and\n Pandey, Suraj and\n PYKL, Srinivas and\n Gamb{\\\"a}ck, Bj{\\\"o}rn and\n Chakraborty, Tanmoy and\n Solorio, Thamar and\n Das, Amitava},\n booktitle = \"Proceedings of the Fourteenth Workshop on Semantic Evaluation\",\n month = dec,\n year = \"2020\",\n address = \"Barcelona (online)\",\n publisher = \"International Committee for Computational Linguistics\",\n url = \"https://aclanthology.org/2020.semeval-1.100\",\n doi = \"10.18653/v1/2020.semeval-1.100\",\n pages = \"774--790\",\n}\n\n\n\n\n\nDomain: news\nLanguage: hr\nLanguage family: Indo-European\nGenus: Slavic\nDefinite articles: no article\nIndefinite articles: no article\nNumber of cases: 5\nOrder of subject, object, verb: SVO\nNegative morphemes: negative particle\nPolar questions: question particle\nPosition of negative word wrt SOV: other\nPrefixing vs suffixing: strongly suffixing\nCoding of nominal plurality: plural suffix\nGrammatical genders: masculine, feminine, neuter\n\n@Article{dataset_hr_sentiment_news_document,\n AUTHOR = {Pelicon, Andraž and Pranjić, Marko and Miljković, Dragana and Škrlj, Blaž and Pollak, Senja},\n TITLE = {Zero-Shot Learning for Cross-Lingual News Sentiment Classification},\n JOURNAL = {Applied Sciences},\n VOLUME = {10},\n YEAR = {2020},\n NUMBER = {17},\n ARTICLE-NUMBER = {5993},\n URL = {https://www.mdpi.com/2076-3417/10/17/5993},\n ISSN = {2076-3417},\n ABSTRACT = {In this paper, we address the task of zero-shot cross-lingual news sentiment classification. Given the annotated dataset of positive, neutral, and negative news in Slovene, the aim is to develop a news classification system that assigns the sentiment category not only to Slovene news, but to news in another language without any training data required. Our system is based on the multilingual BERTmodel, while we test different approaches for handling long documents and propose a novel technique for sentiment enrichment of the BERT model as an intermediate training step. With the proposed approach, we achieve state-of-the-art performance on the sentiment analysis task on Slovenian news. We evaluate the zero-shot cross-lingual capabilities of our system on a novel news sentiment test set in Croatian. The results show that the cross-lingual approach also largely outperforms the majority classifier, as well as all settings without sentiment enrichment in pre-training.},\n DOI = {10.3390/app10175993}\n}\n\n\n\n\n\nDomain: social_media\nLanguage: hr\nLanguage family: Indo-European\nGenus: Slavic\nDefinite articles: no article\nIndefinite articles: no article\nNumber of cases: 5\nOrder of subject, object, verb: SVO\nNegative morphemes: negative particle\nPolar questions: question particle\nPosition of negative word wrt SOV: other\nPrefixing vs suffixing: strongly suffixing\nCoding of nominal plurality: plural suffix\nGrammatical genders: masculine, feminine, neuter\n\n@article{dataset_twitter_sentiment,\n doi = {10.1371/journal.pone.0155036},\n author = {Mozetič, Igor AND Grčar, Miha AND Smailović, Jasmina},\n journal = {PLOS ONE},\n publisher = {Public Library of Science},\n title = {Multilingual Twitter Sentiment Classification: The Role of Human Annotators},\n year = {2016},\n month = {05},\n volume = {11},\n url = {https://doi.org/10.1371/journal.pone.0155036},\n pages = {1-26},\n number = {5},\n}\n\n\n\n\n\nDomain: social_media\nLanguage: hu\nLanguage family: Uralic\nGenus: Ugric\nDefinite articles: definite word distinct from demonstrative\nIndefinite articles: indefinite word distinct from one\nNumber of cases: 10 or more\nOrder of subject, object, verb: no dominant order\nNegative morphemes: negative particle\nPolar questions: question particle\nPosition of negative word wrt SOV: SNegVO\nPrefixing vs suffixing: strongly suffixing\nCoding of nominal plurality: plural suffix\nGrammatical genders: no grammatical gender\n\n@article{dataset_twitter_sentiment,\n doi = {10.1371/journal.pone.0155036},\n author = {Mozetič, Igor AND Grčar, Miha AND Smailović, Jasmina},\n journal = {PLOS ONE},\n publisher = {Public Library of Science},\n title = {Multilingual Twitter Sentiment Classification: The Role of Human Annotators},\n year = {2016},\n month = {05},\n volume = {11},\n url = {https://doi.org/10.1371/journal.pone.0155036},\n pages = {1-26},\n number = {5},\n}\n\n\n\n\n\nDomain: social_media\nLanguage: it\nLanguage family: Indo-European\nGenus: Romance\nDefinite articles: definite word distinct from demonstrative\nIndefinite articles: indefinite word same as one\nNumber of cases: no morphological case-making\nOrder of subject, object, verb: SVO\nNegative morphemes: negative particle\nPolar questions: interrogative intonation only\nPosition of negative word wrt SOV: SNegVO\nPrefixing vs suffixing: strongly suffixing\nCoding of nominal plurality: plural suffix\nGrammatical genders: masculine, feminine\n\n@inproceedings{dataset_it_evalita2016,\n TITLE = {{Overview of the Evalita 2016 SENTIment POLarity Classification Task}},\n AUTHOR = {Barbieri, Francesco and Basile, Valerio and Croce, Danilo and Nissim, Malvina and Novielli, Nicole and Patti, Viviana},\n URL = {https://hal.inria.fr/hal-01414731},\n BOOKTITLE = {{Proceedings of Third Italian Conference on Computational Linguistics (CLiC-it 2016) \\& Fifth Evaluation Campaign of Natural Language Processing and Speech Tools for Italian. Final Workshop (EVALITA 2016)}},\n ADDRESS = {Naples, Italy},\n YEAR = {2016},\n MONTH = Dec,\n KEYWORDS = {Natural language processing and web ; Social media analysis ; Sentiment analysis},\n PDF = {https://hal.inria.fr/hal-01414731/file/paper_026.pdf},\n HAL_ID = {hal-01414731},\n HAL_VERSION = {v1},\n}\n\n\n\n\n\nDomain: social_media\nLanguage: it\nLanguage family: Indo-European\nGenus: Romance\nDefinite articles: definite word distinct from demonstrative\nIndefinite articles: indefinite word same as one\nNumber of cases: no morphological case-making\nOrder of subject, object, verb: SVO\nNegative morphemes: negative particle\nPolar questions: interrogative intonation only\nPosition of negative word wrt SOV: SNegVO\nPrefixing vs suffixing: strongly suffixing\nCoding of nominal plurality: plural suffix\nGrammatical genders: masculine, feminine\n\n@inproceedings{dataset_it_multiemotions,\n author = {Sprugnoli, Rachele},\n year = {2020},\n month = {12},\n pages = {},\n title = {MultiEmotions-It: a New Dataset for Opinion Polarity and Emotion Analysis for Italian},\n booktitle = {Proceedings of the Seventh Italian Conference on Computational Linguistics},\n}\n\n\n\n\n\nDomain: reviews\nLanguage: ja\nLanguage family: Japanese\nGenus: Japanese\nDefinite articles: no article\nIndefinite articles: indefinite word distinct from one\nNumber of cases: 8-9\nOrder of subject, object, verb: SOV\nNegative morphemes: negative affix\nPolar questions: question particle\nPosition of negative word wrt SOV: MorphNeg\nPrefixing vs suffixing: strongly suffixing\nCoding of nominal plurality: plural suffix\nGrammatical genders: no grammatical gender\n\n@inproceedings{dataset_multilan_amazon,\n title = \"The Multilingual {A}mazon Reviews Corpus\",\n author = {Keung, Phillip and\n Lu, Yichao and\n Szarvas, Gy{\\\"o}rgy and\n Smith, Noah A.},\n booktitle = \"Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP)\",\n month = nov,\n year = \"2020\",\n address = \"Online\",\n publisher = \"Association for Computational Linguistics\",\n url = \"https://aclanthology.org/2020.emnlp-main.369\",\n doi = \"10.18653/v1/2020.emnlp-main.369\",\n pages = \"4563--4568\",\n}\n\n\n\n\n\nDomain: social_media\nLanguage: lv\nLanguage family: Indo-European\nGenus: Baltic\nDefinite articles: demonstrative word used as definite article\nIndefinite articles: indefinite word same as one\nNumber of cases: 5\nOrder of subject, object, verb: SVO\nNegative morphemes: negative affix\nPolar questions: question particle\nPosition of negative word wrt SOV: MorphNeg\nPrefixing vs suffixing: weakly suffixing\nCoding of nominal plurality: plural suffix\nGrammatical genders: masculine, feminine\n\n@article{dataset_lv_ltec_sentiment,\n author = {Uga Sprogis and\n Matiss Rikters},\n title = {What Can We Learn From Almost a Decade of Food Tweets},\n journal = {Computing Research Repository},\n volume = {arXiv:2007.05194},\n note = {Version 2},\n year = {2020},\n url = {https://arxiv.org/abs/2007.05194},\n eprinttype = {arXiv},\n eprint = {2007.05194},\n timestamp = {Mon, 20 Jul 2020 14:20:39 +0200},\n biburl = {https://dblp.org/rec/journals/corr/abs-2007-05194.bib},\n bibsource = {dblp computer science bibliography, https://dblp.org}\n}\n\n\n\n\n\nDomain: reviews\nLanguage: pl\nLanguage family: Indo-European\nGenus: Slavic\nDefinite articles: no article\nIndefinite articles: no article\nNumber of cases: 6-7\nOrder of subject, object, verb: SVO\nNegative morphemes: negative particle\nPolar questions: question particle\nPosition of negative word wrt SOV: SNegVO\nPrefixing vs suffixing: strongly suffixing\nCoding of nominal plurality: plural suffix\nGrammatical genders: masculine, feminine, neuter\n\n@inproceedings{dataset_pl_klej_allegro_reviews,\n title = \"{KLEJ}: Comprehensive Benchmark for {P}olish Language Understanding\",\n author = \"Rybak, Piotr and\n Mroczkowski, Robert and\n Tracz, Janusz and\n Gawlik, Ireneusz\",\n booktitle = \"Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics\",\n month = jul,\n year = \"2020\",\n address = \"Online\",\n publisher = \"Association for Computational Linguistics\",\n url = \"https://aclanthology.org/2020.acl-main.111\",\n doi = \"10.18653/v1/2020.acl-main.111\",\n pages = \"1191--1201\",\n}\n\n\n\n\n\nDomain: social_media\nLanguage: pl\nLanguage family: Indo-European\nGenus: Slavic\nDefinite articles: no article\nIndefinite articles: no article\nNumber of cases: 6-7\nOrder of subject, object, verb: SVO\nNegative morphemes: negative particle\nPolar questions: question particle\nPosition of negative word wrt SOV: SNegVO\nPrefixing vs suffixing: strongly suffixing\nCoding of nominal plurality: plural suffix\nGrammatical genders: masculine, feminine, neuter\n\n@article{dataset_pl_opi_lil_2012,\n author = {Pawel Sobkowicz and Antoni Sobkowicz},\n title ={Two-Year Study of Emotion and Communication Patterns in a Highly Polarized Political Discussion Forum},\n journal = {Social Science Computer Review},\n volume = {30},\n number = {4},\n pages = {448-469},\n year = {2012},\n doi = {10.1177/0894439312436512}\n}\n\n\n\n\n\nDomain: reviews\nLanguage: pl\nLanguage family: Indo-European\nGenus: Slavic\nDefinite articles: no article\nIndefinite articles: no article\nNumber of cases: 6-7\nOrder of subject, object, verb: SVO\nNegative morphemes: negative particle\nPolar questions: question particle\nPosition of negative word wrt SOV: SNegVO\nPrefixing vs suffixing: strongly suffixing\nCoding of nominal plurality: plural suffix\nGrammatical genders: masculine, feminine, neuter\n\n@inproceedings{dataset_pl_polemo,\n title = \"Multi-Level Sentiment Analysis of {P}ol{E}mo 2.0: Extended Corpus of Multi-Domain Consumer Reviews\",\n author = \"Koco{\\'n}, Jan and\n Mi{\\l}kowski, Piotr and\n Za{\\'s}ko-Zieli{\\'n}ska, Monika\",\n booktitle = \"Proceedings of the 23rd Conference on Computational Natural Language Learning (CoNLL)\",\n month = nov,\n year = \"2019\",\n address = \"Hong Kong, China\",\n publisher = \"Association for Computational Linguistics\",\n url = \"https://aclanthology.org/K19-1092\",\n doi = \"10.18653/v1/K19-1092\",\n pages = \"980--991\"\n}\n\n\n\n\n\nDomain: social_media\nLanguage: pl\nLanguage family: Indo-European\nGenus: Slavic\nDefinite articles: no article\nIndefinite articles: no article\nNumber of cases: 6-7\nOrder of subject, object, verb: SVO\nNegative morphemes: negative particle\nPolar questions: question particle\nPosition of negative word wrt SOV: SNegVO\nPrefixing vs suffixing: strongly suffixing\nCoding of nominal plurality: plural suffix\nGrammatical genders: masculine, feminine, neuter\n\n@article{dataset_twitter_sentiment,\n doi = {10.1371/journal.pone.0155036},\n author = {Mozetič, Igor AND Grčar, Miha AND Smailović, Jasmina},\n journal = {PLOS ONE},\n publisher = {Public Library of Science},\n title = {Multilingual Twitter Sentiment Classification: The Role of Human Annotators},\n year = {2016},\n month = {05},\n volume = {11},\n url = {https://doi.org/10.1371/journal.pone.0155036},\n pages = {1-26},\n number = {5},\n}\n\n\n\n\n\nDomain: social_media\nLanguage: pt\nLanguage family: Indo-European\nGenus: Romance\nDefinite articles: definite word distinct from demonstrative\nIndefinite articles: indefinite word same as one\nNumber of cases: no morphological case-making\nOrder of subject, object, verb: SVO\nNegative morphemes: negative particle\nPolar questions: question particle\nPosition of negative word wrt SOV: SNegVO\nPrefixing vs suffixing: strongly suffixing\nCoding of nominal plurality: plural suffix\nGrammatical genders: masculine, feminine\n\n@inproceedings{dataset_dai_labor,\n author = {Narr, Sascha and Michael Hülfenhaus and Albayrak, Sahin},\n title = {Language-Independent Twitter Sentiment Analysis},\n booktitle = {Workshop on Knowledge Discovery, Data Mining and Machine Learning (KDML-2012)},\n year = {2012},\n location = {Dortmund, Germany},\n}\n\n\n\n\n\nDomain: social_media\nLanguage: pt\nLanguage family: Indo-European\nGenus: Romance\nDefinite articles: definite word distinct from demonstrative\nIndefinite articles: indefinite word same as one\nNumber of cases: no morphological case-making\nOrder of subject, object, verb: SVO\nNegative morphemes: negative particle\nPolar questions: question particle\nPosition of negative word wrt SOV: SNegVO\nPrefixing vs suffixing: strongly suffixing\nCoding of nominal plurality: plural suffix\nGrammatical genders: masculine, feminine\n\n@inproceedings{dataset_dai_labor,\n author = {Narr, Sascha and Michael Hülfenhaus and Albayrak, Sahin},\n title = {Language-Independent Twitter Sentiment Analysis},\n booktitle = {Workshop on Knowledge Discovery, Data Mining and Machine Learning (KDML-2012)},\n year = {2012},\n location = {Dortmund, Germany},\n}\n\n\n\n\n\nDomain: social_media\nLanguage: pt\nLanguage family: Indo-European\nGenus: Romance\nDefinite articles: definite word distinct from demonstrative\nIndefinite articles: indefinite word same as one\nNumber of cases: no morphological case-making\nOrder of subject, object, verb: SVO\nNegative morphemes: negative particle\nPolar questions: question particle\nPosition of negative word wrt SOV: SNegVO\nPrefixing vs suffixing: strongly suffixing\nCoding of nominal plurality: plural suffix\nGrammatical genders: masculine, feminine\n\n@inproceedings{dataset_pt_tweet_sent_br,\n title = \"Building a Sentiment Corpus of Tweets in {B}razilian {P}ortuguese\",\n author = \"Brum, Henrico and\n Volpe Nunes, Maria das Gra{\\c{c}}as\",\n booktitle = \"Proceedings of the Eleventh International Conference on Language Resources and Evaluation ({LREC} 2018)\",\n month = may,\n year = \"2018\",\n address = \"Miyazaki, Japan\",\n publisher = \"European Language Resources Association (ELRA)\",\n url = \"https://aclanthology.org/L18-1658\",\n}\n\n\n\n\n\nDomain: social_media\nLanguage: pt\nLanguage family: Indo-European\nGenus: Romance\nDefinite articles: definite word distinct from demonstrative\nIndefinite articles: indefinite word same as one\nNumber of cases: no morphological case-making\nOrder of subject, object, verb: SVO\nNegative morphemes: negative particle\nPolar questions: question particle\nPosition of negative word wrt SOV: SNegVO\nPrefixing vs suffixing: strongly suffixing\nCoding of nominal plurality: plural suffix\nGrammatical genders: masculine, feminine\n\n@article{dataset_twitter_sentiment,\n doi = {10.1371/journal.pone.0155036},\n author = {Mozetič, Igor AND Grčar, Miha AND Smailović, Jasmina},\n journal = {PLOS ONE},\n publisher = {Public Library of Science},\n title = {Multilingual Twitter Sentiment Classification: The Role of Human Annotators},\n year = {2016},\n month = {05},\n volume = {11},\n url = {https://doi.org/10.1371/journal.pone.0155036},\n pages = {1-26},\n number = {5},\n}\n\n\n\n\n\nDomain: social_media\nLanguage: ru\nLanguage family: Indo-European\nGenus: Slavic\nDefinite articles: no article\nIndefinite articles: no article\nNumber of cases: 6-7\nOrder of subject, object, verb: SVO\nNegative morphemes: negative particle\nPolar questions: question particle\nPosition of negative word wrt SOV: SNegVO\nPrefixing vs suffixing: strongly suffixing\nCoding of nominal plurality: plural suffix\nGrammatical genders: masculine, feminine, neuter\n\n@inproceedings{dataset_ru_sentiment,\n title = \"{R}u{S}entiment: An Enriched Sentiment Analysis Dataset for Social Media in {R}ussian\",\n author = \"Rogers, Anna and\n Romanov, Alexey and\n Rumshisky, Anna and\n Volkova, Svitlana and\n Gronas, Mikhail and\n Gribov, Alex\",\n booktitle = \"Proceedings of the 27th International Conference on Computational Linguistics\",\n month = aug,\n year = \"2018\",\n address = \"Santa Fe, New Mexico, USA\",\n publisher = \"Association for Computational Linguistics\",\n url = \"https://aclanthology.org/C18-1064\",\n pages = \"755--763\",\n abstract = \"This paper presents RuSentiment, a new dataset for sentiment analysis of social media posts in Russian, and a new set of comprehensive annotation guidelines that are extensible to other languages. RuSentiment is currently the largest in its class for Russian, with 31,185 posts annotated with Fleiss{'} kappa of 0.58 (3 annotations per post). To diversify the dataset, 6,950 posts were pre-selected with an active learning-style strategy. We report baseline classification results, and we also release the best-performing embeddings trained on 3.2B tokens of Russian VKontakte posts.\",\n}\n\n\n\n\n\nDomain: social_media\nLanguage: ru\nLanguage family: Indo-European\nGenus: Slavic\nDefinite articles: no article\nIndefinite articles: no article\nNumber of cases: 6-7\nOrder of subject, object, verb: SVO\nNegative morphemes: negative particle\nPolar questions: question particle\nPosition of negative word wrt SOV: SNegVO\nPrefixing vs suffixing: strongly suffixing\nCoding of nominal plurality: plural suffix\nGrammatical genders: masculine, feminine, neuter\n\n@article{dataset_twitter_sentiment,\n doi = {10.1371/journal.pone.0155036},\n author = {Mozetič, Igor AND Grčar, Miha AND Smailović, Jasmina},\n journal = {PLOS ONE},\n publisher = {Public Library of Science},\n title = {Multilingual Twitter Sentiment Classification: The Role of Human Annotators},\n year = {2016},\n month = {05},\n volume = {11},\n url = {https://doi.org/10.1371/journal.pone.0155036},\n pages = {1-26},\n number = {5},\n}\n\n\n\n\n\nDomain: social_media\nLanguage: sk\nLanguage family: Indo-European\nGenus: Slavic\nDefinite articles: no article\nIndefinite articles: no article\nNumber of cases: 6-7\nOrder of subject, object, verb: SVO\nNegative morphemes: negative affix\nPolar questions: interrogative word order\nPosition of negative word wrt SOV: MorphNeg\nPrefixing vs suffixing: weakly suffixing\nCoding of nominal plurality: plural suffix\nGrammatical genders: masculine, feminine, neuter\n\n@article{dataset_twitter_sentiment,\n doi = {10.1371/journal.pone.0155036},\n author = {Mozetič, Igor AND Grčar, Miha AND Smailović, Jasmina},\n journal = {PLOS ONE},\n publisher = {Public Library of Science},\n title = {Multilingual Twitter Sentiment Classification: The Role of Human Annotators},\n year = {2016},\n month = {05},\n volume = {11},\n url = {https://doi.org/10.1371/journal.pone.0155036},\n pages = {1-26},\n number = {5},\n}\n\n\n\n\n\nDomain: news\nLanguage: sl\nLanguage family: Indo-European\nGenus: Slavic\nDefinite articles: no article\nIndefinite articles: no article\nNumber of cases: 6-7\nOrder of subject, object, verb: SVO\nNegative morphemes: negative particle\nPolar questions: question particle\nPosition of negative word wrt SOV: SNegVO\nPrefixing vs suffixing: strongly suffixing\nCoding of nominal plurality: plural suffix\nGrammatical genders: masculine, feminine, neuter\n\n@Article{Bučar2018,\n author={Bu{\\v{c}}ar, Jo{\\v{z}}e\n and {\\v{Z}}nidar{\\v{s}}i{\\v{c}}, Martin\n and Povh, Janez},\n title={Annotated news corpora and a lexicon for sentiment analysis in Slovene},\n journal={Language Resources and Evaluation},\n year={2018},\n month={Sep},\n day={01},\n volume={52},\n number={3},\n pages={895-919},\n abstract={In this study, we introduce Slovene web-crawled news corpora with sentiment annotation on three levels of granularity: sentence, paragraph and document levels. We describe the methodology and tools that were required for their construction. The corpora contain more than 250,000 documents with political, business, economic and financial content from five Slovene media resources on the web. More than 10,000 of them were manually annotated as negative, neutral or positive. All corpora are publicly available under a Creative Commons copyright license. We used the annotated documents to construct a Slovene sentiment lexicon, which is the first of its kind for Slovene, and to assess the sentiment classification approaches used. The constructed corpora were also utilised to monitor within-the-document sentiment dynamics, its changes over time and relations with news topics. We show that sentiment is, on average, more explicit at the beginning of documents, and it loses sharpness towards the end of documents.},\n issn={1574-0218},\n doi={10.1007/s10579-018-9413-3},\n url={https://doi.org/10.1007/s10579-018-9413-3}\n}\n\n\n\n\n\nDomain: social_media\nLanguage: sl\nLanguage family: Indo-European\nGenus: Slavic\nDefinite articles: no article\nIndefinite articles: no article\nNumber of cases: 6-7\nOrder of subject, object, verb: SVO\nNegative morphemes: negative particle\nPolar questions: question particle\nPosition of negative word wrt SOV: SNegVO\nPrefixing vs suffixing: strongly suffixing\nCoding of nominal plurality: plural suffix\nGrammatical genders: masculine, feminine, neuter\n\n@article{dataset_twitter_sentiment,\n doi = {10.1371/journal.pone.0155036},\n author = {Mozetič, Igor AND Grčar, Miha AND Smailović, Jasmina},\n journal = {PLOS ONE},\n publisher = {Public Library of Science},\n title = {Multilingual Twitter Sentiment Classification: The Role of Human Annotators},\n year = {2016},\n month = {05},\n volume = {11},\n url = {https://doi.org/10.1371/journal.pone.0155036},\n pages = {1-26},\n number = {5},\n}\n\n\n\n\n\nDomain: social_media\nLanguage: sq\nLanguage family: Indo-European\nGenus: Albanian\nDefinite articles: definite affix\nIndefinite articles: indefinite word distinct from one\nNumber of cases: 4\nOrder of subject, object, verb: SVO\nNegative morphemes: negative particle\nPolar questions: question particle\nPosition of negative word wrt SOV: SNegVO\nPrefixing vs suffixing: strongly suffixing\nCoding of nominal plurality: plural suffix\nGrammatical genders: masculine, feminine\n\n@article{dataset_twitter_sentiment,\n doi = {10.1371/journal.pone.0155036},\n author = {Mozetič, Igor AND Grčar, Miha AND Smailović, Jasmina},\n journal = {PLOS ONE},\n publisher = {Public Library of Science},\n title = {Multilingual Twitter Sentiment Classification: The Role of Human Annotators},\n year = {2016},\n month = {05},\n volume = {11},\n url = {https://doi.org/10.1371/journal.pone.0155036},\n pages = {1-26},\n number = {5},\n}\n\n\n\n\n\nDomain: reviews\nLanguage: sr\nLanguage family: Indo-European\nGenus: Slavic\nDefinite articles: no article\nIndefinite articles: no article\nNumber of cases: 5\nOrder of subject, object, verb: SVO\nNegative morphemes: negative particle\nPolar questions: question particle\nPosition of negative word wrt SOV: other\nPrefixing vs suffixing: strongly suffixing\nCoding of nominal plurality: plural suffix\nGrammatical genders: masculine, feminine, neuter\n\n@inproceedings{dataset_sr_serb_movie_reviews,\n title = \"Reliable Baselines for Sentiment Analysis in Resource-Limited Languages: The {S}erbian Movie Review Dataset\",\n author = \"Batanovi{\\'c}, Vuk and\n Nikoli{\\'c}, Bo{\\v{s}}ko and\n Milosavljevi{\\'c}, Milan\",\n booktitle = \"Proceedings of the Tenth International Conference on Language Resources and Evaluation ({LREC}'16)\",\n month = may,\n year = \"2016\",\n address = \"Portoro{\\v{z}}, Slovenia\",\n publisher = \"European Language Resources Association (ELRA)\",\n url = \"https://aclanthology.org/L16-1427\",\n pages = \"2688--2696\",\n abstract = \"Collecting data for sentiment analysis in resource-limited languages carries a significant risk of sample selection bias, since the small quantities of available data are most likely not representative of the whole population. Ignoring this bias leads to less robust machine learning classifiers and less reliable evaluation results. In this paper we present a dataset balancing algorithm that minimizes the sample selection bias by eliminating irrelevant systematic differences between the sentiment classes. We prove its superiority over the random sampling method and we use it to create the Serbian movie review dataset ― SerbMR ― the first balanced and topically uniform sentiment analysis dataset in Serbian. In addition, we propose an incremental way of finding the optimal combination of simple text processing options and machine learning features for sentiment classification. Several popular classifiers are used in conjunction with this evaluation approach in order to establish strong but reliable baselines for sentiment analysis in Serbian.\",\n}\n\n\n\n\n\nDomain: reviews\nLanguage: sr\nLanguage family: Indo-European\nGenus: Slavic\nDefinite articles: no article\nIndefinite articles: no article\nNumber of cases: 5\nOrder of subject, object, verb: SVO\nNegative morphemes: negative particle\nPolar questions: question particle\nPosition of negative word wrt SOV: other\nPrefixing vs suffixing: strongly suffixing\nCoding of nominal plurality: plural suffix\nGrammatical genders: masculine, feminine, neuter\n\n@article{dataset_sr_senticomments,\n doi = {10.1371/journal.pone.0242050},\n author = {Batanović, Vuk AND Cvetanović, Miloš AND Nikolić, Boško},\n journal = {PLOS ONE},\n publisher = {Public Library of Science},\n title = {A versatile framework for resource-limited sentiment articulation, annotation, and analysis of short texts},\n year = {2020},\n month = {11},\n volume = {15},\n url = {https://doi.org/10.1371/journal.pone.0242050},\n pages = {1-30},\n abstract = {Choosing a comprehensive and cost-effective way of articulating and annotating the sentiment of a text is not a trivial task, particularly when dealing with short texts, in which sentiment can be expressed through a wide variety of linguistic and rhetorical phenomena. This problem is especially conspicuous in resource-limited settings and languages, where design options are restricted either in terms of manpower and financial means required to produce appropriate sentiment analysis resources, or in terms of available language tools, or both. In this paper, we present a versatile approach to addressing this issue, based on multiple interpretations of sentiment labels that encode information regarding the polarity, subjectivity, and ambiguity of a text, as well as the presence of sarcasm or a mixture of sentiments. We demonstrate its use on Serbian, a resource-limited language, via the creation of a main sentiment analysis dataset focused on movie comments, and two smaller datasets belonging to the movie and book domains. In addition to measuring the quality of the annotation process, we propose a novel metric to validate its cost-effectiveness. Finally, the practicality of our approach is further validated by training, evaluating, and determining the optimal configurations of several different kinds of machine-learning models on a range of sentiment classification tasks using the produced dataset.},\n number = {11},\n}\n\n\n\n\n\nDomain: social_media\nLanguage: sr\nLanguage family: Indo-European\nGenus: Slavic\nDefinite articles: no article\nIndefinite articles: no article\nNumber of cases: 5\nOrder of subject, object, verb: SVO\nNegative morphemes: negative particle\nPolar questions: question particle\nPosition of negative word wrt SOV: other\nPrefixing vs suffixing: strongly suffixing\nCoding of nominal plurality: plural suffix\nGrammatical genders: masculine, feminine, neuter\n\n@article{dataset_twitter_sentiment,\n doi = {10.1371/journal.pone.0155036},\n author = {Mozetič, Igor AND Grčar, Miha AND Smailović, Jasmina},\n journal = {PLOS ONE},\n publisher = {Public Library of Science},\n title = {Multilingual Twitter Sentiment Classification: The Role of Human Annotators},\n year = {2016},\n month = {05},\n volume = {11},\n url = {https://doi.org/10.1371/journal.pone.0155036},\n pages = {1-26},\n number = {5},\n}\n\n\n\n\n\nDomain: social_media\nLanguage: sv\nLanguage family: Indo-European\nGenus: Germanic\nDefinite articles: definite affix\nIndefinite articles: indefinite word same as one\nNumber of cases: 2\nOrder of subject, object, verb: SVO\nNegative morphemes: negative particle\nPolar questions: interrogative word order\nPosition of negative word wrt SOV: more than one position\nPrefixing vs suffixing: strongly suffixing\nCoding of nominal plurality: plural suffix\nGrammatical genders: common, neuter\n\n@article{dataset_twitter_sentiment,\n doi = {10.1371/journal.pone.0155036},\n author = {Mozetič, Igor AND Grčar, Miha AND Smailović, Jasmina},\n journal = {PLOS ONE},\n publisher = {Public Library of Science},\n title = {Multilingual Twitter Sentiment Classification: The Role of Human Annotators},\n year = {2016},\n month = {05},\n volume = {11},\n url = {https://doi.org/10.1371/journal.pone.0155036},\n pages = {1-26},\n number = {5},\n}\n\n\n\n\n\nDomain: social_media\nLanguage: th\nLanguage family: Tai-Kadai\nGenus: Kam-Tai\nDefinite articles: no article\nIndefinite articles: indefinite word distinct from one\nNumber of cases: no morphological case-making\nOrder of subject, object, verb: SVO\nNegative morphemes: negative auxiliary verb\nPolar questions: question particle\nPosition of negative word wrt SOV: SNegVO\nPrefixing vs suffixing: little affixation\nCoding of nominal plurality: mixed morphological plural\nGrammatical genders: noun classifiers\n\n@misc{dataset_th_wisesight_sentiment,\n author = {Suriyawongkul, Arthit and\n Chuangsuwanich, Ekapol and\n Chormai, Pattarawat and\n Polpanumas, Charin},\n title = {PyThaiNLP/wisesight-sentiment: First release (v1.0)},\n month = sep,\n year = 2019,\n publisher = {Zenodo},\n version = {v1.0},\n doi = {10.5281/zenodo.3457447},\n url = {https://doi.org/10.5281/zenodo.3457447},\n note = {Zenodo}\n}\n\n\n\n\n\nDomain: reviews\nLanguage: th\nLanguage family: Tai-Kadai\nGenus: Kam-Tai\nDefinite articles: no article\nIndefinite articles: indefinite word distinct from one\nNumber of cases: no morphological case-making\nOrder of subject, object, verb: SVO\nNegative morphemes: negative auxiliary verb\nPolar questions: question particle\nPosition of negative word wrt SOV: SNegVO\nPrefixing vs suffixing: little affixation\nCoding of nominal plurality: mixed morphological plural\nGrammatical genders: noun classifiers\n\n@misc{dataset_th_wongnai_reviews,\n author = {Ekkalak Thongthanomkul and Tanapol Nearunchorn and Yuwat Chuesathuchon},\n title = {wongnai-corpus},\n year = {2019},\n publisher = {GitHub},\n journal = {GitHub repository},\n howpublished = {\\url{https://github.com/wongnai/wongnai-corpus}}\n}\n\n\n\n\n\nDomain: mixed\nLanguage: ur\nLanguage family: Indo-European\nGenus: Indic\nDefinite articles: no article\nIndefinite articles: no article\nNumber of cases: 2\nOrder of subject, object, verb: SOV\nNegative morphemes: negative affix\nPolar questions: question particle\nPosition of negative word wrt SOV: SONegV\nPrefixing vs suffixing: strongly suffixing\nCoding of nominal plurality: plural suffix\nGrammatical genders: masculine, feminine\n\n@InProceedings{dataset_ur_roman_urdu,\n title = \"Performing Natural Language Processing on Roman Urdu Datasets\",\n author = \"Zareen Sharf and Saif Ur Rahman\",\n booktitle = \"International Journal of Computer Science and Network Security\",\n volume = \"18\",\n pages = \"141-148\",\n year = \"2018\",\n url = {http://paper.ijcsns.org/07_book/201801/20180117.pdf}\n}\n\n\n\n\n\nDomain: reviews\nLanguage: zh\nLanguage family: Sino-Tibetan\nGenus: Chinese\nDefinite articles: no article\nIndefinite articles: indefinite word same as one\nNumber of cases: no morphological case-making\nOrder of subject, object, verb: SVO\nNegative morphemes: negative particle\nPolar questions: question particle\nPosition of negative word wrt SOV: SNegVO\nPrefixing vs suffixing: little affixation\nCoding of nominal plurality: no plural\nGrammatical genders: noun classifiers\n\n@inproceedings{dataset_zh_hotel_reviews,\n title = \"An Empirical Study on Sentiment Classification of {C}hinese Review using Word Embedding\",\n author = \"Lin, Yiou and\n Lei, Hang and\n Wu, Jia and\n Li, Xiaoyu\",\n booktitle = \"Proceedings of the 29th Pacific Asia Conference on Language, Information and Computation: Posters\",\n month = oct,\n year = \"2015\",\n address = \"Shanghai, China\",\n url = \"https://aclanthology.org/Y15-2030\",\n pages = \"258--266\",\n}\n\n\n\n\nDomain: reviews\nLanguage: zh\nLanguage family: Sino-Tibetan\nGenus: Chinese\nDefinite articles: no article\nIndefinite articles: indefinite word same as one\nNumber of cases: no morphological case-making\nOrder of subject, object, verb: SVO\nNegative morphemes: negative particle\nPolar questions: question particle\nPosition of negative word wrt SOV: SNegVO\nPrefixing vs suffixing: little affixation\nCoding of nominal plurality: no plural\nGrammatical genders: noun classifiers\n\n@inproceedings{dataset_multilan_amazon,\n title = \"The Multilingual {A}mazon Reviews Corpus\",\n author = {Keung, Phillip and\n Lu, Yichao and\n Szarvas, Gy{\\\"o}rgy and\n Smith, Noah A.},\n booktitle = \"Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP)\",\n month = nov,\n year = \"2020\",\n address = \"Online\",\n publisher = \"Association for Computational Linguistics\",\n url = \"https://aclanthology.org/2020.emnlp-main.369\",\n doi = \"10.18653/v1/2020.emnlp-main.369\",\n pages = \"4563--4568\",\n}"
+ },
+ {
+ "objectID": "index.html",
+ "href": "index.html",
+ "title": "MMS Dataset and Benchmark",
+ "section": "",
+ "text": "Despite impressive advancements in multilingual corpora collection and model training, developing large-scale deployments of multilingual models still presents a significant challenge. This is particularly true for language tasks that are culture-dependent. One such example is the area of multilingual sentiment analysis, where affective markers can be subtle and deeply ensconced in culture.\nThis work presents the most extensive open massively multilingual corpus of datasets for training sentiment models. The corpus consists of 79 manually selected datasets from over 350 datasets reported in the scientific literature based on strict quality criteria. The corpus covers 27 languages representing 6 language families. Datasets can be queried using several linguistic and functional features. In addition, we present a multi-faceted sentiment classification benchmark summarizing hundreds of experiments conducted on different base models, training objectives, dataset collections, and fine-tuning strategies."
+ },
+ {
+ "objectID": "index.html#dataset",
+ "href": "index.html#dataset",
+ "title": "MMS Dataset and Benchmark",
+ "section": "Dataset",
+ "text": "Dataset\nMassively Multilingual Sentiment Datasets"
+ },
+ {
+ "objectID": "index.html#analysis-and-benchmarking",
+ "href": "index.html#analysis-and-benchmarking",
+ "title": "MMS Dataset and Benchmark",
+ "section": "Analysis and benchmarking",
+ "text": "Analysis and benchmarking\nHuggingFace Spaces with Analysis and Benchmark"
+ },
+ {
+ "objectID": "index.html#general-statistics-about-the-dataset",
+ "href": "index.html#general-statistics-about-the-dataset",
+ "title": "MMS Dataset and Benchmark",
+ "section": "General statistics about the dataset",
+ "text": "General statistics about the dataset\n\nIt may take some time to download the dataset and generate train set inside HuggingFace dataset. Please be patient.\n\n\nmms_dataset = datasets.load_dataset(\"Brand24/mms\")\n\n\nmms_dataset_df = mms_dataset[\"train\"].to_pandas()\n\nHow many examples do we have?\n\nmms_dataset.num_rows\n\n{'train': 6164762}"
+ },
+ {
+ "objectID": "index.html#features",
+ "href": "index.html#features",
+ "title": "MMS Dataset and Benchmark",
+ "section": "Features",
+ "text": "Features\nWe provide not only texts and sentiment labels but we assigned many additional dimensions for datasets and languages, hence it is possible to splice and dice them as you want and need.\n\nmms_dataset[\"train\"].features\n\n{'_id': Value(dtype='int32', id=None),\n 'text': Value(dtype='string', id=None),\n 'label': ClassLabel(names=['negative', 'neutral', 'positive'], id=None),\n 'original_dataset': Value(dtype='string', id=None),\n 'domain': Value(dtype='string', id=None),\n 'language': Value(dtype='string', id=None),\n 'Family': Value(dtype='string', id=None),\n 'Genus': Value(dtype='string', id=None),\n 'Definite articles': Value(dtype='string', id=None),\n 'Indefinite articles': Value(dtype='string', id=None),\n 'Number of cases': Value(dtype='string', id=None),\n 'Order of subject, object, verb': Value(dtype='string', id=None),\n 'Negative morphemes': Value(dtype='string', id=None),\n 'Polar questions': Value(dtype='string', id=None),\n 'Position of negative word wrt SOV': Value(dtype='string', id=None),\n 'Prefixing vs suffixing': Value(dtype='string', id=None),\n 'Coding of nominal plurality': Value(dtype='string', id=None),\n 'Grammatical genders': Value(dtype='string', id=None),\n 'cleanlab_self_confidence': Value(dtype='float32', id=None)}\n\n\n\nExample\n\nmms_dataset[\"train\"][2001000]\n\n{'_id': 2001000,\n 'text': 'I was a tomboy and this has such great memories for me. They fit exactly how I remember, PERFECTLY!!',\n 'label': 2,\n 'original_dataset': 'en_amazon',\n 'domain': 'reviews',\n 'language': 'en',\n 'Family': 'Indo-European',\n 'Genus': 'Germanic',\n 'Definite articles': 'definite word distinct from demonstrative',\n 'Indefinite articles': 'indefinite word distinct from one',\n 'Number of cases': '2',\n 'Order of subject, object, verb': 'SVO',\n 'Negative morphemes': 'negative particle',\n 'Polar questions': 'interrogative word order',\n 'Position of negative word wrt SOV': 'SNegVO',\n 'Prefixing vs suffixing': 'strongly suffixing',\n 'Coding of nominal plurality': 'plural suffix',\n 'Grammatical genders': 'no grammatical gender',\n 'cleanlab_self_confidence': 0.9978116750717163}\n\n\n\n\nClasses\n\nlabels = mms_dataset[\"train\"].features[\"label\"].names\nlabels\n\n['negative', 'neutral', 'positive']\n\n\n\nmms_dataset_df[\"label_name\"] = mms_dataset_df[\"label\"].apply(lambda x: labels[x])\n\n\n\nClasses distribution\n\nlabels_stats_df = pd.DataFrame(mms_dataset_df.label_name.value_counts())\nlabels_stats_df[\"percentage\"] = (labels_stats_df[\"label_name\"] / labels_stats_df[\"label_name\"].sum()).round(3)\nlabels_stats_df\n\n\n\n\n\n\n\n\nlabel_name\npercentage\n\n\n\n\npositive\n3494478\n0.567\n\n\nneutral\n1341354\n0.218\n\n\nnegative\n1328930\n0.216"
+ },
+ {
+ "objectID": "index.html#sentiment-orientation-for-each-language",
+ "href": "index.html#sentiment-orientation-for-each-language",
+ "title": "MMS Dataset and Benchmark",
+ "section": "Sentiment orientation for each language",
+ "text": "Sentiment orientation for each language\n\ncols = ['language', 'label_name']\nmms_dataset_df[cols].value_counts().to_frame().reset_index().rename(columns={0: 'count'}).sort_values(by=cols, ascending=True)\n\n\n\n\n\n\n\n\nlanguage\nlabel_name\ncount\n\n\n\n\n7\nar\nnegative\n138899\n\n\n4\nar\nneutral\n192774\n\n\n1\nar\npositive\n600402\n\n\n53\nbg\nnegative\n13930\n\n\n41\nbg\nneutral\n28657\n\n\n...\n...\n...\n...\n\n\n62\nur\nneutral\n8585\n\n\n67\nur\npositive\n5836\n\n\n9\nzh\nnegative\n117967\n\n\n21\nzh\nneutral\n69016\n\n\n6\nzh\npositive\n144719\n\n\n\n\n81 rows × 3 columns"
+ },
+ {
+ "objectID": "index.html#per-language",
+ "href": "index.html#per-language",
+ "title": "MMS Dataset and Benchmark",
+ "section": "Per language",
+ "text": "Per language\n\ncols = ['language']\nmms_dataset_df[cols].value_counts().to_frame().reset_index().rename(columns={0: 'count'}).sort_values(by=cols, ascending=True)\n\n\n\n\n\n\n\n\nlanguage\ncount\n\n\n\n\n1\nar\n932075\n\n\n15\nbg\n62150\n\n\n20\nbs\n36183\n\n\n8\ncs\n196287\n\n\n4\nde\n315887\n\n\n0\nen\n2330486\n\n\n2\nes\n418712\n\n\n23\nfa\n13525\n\n\n6\nfr\n210631\n\n\n25\nhe\n8619\n\n\n22\nhi\n16999\n\n\n12\nhr\n77594\n\n\n16\nhu\n56682\n\n\n24\nit\n12065\n\n\n7\nja\n209780\n\n\n26\nlv\n5790\n\n\n5\npl\n236688\n\n\n9\npt\n157834\n\n\n11\nru\n110930\n\n\n17\nsk\n56623\n\n\n10\nsl\n113543\n\n\n18\nsq\n44284\n\n\n13\nsr\n76368\n\n\n19\nsv\n41346\n\n\n14\nth\n72319\n\n\n21\nur\n19660\n\n\n3\nzh\n331702"
+ },
+ {
+ "objectID": "index.html#example-of-filtering-datasets",
+ "href": "index.html#example-of-filtering-datasets",
+ "title": "MMS Dataset and Benchmark",
+ "section": "Example of filtering datasets",
+ "text": "Example of filtering datasets\n\nChoose only Polish\n\npl = mms_dataset.filter(lambda row: row['language'] == 'pl')\n\n\n\n\n\npl[\"train\"].to_pandas().sample(5)\n\n\n\n\n\n\n\n\n_id\ntext\nlabel\noriginal_dataset\ndomain\nlanguage\nFamily\nGenus\nDefinite articles\nIndefinite articles\nNumber of cases\nOrder of subject, object, verb\nNegative morphemes\nPolar questions\nPosition of negative word wrt SOV\nPrefixing vs suffixing\nCoding of nominal plurality\nGrammatical genders\ncleanlab_self_confidence\n\n\n\n\n215921\n5119386\nTypujcie jaki dziś będzie wynik St.Pats - Legi...\n2\npl_twitter_sentiment\nsocial_media\npl\nIndo-European\nSlavic\nno article\nno article\n6-7\nSVO\nnegative particle\nquestion particle\nSNegVO\nstrongly suffixing\nplural suffix\nmasculine, feminine, neuter\n0.589098\n\n\n86525\n4989990\n@KaczmarSF Przyjemne ciarki mam, gdy patrzę na...\n2\npl_twitter_sentiment\nsocial_media\npl\nIndo-European\nSlavic\nno article\nno article\n6-7\nSVO\nnegative particle\nquestion particle\nSNegVO\nstrongly suffixing\nplural suffix\nmasculine, feminine, neuter\n0.950756\n\n\n66031\n4969496\nszkoda bylo czasu i kasy .\n0\npl_polemo\nreviews\npl\nIndo-European\nSlavic\nno article\nno article\n6-7\nSVO\nnegative particle\nquestion particle\nSNegVO\nstrongly suffixing\nplural suffix\nmasculine, feminine, neuter\n0.940540\n\n\n137768\n5041233\n@shinyvalentine mam ja w dupie lecz bylo to kr...\n0\npl_twitter_sentiment\nsocial_media\npl\nIndo-European\nSlavic\nno article\nno article\n6-7\nSVO\nnegative particle\nquestion particle\nSNegVO\nstrongly suffixing\nplural suffix\nmasculine, feminine, neuter\n0.220028\n\n\n118766\n5022231\n@itiNieWracaj pokazują to gdzieś?\n2\npl_twitter_sentiment\nsocial_media\npl\nIndo-European\nSlavic\nno article\nno article\n6-7\nSVO\nnegative particle\nquestion particle\nSNegVO\nstrongly suffixing\nplural suffix\nmasculine, feminine, neuter\n0.139179"
+ },
+ {
+ "objectID": "index.html#use-cases",
+ "href": "index.html#use-cases",
+ "title": "MMS Dataset and Benchmark",
+ "section": "Use cases",
+ "text": "Use cases\n\nCase 1\nThus, when training a sentiment classifier using our dataset, one may download different facets of the collection. For instance, one can download all datasets in Slavic languages in which polar questions are formed using the interrogative word order or download all datasets from the Afro-Asiatic language family with no morphological case-making.\n\nslavic = mms_dataset.filter(lambda row: row[\"Genus\"] == \"Slavic\" and row[\"Polar questions\"] == \"interrogative word order\")\n\n\n\n\n\nslavic\n\nDatasetDict({\n train: Dataset({\n features: ['_id', 'text', 'label', 'original_dataset', 'domain', 'language', 'Family', 'Genus', 'Definite articles', 'Indefinite articles', 'Number of cases', 'Order of subject, object, verb', 'Negative morphemes', 'Polar questions', 'Position of negative word wrt SOV', 'Prefixing vs suffixing', 'Coding of nominal plurality', 'Grammatical genders', 'cleanlab_self_confidence'],\n num_rows: 252910\n })\n})\n\n\n\n\nCase 2\n\nafro_asiatic = mms_dataset.filter(lambda row: row[\"Family\"] == \"Afro-Asiatic\" and row[\"Number of cases\"] == \"no morphological case-making\")\n\n\n\n\n\nafro_asiatic\n\nDatasetDict({\n train: Dataset({\n features: ['_id', 'text', 'label', 'original_dataset', 'domain', 'language', 'Family', 'Genus', 'Definite articles', 'Indefinite articles', 'Number of cases', 'Order of subject, object, verb', 'Negative morphemes', 'Polar questions', 'Position of negative word wrt SOV', 'Prefixing vs suffixing', 'Coding of nominal plurality', 'Grammatical genders', 'cleanlab_self_confidence'],\n num_rows: 8619\n })\n})"
+ },
+ {
+ "objectID": "index.html#dataset-curators",
+ "href": "index.html#dataset-curators",
+ "title": "MMS Dataset and Benchmark",
+ "section": "Dataset Curators",
+ "text": "Dataset Curators\nThe corpus was put together by\n\n@laugustyniak\n@swozniak\n@mgruza\n@pgramacki\n@krajda\n@mmorzy\n@tkajdanowicz"
+ },
+ {
+ "objectID": "index.html#citation",
+ "href": "index.html#citation",
+ "title": "MMS Dataset and Benchmark",
+ "section": "Citation",
+ "text": "Citation\n@misc{augustyniak2023massively,\n title={Massively Multilingual Corpus of Sentiment Datasets and Multi-faceted Sentiment Classification Benchmark}, \n author={Łukasz Augustyniak and Szymon Woźniak and Marcin Gruza and Piotr Gramacki and Krzysztof Rajda and Mikołaj Morzy and Tomasz Kajdanowicz},\n year={2023},\n eprint={2306.07902},\n archivePrefix={arXiv},\n primaryClass={cs.CL}\n}"
+ },
+ {
+ "objectID": "index.html#acknowledgements",
+ "href": "index.html#acknowledgements",
+ "title": "MMS Dataset and Benchmark",
+ "section": "Acknowledgements",
+ "text": "Acknowledgements\n\nBRAND24 - https://brand24.com\nCLARIN-PL-Biz - https://clarin.biz"
+ },
+ {
+ "objectID": "index.html#licensing-information",
+ "href": "index.html#licensing-information",
+ "title": "MMS Dataset and Benchmark",
+ "section": "Licensing Information",
+ "text": "Licensing Information\nThese data are released under this licensing scheme. We do not own any text from which these data and datasets have been extracted.\nWe license the actual packaging of these data under the Attribution-NonCommercial 4.0 International (CC BY-NC 4.0) https://creativecommons.org/licenses/by-nc/4.0/\nThis work is published from Poland.\nShould you consider that our data contains material that is owned by you and should, therefore not be reproduced here, please: * Clearly identify yourself with detailed contact data such as an address, telephone number, or email address at which you can be contacted. * Clearly identify the copyrighted work claimed to be infringed. * Clearly identify the material claimed to be infringing and the information reasonably sufficient to allow us to locate the material.\nWe will comply with legitimate requests by removing the affected sources from the next release of the corpus."
+ },
+ {
+ "objectID": "benchmark_results.html",
+ "href": "benchmark_results.html",
+ "title": "Benchmark results",
+ "section": "",
+ "text": "Our preliminary results has been presented in (Rajda et al. 2022) and finally presented in (Augustyniak et al. 2023) review at NeurIPS’23."
+ },
+ {
+ "objectID": "benchmark_results.html#benchmark-results---f1-macro-scores",
+ "href": "benchmark_results.html#benchmark-results---f1-macro-scores",
+ "title": "Benchmark results",
+ "section": "Benchmark results - F1 Macro scores",
+ "text": "Benchmark results - F1 Macro scores\n\nModels\n\n\n\n\n\n\n\n\n\n\n\n\nModel\nInf. time [s]\n#params\n#langs\nbase\ndata\nreference\n\n\n\n\nmT5\n1.69\n277M\n101\nT5\n\\(CC^b\\)\n(Xue et al. 2021)\n\n\nLASER\n1.64\n52M\n93\nBiLSTM\n\\(OPUS^c\\)\n(Artetxe and Schwenk 2019)\n\n\nmBERT\n1.49\n177M\n104\nBERT\nWiki\n(Devlin et al. 2019)\n\n\nMPNet**\n1.38\n278M\n53\nXLM-R\n\\(OPUS^c\\), \\(MUSE^d\\), \\(Wikititles^e\\)\n(Reimers and Gurevych 2020)\n\n\nXLM-R-dist**\n1.37\n278M\n53\nXLM-R\n\\(OPUS^c\\), \\(MUSE^d\\), \\(Wikititles^e\\)\n(Reimers and Gurevych 2020)\n\n\nXLM-R\n1.37\n278M\n100\nXLM-R\nCC\n(Conneau et al. 2020)\n\n\nLaBSE\n1.36\n470M\n109\nBERT\nCC, Wiki + mined bitexts\n(Feng et al. 2020)\n\n\nDistilmBERT\n0.79\n134M\n104\nBERT\nWiki\n(Sanh et al. 2020)\n\n\nmUSE-dist**\n0.79\n134M\n53\nDistilmBERT\n\\(OPUS^c\\), \\(MUSE^d\\), \\(Wikititles^e\\)\n(Reimers and Gurevych 2020)\n\n\nmUSE-transformer*\n0.65\n85M\n16\ntransformer\nmined QA + bitexts, SNLI\n(Yang et al. 2020)\n\n\nmUSE-cnn*\n0.12\n68M\n16\nCNN\nmined QA + bitexts, SNLI\n(Yang et al. 2020)\n\n\n\n\n* mUSE models were used in TensorFlow implementation in contrast to others in torch\na Base model is either monolingual version on which it was based or another multilingual model which was used and adopted\nb Colossal Clean Crawled Corpus in multilingual version (mC4)\nc multiple datasets from OPUS website (https://opus.nlpl.eu)\nd bilingual dictionaries from MUSE (https://github.com/facebookresearch/MUSE)\ne just titles from wiki articles in multiple languages\n\n\n\nResults"
+ },
+ {
+ "objectID": "dataset_card.html",
+ "href": "dataset_card.html",
+ "title": "MMS Dataset Card",
+ "section": "",
+ "text": "One of the key ideas behind creating our library of datasets was to prioritize ease of use for researchers. Recognizing the importance of accessibility and convenience, we chose the HuggingFace platform as the storage and distribution platform for the datasets. HuggingFace provides a user-friendly interface and a wide range of tools and resources, making it easy for researchers to access and utilize the datasets.\nTo further enhance usability, we took the initiative to gather all the necessary citations for the datasets included in our library. By unifying the citations, we aimed to simplify and expedite the process of generating citations for researchers who utilize our datasets. This step reduces the time and effort required for researchers to acknowledge the datasets’ sources properly.\nHowever, it is essential to note that while we have taken steps to streamline the citation process, researchers should still independently verify the licenses of the datasets, especially if they intend to use them for purposes beyond strict academic research. Ensuring compliance with licensing requirements is crucial to maintaining ethical and legal data use standards.\nOverall, our overarching goal in creating this unified corpus of datasets is accelerating academic sentiment analysis research. By providing a comprehensive collection of high-quality datasets and facilitating their accessibility, we aim to support researchers in exploring and advancing sentiment analysis techniques and methodologies.\n\n\nOur dataset is designed to be versatile and allows researchers to slice and dice the data for training and modeling according to their specific needs. Drawing from the field of linguistic typology, which examines the characteristics of languages, we have incorporated various linguistic features into our dataset selection process. These features include the text itself, sentiment labels, the original dataset source, domain, language, language family, genus, the presence or absence of definite and indefinite articles, the number of cases, word order, negative morphemes, polar questions, the position of negative morphemes, prefixing vs. suffixing, coding of nominal plurals, and grammatical genders. Researchers can easily access datasets that match their desired linguistic typology criteria by offering these features as filtering options in our library.\nFor instance, researchers can download datasets specific to Slavic languages with interrogative word order for polar questions or datasets from the Afro-Asiatic language family without morphological case-making. This flexibility empowers researchers to tailor their analyses and models to their linguistic interests and research questions.\n\nimport datasets\n\nmms_dataset = datasets.load_dataset(\"Brand24/mms\")\nmms_dataset_df = mms_dataset[\"train\"].to_pandas()\n\nAll features in dataset\n\nmms_dataset_df.sample(5)\n\n\n\n\n\n\n\n\n_id\ntext\nlabel\noriginal_dataset\ndomain\nlanguage\nFamily\nGenus\nDefinite articles\nIndefinite articles\nNumber of cases\nOrder of subject, object, verb\nNegative morphemes\nPolar questions\nPosition of negative word wrt SOV\nPrefixing vs suffixing\nCoding of nominal plurality\nGrammatical genders\ncleanlab_self_confidence\n\n\n\n\n1117023\n1117023\nhlucnost mi prijde uplne v pohode, pere dobre,...\n2\ncs_mall_product_reviews\nreviews\ncs\nIndo-European\nSlavic\nno article\nno article\n6-7\nSVO\nnegative affix\ninterrogative word order\nMorphNeg\nweakly suffixing\nplural suffix\nmasculine, feminine, neuter\n0.679376\n\n\n824580\n824580\n“فندق جميل ولكن الخدمة جدا سيئه”. . الخدمة غير...\n0\nar_hard\nreviews\nar\nAfro-Asiatic\nSemitic\ndefinite affix\nno article\n3\nSVO\nnegative particle\ninterrogative intonation only\nSNegVO\nweakly suffixing\nmixed morphological plural\nmasculine, feminine\n0.725264\n\n\n6014593\n6014593\n刚开始不习惯…之后还挺好用的…很轻便 很细…调节长度也很方便\n2\nzh_multilan_amazon\nreviews\nzh\nSino-Tibetan\nChinese\nno article\nindefinite word same as one\nno morphological case-making\nSVO\nnegative particle\nquestion particle\nSNegVO\nlittle affixation\nno plural\nnoun classifiers\n0.907645\n\n\n5313872\n5313872\nЧемпионы. И этим все сказано.\n2\nru_sentiment\nsocial_media\nru\nIndo-European\nSlavic\nno article\nno article\n6-7\nSVO\nnegative particle\nquestion particle\nSNegVO\nstrongly suffixing\nplural suffix\nmasculine, feminine, neuter\n0.109386\n\n\n4290632\n4290632\n“@UnCharroDice: Y no ha de sobrar, quien con c...\n1\nes_twitter_sentiment\nsocial_media\nes\nIndo-European\nRomance\ndefinite word distinct from demonstrative\nindefinite word same as one\nno morphological case-making\nSVO\nnegative particle\ninterrogative word order\nSNegVO\nstrongly suffixing\nplural suffix\nmasculine, feminine\n0.164549\n\n\n\n\n\n\n\n\n\n\nThe field of language typology focuses on studying the similarities and differences among languages. These differences can be categorized into phonological (sounds), syntactic (structures), lexical (vocabulary), and theoretical aspects. Linguistic typology analyzes the current state of languages, contrasting with genealogical linguistics, which examines historical relationships between languages.\nGenealogical linguistics studies language families and genera. A language family consists of languages that share a common ancestral language, while genera are branches within a language family. The Indo-European family, for example, includes genera such as Slavic, Romance, Germanic, and Indic. Over 7000 languages are categorized into approximately 150 language families, with Indo-European, Sino-Tibetan, Turkic, Afro-Asiatic, Nilo-Saharan, Niger-Congo, and Eskimo-Aleut being some of the largest families.\nWithin linguistic typology, languages are described using various linguistic features. Our work focuses on sentiment classification and selects ten relevant features:\n\ntext: The feature text represents the actual text of the sentiment dataset. It is of type string and contains the text samples or sentences for sentiment analysis.\nlabel: The feature label corresponds to the sentiment labels of the text samples. It is of type ClassLabel and has three possible values: negative, neutral, and positive. These labels indicate the sentiment or emotional polarity associated with the text.\noriginal_dataset: The feature original_dataset refers to the name or identifier of the original dataset from which the text samples were extracted. It is of type string and provides information about the source dataset.\ndomain: The feature domain represents the domain or topic of the sentiment dataset. It is of type string and provides context regarding the subject matter of the text samples.\nlanguage: The feature language indicates the language of the text samples in the sentiment dataset. It is of type string and specifies the language in which the text is written.\nFamily: The feature Family represents the language family to which a specific language belongs. It is of type string and provides information about the broader categorization of languages into language families.\nGenus: The feature Genus corresponds to the genus or branch within a language family. It is of type string and indicates the specific subgrouping of languages within a language family.\nDefinite article: Half of the languages do not use the definite article, which signals uniqueness or definiteness of a concept.\nIndefinite article: Half of the languages do not use the indefinite article, with some languages using a separate article or the numeral “one.”\nNumber of cases: Languages vary greatly in the number of morphological cases used.\nOrder of subject, verb, and object: Different languages have different word orderings, with variations like SOV, SVO, VSO, VOS, OVS, and OSV.\nNegative morphemes: Negative morphemes indicate clausal negation in declarative sentences.\nPolar questions: Questions with yes/no answers, which can be formed using question particles, interrogative morphology, or intonation.\nPosition of the negative morpheme: The position of the negative morpheme can vary in relation to subjects and objects.\nPrefixing vs. suffixing: Languages differ in their use of prefixes and suffixes in inflectional morphology.\nCoding of nominal plurals: Plurals can be expressed through morphological changes or the use of plurality indicator morphemes.\nGrammatical genders: Languages vary in the number of grammatical genders used, or may not use the concept at all.\n\nThese language features are available as filtering options in our library. Users can download specific facets of the collection, such as datasets in Slavic languages with interrogative word order for polar questions or datasets from the Afro-Asiatic language family without morphological case-making."
+ },
+ {
+ "objectID": "dataset_card.html#easiness-of-using",
+ "href": "dataset_card.html#easiness-of-using",
+ "title": "MMS Dataset Card",
+ "section": "",
+ "text": "One of the key ideas behind creating our library of datasets was to prioritize ease of use for researchers. Recognizing the importance of accessibility and convenience, we chose the HuggingFace platform as the storage and distribution platform for the datasets. HuggingFace provides a user-friendly interface and a wide range of tools and resources, making it easy for researchers to access and utilize the datasets.\nTo further enhance usability, we took the initiative to gather all the necessary citations for the datasets included in our library. By unifying the citations, we aimed to simplify and expedite the process of generating citations for researchers who utilize our datasets. This step reduces the time and effort required for researchers to acknowledge the datasets’ sources properly.\nHowever, it is essential to note that while we have taken steps to streamline the citation process, researchers should still independently verify the licenses of the datasets, especially if they intend to use them for purposes beyond strict academic research. Ensuring compliance with licensing requirements is crucial to maintaining ethical and legal data use standards.\nOverall, our overarching goal in creating this unified corpus of datasets is accelerating academic sentiment analysis research. By providing a comprehensive collection of high-quality datasets and facilitating their accessibility, we aim to support researchers in exploring and advancing sentiment analysis techniques and methodologies.\n\n\nOur dataset is designed to be versatile and allows researchers to slice and dice the data for training and modeling according to their specific needs. Drawing from the field of linguistic typology, which examines the characteristics of languages, we have incorporated various linguistic features into our dataset selection process. These features include the text itself, sentiment labels, the original dataset source, domain, language, language family, genus, the presence or absence of definite and indefinite articles, the number of cases, word order, negative morphemes, polar questions, the position of negative morphemes, prefixing vs. suffixing, coding of nominal plurals, and grammatical genders. Researchers can easily access datasets that match their desired linguistic typology criteria by offering these features as filtering options in our library.\nFor instance, researchers can download datasets specific to Slavic languages with interrogative word order for polar questions or datasets from the Afro-Asiatic language family without morphological case-making. This flexibility empowers researchers to tailor their analyses and models to their linguistic interests and research questions.\n\nimport datasets\n\nmms_dataset = datasets.load_dataset(\"Brand24/mms\")\nmms_dataset_df = mms_dataset[\"train\"].to_pandas()\n\nAll features in dataset\n\nmms_dataset_df.sample(5)\n\n\n\n\n\n\n\n\n_id\ntext\nlabel\noriginal_dataset\ndomain\nlanguage\nFamily\nGenus\nDefinite articles\nIndefinite articles\nNumber of cases\nOrder of subject, object, verb\nNegative morphemes\nPolar questions\nPosition of negative word wrt SOV\nPrefixing vs suffixing\nCoding of nominal plurality\nGrammatical genders\ncleanlab_self_confidence\n\n\n\n\n1117023\n1117023\nhlucnost mi prijde uplne v pohode, pere dobre,...\n2\ncs_mall_product_reviews\nreviews\ncs\nIndo-European\nSlavic\nno article\nno article\n6-7\nSVO\nnegative affix\ninterrogative word order\nMorphNeg\nweakly suffixing\nplural suffix\nmasculine, feminine, neuter\n0.679376\n\n\n824580\n824580\n“فندق جميل ولكن الخدمة جدا سيئه”. . الخدمة غير...\n0\nar_hard\nreviews\nar\nAfro-Asiatic\nSemitic\ndefinite affix\nno article\n3\nSVO\nnegative particle\ninterrogative intonation only\nSNegVO\nweakly suffixing\nmixed morphological plural\nmasculine, feminine\n0.725264\n\n\n6014593\n6014593\n刚开始不习惯…之后还挺好用的…很轻便 很细…调节长度也很方便\n2\nzh_multilan_amazon\nreviews\nzh\nSino-Tibetan\nChinese\nno article\nindefinite word same as one\nno morphological case-making\nSVO\nnegative particle\nquestion particle\nSNegVO\nlittle affixation\nno plural\nnoun classifiers\n0.907645\n\n\n5313872\n5313872\nЧемпионы. И этим все сказано.\n2\nru_sentiment\nsocial_media\nru\nIndo-European\nSlavic\nno article\nno article\n6-7\nSVO\nnegative particle\nquestion particle\nSNegVO\nstrongly suffixing\nplural suffix\nmasculine, feminine, neuter\n0.109386\n\n\n4290632\n4290632\n“@UnCharroDice: Y no ha de sobrar, quien con c...\n1\nes_twitter_sentiment\nsocial_media\nes\nIndo-European\nRomance\ndefinite word distinct from demonstrative\nindefinite word same as one\nno morphological case-making\nSVO\nnegative particle\ninterrogative word order\nSNegVO\nstrongly suffixing\nplural suffix\nmasculine, feminine\n0.164549\n\n\n\n\n\n\n\n\n\n\nThe field of language typology focuses on studying the similarities and differences among languages. These differences can be categorized into phonological (sounds), syntactic (structures), lexical (vocabulary), and theoretical aspects. Linguistic typology analyzes the current state of languages, contrasting with genealogical linguistics, which examines historical relationships between languages.\nGenealogical linguistics studies language families and genera. A language family consists of languages that share a common ancestral language, while genera are branches within a language family. The Indo-European family, for example, includes genera such as Slavic, Romance, Germanic, and Indic. Over 7000 languages are categorized into approximately 150 language families, with Indo-European, Sino-Tibetan, Turkic, Afro-Asiatic, Nilo-Saharan, Niger-Congo, and Eskimo-Aleut being some of the largest families.\nWithin linguistic typology, languages are described using various linguistic features. Our work focuses on sentiment classification and selects ten relevant features:\n\ntext: The feature text represents the actual text of the sentiment dataset. It is of type string and contains the text samples or sentences for sentiment analysis.\nlabel: The feature label corresponds to the sentiment labels of the text samples. It is of type ClassLabel and has three possible values: negative, neutral, and positive. These labels indicate the sentiment or emotional polarity associated with the text.\noriginal_dataset: The feature original_dataset refers to the name or identifier of the original dataset from which the text samples were extracted. It is of type string and provides information about the source dataset.\ndomain: The feature domain represents the domain or topic of the sentiment dataset. It is of type string and provides context regarding the subject matter of the text samples.\nlanguage: The feature language indicates the language of the text samples in the sentiment dataset. It is of type string and specifies the language in which the text is written.\nFamily: The feature Family represents the language family to which a specific language belongs. It is of type string and provides information about the broader categorization of languages into language families.\nGenus: The feature Genus corresponds to the genus or branch within a language family. It is of type string and indicates the specific subgrouping of languages within a language family.\nDefinite article: Half of the languages do not use the definite article, which signals uniqueness or definiteness of a concept.\nIndefinite article: Half of the languages do not use the indefinite article, with some languages using a separate article or the numeral “one.”\nNumber of cases: Languages vary greatly in the number of morphological cases used.\nOrder of subject, verb, and object: Different languages have different word orderings, with variations like SOV, SVO, VSO, VOS, OVS, and OSV.\nNegative morphemes: Negative morphemes indicate clausal negation in declarative sentences.\nPolar questions: Questions with yes/no answers, which can be formed using question particles, interrogative morphology, or intonation.\nPosition of the negative morpheme: The position of the negative morpheme can vary in relation to subjects and objects.\nPrefixing vs. suffixing: Languages differ in their use of prefixes and suffixes in inflectional morphology.\nCoding of nominal plurals: Plurals can be expressed through morphological changes or the use of plurality indicator morphemes.\nGrammatical genders: Languages vary in the number of grammatical genders used, or may not use the concept at all.\n\nThese language features are available as filtering options in our library. Users can download specific facets of the collection, such as datasets in Slavic languages with interrogative word order for polar questions or datasets from the Afro-Asiatic language family without morphological case-making."
+ },
+ {
+ "objectID": "dataset_card.html#datasheets-for-datasets",
+ "href": "dataset_card.html#datasheets-for-datasets",
+ "title": "MMS Dataset Card",
+ "section": "Datasheets for Datasets",
+ "text": "Datasheets for Datasets\nThe datasheets provide detailed information about the datasets, including data collection methods, annotation guidelines, and potential biases. They also specify the intended uses and potential limitations of the datasets.\nThe initial pool of sentiment datasets was gathered through an extensive search using sources such as Google Scholar, GitHub repositories, and the HuggingFace datasets library. This search yielded a total of 345 datasets.\nTo ensure the quality of the datasets, a set of quality assurance criteria was applied to manually filter the initial pool of datasets. The following criteria were used:\n\nStrong Annotations: Datasets containing weak annotations, such as labels based on emoji occurrence or automatically generated through classification by machine learning models, were rejected. This decision was made to minimize the presence of noise in the datasets, ensuring higher quality annotations.\nWell-Defined Annotation Protocol: Datasets without sufficient information about the annotation protocol, including whether the annotation was done manually or automatically and the number of annotators involved, were rejected. This step aimed to avoid merging datasets with contradicting annotation instructions, ensuring consistency across the selected datasets.\nNumerical Ratings: Datasets with numerical ratings were accepted. Specifically, Likert-type 5-point scales were mapped into three class sentiment labels. Ratings 1 and 2 were mapped to “negative,” rating 3 was mapped to “neutral,” and ratings 4 and 5 were mapped to “positive.” This mapping allowed for consistent sentiment labeling across the datasets.\nThree Classes Only: Datasets annotated with binary sentiment labels were rejected. The decision to focus on datasets with three sentiment classes (negative, neutral, and positive) was made based on the unsatisfactory performance of binary sentiment labeling in three-class settings.\nMonolingual Datasets: In cases where a dataset contained samples in multiple languages, it was divided into independent datasets for each constituent language. This approach ensured that the corpus includes separate datasets for different languages, allowing for targeted analysis and evaluation.\n\nBy applying these quality assurance criteria, we were able to filter the initial pool of sentiment datasets and select a final set of 79 datasets that met the specified standards for inclusion in the multilingual corpus.\n\nf\"We cover {mms_dataset_df.original_dataset.nunique()} datasets in {mms_dataset_df.language.nunique()} languages.\"\n\n'We cover 79 datasets in 27 languages.'\n\n\n\nf\"The classes that we cover: {mms_dataset_df.label_name.unique()}\"\n\n\"The classes that we cover: ['positive' 'neutral' 'negative']\""
+ },
+ {
+ "objectID": "dataset_card.html#limitations",
+ "href": "dataset_card.html#limitations",
+ "title": "MMS Dataset Card",
+ "section": "Limitations",
+ "text": "Limitations\nDespite the fact that our collection is the largest public collection of multilingual sentiment datasets, it still covers only 27 languages. The collection of datasets is highly biased towards the Indo-European family of languages, English in particular. We attribute this bias to the general culture of scientific publishing and its enforcement of English as the primary carrier of scientific discovery. Our work’s main potential negative social impact is that the models developed and trained using the provided datasets may still exhibit better performance for the major languages. This could further perpetuate the existing language disparities and inequality in sentiment analysis capabilities across different languages. Addressing this limitation and working towards more equitable representation and performance across languages is crucial to avoid reinforcing language biases and the potential marginalization of underrepresented languages. The ethical implications of such disparities should be thoroughly discussed and considered.\n\n\n\nData Quality\n\n\nAn important limitation of our dataset collection is a significant variance in sample quality across all datasets and all languages. Above figure presents the distribution of self-confidence label-quality score for each data point computed by the cleanlab (Northcutt, Jiang, and Chuang 2021). The distribution of quality is skewed in favor of popular languages, with low-resource languages suffering from data quality issues. A related limitation is caused by an unequal distribution of data modalities across languages. For instance, our benchmark clearly shows that all models universally underperform when tested on Portuguese datasets. This is the direct result of the fact that data points for Portuguese almost exclusively represent the domain of social media. As a consequence, some combinations of filtering facets in our dataset collection produce very little data (i.e., asking for social media data in the Germanic genus of Indo-European languages will produce a significantly larger dataset than asking for news data representing Afro-Asiatic languages).\nFinally, we acknowledge the lack of internal coherence of annotation protocols between datasets and languages. We have enforced strict quality criteria and rejected all datasets published without the annotation protocol, but we were unable, for obvious reasons, to unify annotation guidelines. The annotation of sentiment expressions and the assignment of sentiment labels are heavily subjective and, at the same time, influenced by cultural and linguistic features. Unfortunately, it is possible that semantically similar utterances will be assigned conflicting labels if they come from different datasets or modalities.\n\nFilter examples by annotation qualitym\nWe know how imporant data quality is for the model training processes. Hence, we added cleanlab scores to each of 6M+ examples in all datasets. Now, it is enalbe to filter examples based on how good quality of data do you need for traning.\nWe can sort examples by top data quality. Cleanlab’s self confidence is a function to compute label-quality scores for classification datasets, where lower scores indicate labels less likely to be correct. Hence, for the best quality we want to have the highest scores.\n\nclean_labels_data = mms_dataset_df.sort_values(by=\"cleanlab_self_confidence\", ascending=False).head(10_000)\n\n\nclean_labels_data.head()\n\n\n\n\n\n\n\n\n_id\ntext\nlabel\noriginal_dataset\ndomain\nlanguage\nFamily\nGenus\nDefinite articles\nIndefinite articles\nNumber of cases\nOrder of subject, object, verb\nNegative morphemes\nPolar questions\nPosition of negative word wrt SOV\nPrefixing vs suffixing\nCoding of nominal plurality\nGrammatical genders\ncleanlab_self_confidence\nlabel_name\n\n\n\n\n3075302\n3075302\nGreat addition to any fan's yard! Show your te...\n2\nen_amazon\nreviews\nen\nIndo-European\nGermanic\ndefinite word distinct from demonstrative\nindefinite word distinct from one\n2\nSVO\nnegative particle\ninterrogative word order\nSNegVO\nstrongly suffixing\nplural suffix\nno grammatical gender\n0.999981\npositive\n\n\n629922\n629922\nمخيب للأمل. . ىحَ\n0\nar_hard\nreviews\nar\nAfro-Asiatic\nSemitic\ndefinite affix\nno article\n3\nSVO\nnegative particle\ninterrogative intonation only\nSNegVO\nweakly suffixing\nmixed morphological plural\nmasculine, feminine\n0.999964\nnegative\n\n\n2858237\n2858237\nThis is a great flag to display your love of A...\n2\nen_amazon\nreviews\nen\nIndo-European\nGermanic\ndefinite word distinct from demonstrative\nindefinite word distinct from one\n2\nSVO\nnegative particle\ninterrogative word order\nSNegVO\nstrongly suffixing\nplural suffix\nno grammatical gender\n0.999950\npositive\n\n\n3110031\n3110031\nOne of the best knives I now proudly own! Am a...\n2\nen_amazon\nreviews\nen\nIndo-European\nGermanic\ndefinite word distinct from demonstrative\nindefinite word distinct from one\n2\nSVO\nnegative particle\ninterrogative word order\nSNegVO\nstrongly suffixing\nplural suffix\nno grammatical gender\n0.999950\npositive\n\n\n2052971\n2052971\nAmen! My Savior Loves! Wonderful testimony!\n2\nen_amazon\nreviews\nen\nIndo-European\nGermanic\ndefinite word distinct from demonstrative\nindefinite word distinct from one\n2\nSVO\nnegative particle\ninterrogative word order\nSNegVO\nstrongly suffixing\nplural suffix\nno grammatical gender\n0.999948\npositive"
+ },
+ {
+ "objectID": "dataset_card.html#datasets",
+ "href": "dataset_card.html#datasets",
+ "title": "MMS Dataset Card",
+ "section": "Datasets",
+ "text": "Datasets\nWe added all necessary citations to the HuggingFace datasets card. You can find them inside citation key. We added a helper fuinctions to parse them.\nWe can load citations as strings - easy adding to bibtex.\n\nfrom mms_benchmark.citations import get_citations\n\n\nprint(get_citations(mms_dataset[\"train\"], citation_as_dict=False)[\"pl_polemo\"])\n\n@inproceedings{dataset_pl_polemo,\n title = \"Multi-Level Sentiment Analysis of {P}ol{E}mo 2.0: Extended Corpus of Multi-Domain Consumer Reviews\",\n author = \"Koco{\\'n}, Jan and\n Mi{\\l}kowski, Piotr and\n Za{\\'s}ko-Zieli{\\'n}ska, Monika\",\n booktitle = \"Proceedings of the 23rd Conference on Computational Natural Language Learning (CoNLL)\",\n month = nov,\n year = \"2019\",\n address = \"Hong Kong, China\",\n publisher = \"Association for Computational Linguistics\",\n url = \"https://aclanthology.org/K19-1092\",\n doi = \"10.18653/v1/K19-1092\",\n pages = \"980--991\"\n}\n% ------------------------------------------------------------------------------------------\n\n\n\nOr as dictionary for working with them.\n\ncitations = get_citations(mms_dataset[\"train\"], citation_as_dict=True)\n\n\ncitations[\"pl_polemo\"]\n\n{'pages': '980--991',\n 'doi': '10.18653/v1/K19-1092',\n 'url': 'https://aclanthology.org/K19-1092',\n 'publisher': 'Association for Computational Linguistics',\n 'address': 'Hong Kong, China',\n 'year': '2019',\n 'month': 'November',\n 'booktitle': 'Proceedings of the 23rd Conference on Computational Natural Language Learning (CoNLL)',\n 'author': \"Koco{\\\\'n}, Jan and\\nMi{\\\\l}kowski, Piotr and\\nZa{\\\\'s}ko-Zieli{\\\\'n}ska, Monika\",\n 'title': 'Multi-Level Sentiment Analysis of {P}ol{E}mo 2.0: Extended Corpus of Multi-Domain Consumer Reviews',\n 'ENTRYTYPE': 'inproceedings',\n 'ID': 'dataset_pl_polemo'}\n\n\n\nShow all datasets with citations in a table\n\nmms_dataset_df[\"citation\"] = mms_dataset_df[\"original_dataset\"].apply(lambda x: f'[@{citations[x][\"ID\"]}]')\n\n\nmms_dataset_df[DATASET_COLS].drop_duplicates().sort_values(\"language\").reset_index(drop=True)\n\n\n\n\n\n\n\n\nlanguage\noriginal_dataset\ndomain\nFamily\nGenus\nDefinite articles\nIndefinite articles\nNumber of cases\nOrder of subject, object, verb\nNegative morphemes\nPolar questions\nPosition of negative word wrt SOV\nPrefixing vs suffixing\nCoding of nominal plurality\nGrammatical genders\ncitation\n\n\n\n\n0\nar\nar_arsentdl\nsocial_media\nAfro-Asiatic\nSemitic\ndefinite affix\nno article\n3\nSVO\nnegative particle\ninterrogative intonation only\nSNegVO\nweakly suffixing\nmixed morphological plural\nmasculine, feminine\n[@dataset_ar_arsentdl]\n\n\n1\nar\nar_semeval_2017\nmixed\nAfro-Asiatic\nSemitic\ndefinite affix\nno article\n3\nSVO\nnegative particle\ninterrogative intonation only\nSNegVO\nweakly suffixing\nmixed morphological plural\nmasculine, feminine\n[@dataset_semeval_2017]\n\n\n2\nar\nar_oclar\nreviews\nAfro-Asiatic\nSemitic\ndefinite affix\nno article\n3\nSVO\nnegative particle\ninterrogative intonation only\nSNegVO\nweakly suffixing\nmixed morphological plural\nmasculine, feminine\n[@dataset_ar_oclar]\n\n\n3\nar\nar_labr\nreviews\nAfro-Asiatic\nSemitic\ndefinite affix\nno article\n3\nSVO\nnegative particle\ninterrogative intonation only\nSNegVO\nweakly suffixing\nmixed morphological plural\nmasculine, feminine\n[@dataset_ar_labr]\n\n\n4\nar\nar_syria_corpus\nsocial_media\nAfro-Asiatic\nSemitic\ndefinite affix\nno article\n3\nSVO\nnegative particle\ninterrogative intonation only\nSNegVO\nweakly suffixing\nmixed morphological plural\nmasculine, feminine\n[@dataset_ar_bbn]\n\n\n5\nar\nar_brad\nreviews\nAfro-Asiatic\nSemitic\ndefinite affix\nno article\n3\nSVO\nnegative particle\ninterrogative intonation only\nSNegVO\nweakly suffixing\nmixed morphological plural\nmasculine, feminine\n[@dataset_ar_brad]\n\n\n6\nar\nar_bbn\nsocial_media\nAfro-Asiatic\nSemitic\ndefinite affix\nno article\n3\nSVO\nnegative particle\ninterrogative intonation only\nSNegVO\nweakly suffixing\nmixed morphological plural\nmasculine, feminine\n[@dataset_ar_bbn]\n\n\n7\nar\nar_astd\nsocial_media\nAfro-Asiatic\nSemitic\ndefinite affix\nno article\n3\nSVO\nnegative particle\ninterrogative intonation only\nSNegVO\nweakly suffixing\nmixed morphological plural\nmasculine, feminine\n[@dataset_ar_astd]\n\n\n8\nar\nar_hard\nreviews\nAfro-Asiatic\nSemitic\ndefinite affix\nno article\n3\nSVO\nnegative particle\ninterrogative intonation only\nSNegVO\nweakly suffixing\nmixed morphological plural\nmasculine, feminine\n[@dataset_ar_hard]\n\n\n9\nbg\nbg_twitter_sentiment\nsocial_media\nIndo-European\nSlavic\ndefinite word distinct from demonstrative\nno article\nno morphological case-making\nSVO\nnegative particle\nquestion particle\nSNegVO\nstrongly suffixing\nplural suffix\nmasculine, feminine, neuter\n[@dataset_twitter_sentiment]\n\n\n10\nbs\nbs_twitter_sentiment\nsocial_media\nIndo-European\nSlavic\nno article\nno article\n5\nSVO\nnegative particle\nquestion particle\nother\nstrongly suffixing\nplural suffix\nmasculine, feminine, neuter\n[@dataset_twitter_sentiment]\n\n\n11\ncs\ncs_facebook\nsocial_media\nIndo-European\nSlavic\nno article\nno article\n6-7\nSVO\nnegative affix\ninterrogative word order\nMorphNeg\nweakly suffixing\nplural suffix\nmasculine, feminine, neuter\n[@dataset_cs_social_media]\n\n\n12\ncs\ncs_mall_product_reviews\nreviews\nIndo-European\nSlavic\nno article\nno article\n6-7\nSVO\nnegative affix\ninterrogative word order\nMorphNeg\nweakly suffixing\nplural suffix\nmasculine, feminine, neuter\n[@dataset_cs_social_media]\n\n\n13\ncs\ncs_movie_reviews\nreviews\nIndo-European\nSlavic\nno article\nno article\n6-7\nSVO\nnegative affix\ninterrogative word order\nMorphNeg\nweakly suffixing\nplural suffix\nmasculine, feminine, neuter\n[@dataset_cs_social_media]\n\n\n14\ncs\ncs_news_stance\nsocial_media\nIndo-European\nSlavic\nno article\nno article\n6-7\nSVO\nnegative affix\ninterrogative word order\nMorphNeg\nweakly suffixing\nplural suffix\nmasculine, feminine, neuter\n[@dataset_cs_social_media]\n\n\n15\nde\nde_twitter_sentiment\nsocial_media\nIndo-European\nGermanic\ndefinite word distinct from demonstrative\nindefinite word same as one\n4\nno dominant order\nnegative particle\ninterrogative word order\nmore than one position\nstrongly suffixing\nplural suffix\nmasculine, feminine, neuter\n[@dataset_twitter_sentiment]\n\n\n16\nde\nde_omp\nsocial_media\nIndo-European\nGermanic\ndefinite word distinct from demonstrative\nindefinite word same as one\n4\nno dominant order\nnegative particle\ninterrogative word order\nmore than one position\nstrongly suffixing\nplural suffix\nmasculine, feminine, neuter\n[@dataset_de_omp]\n\n\n17\nde\nde_sb10k\nsocial_media\nIndo-European\nGermanic\ndefinite word distinct from demonstrative\nindefinite word same as one\n4\nno dominant order\nnegative particle\ninterrogative word order\nmore than one position\nstrongly suffixing\nplural suffix\nmasculine, feminine, neuter\n[@dataset_de_sb10k]\n\n\n18\nde\nde_ifeel\nsocial_media\nIndo-European\nGermanic\ndefinite word distinct from demonstrative\nindefinite word same as one\n4\nno dominant order\nnegative particle\ninterrogative word order\nmore than one position\nstrongly suffixing\nplural suffix\nmasculine, feminine, neuter\n[@dataset_dai_labor]\n\n\n19\nde\nde_dai_labor\nsocial_media\nIndo-European\nGermanic\ndefinite word distinct from demonstrative\nindefinite word same as one\n4\nno dominant order\nnegative particle\ninterrogative word order\nmore than one position\nstrongly suffixing\nplural suffix\nmasculine, feminine, neuter\n[@dataset_dai_labor]\n\n\n20\nde\nde_multilan_amazon\nreviews\nIndo-European\nGermanic\ndefinite word distinct from demonstrative\nindefinite word same as one\n4\nno dominant order\nnegative particle\ninterrogative word order\nmore than one position\nstrongly suffixing\nplural suffix\nmasculine, feminine, neuter\n[@dataset_multilan_amazon]\n\n\n21\nen\nen_vader_twitter\nsocial_media\nIndo-European\nGermanic\ndefinite word distinct from demonstrative\nindefinite word distinct from one\n2\nSVO\nnegative particle\ninterrogative word order\nSNegVO\nstrongly suffixing\nplural suffix\nno grammatical gender\n[@dataset_en_vader]\n\n\n22\nen\nen_vader_nyt\nnews\nIndo-European\nGermanic\ndefinite word distinct from demonstrative\nindefinite word distinct from one\n2\nSVO\nnegative particle\ninterrogative word order\nSNegVO\nstrongly suffixing\nplural suffix\nno grammatical gender\n[@dataset_en_vader]\n\n\n23\nen\nen_vader_movie_reviews\nreviews\nIndo-European\nGermanic\ndefinite word distinct from demonstrative\nindefinite word distinct from one\n2\nSVO\nnegative particle\ninterrogative word order\nSNegVO\nstrongly suffixing\nplural suffix\nno grammatical gender\n[@dataset_en_vader]\n\n\n24\nen\nen_vader_amazon\nreviews\nIndo-European\nGermanic\ndefinite word distinct from demonstrative\nindefinite word distinct from one\n2\nSVO\nnegative particle\ninterrogative word order\nSNegVO\nstrongly suffixing\nplural suffix\nno grammatical gender\n[@dataset_en_vader]\n\n\n25\nen\nen_twitter_sentiment\nsocial_media\nIndo-European\nGermanic\ndefinite word distinct from demonstrative\nindefinite word distinct from one\n2\nSVO\nnegative particle\ninterrogative word order\nSNegVO\nstrongly suffixing\nplural suffix\nno grammatical gender\n[@dataset_twitter_sentiment]\n\n\n26\nen\nen_tweets_sanders\nsocial_media\nIndo-European\nGermanic\ndefinite word distinct from demonstrative\nindefinite word distinct from one\n2\nSVO\nnegative particle\ninterrogative word order\nSNegVO\nstrongly suffixing\nplural suffix\nno grammatical gender\n[@dataset_en_tweets_sanders]\n\n\n27\nen\nen_tweet_airlines\nsocial_media\nIndo-European\nGermanic\ndefinite word distinct from demonstrative\nindefinite word distinct from one\n2\nSVO\nnegative particle\ninterrogative word order\nSNegVO\nstrongly suffixing\nplural suffix\nno grammatical gender\n[@dataset_en_tweet_airlines]\n\n\n28\nen\nen_silicone_sem\nchats\nIndo-European\nGermanic\ndefinite word distinct from demonstrative\nindefinite word distinct from one\n2\nSVO\nnegative particle\ninterrogative word order\nSNegVO\nstrongly suffixing\nplural suffix\nno grammatical gender\n[@dataset_en_silicone]\n\n\n29\nen\nen_sentistrength\nsocial_media\nIndo-European\nGermanic\ndefinite word distinct from demonstrative\nindefinite word distinct from one\n2\nSVO\nnegative particle\ninterrogative word order\nSNegVO\nstrongly suffixing\nplural suffix\nno grammatical gender\n[@dataset_en_sentistrength]\n\n\n30\nen\nen_semeval_2017\nmixed\nIndo-European\nGermanic\ndefinite word distinct from demonstrative\nindefinite word distinct from one\n2\nSVO\nnegative particle\ninterrogative word order\nSNegVO\nstrongly suffixing\nplural suffix\nno grammatical gender\n[@dataset_semeval_2017]\n\n\n31\nen\nen_poem_sentiment\npoems\nIndo-European\nGermanic\ndefinite word distinct from demonstrative\nindefinite word distinct from one\n2\nSVO\nnegative particle\ninterrogative word order\nSNegVO\nstrongly suffixing\nplural suffix\nno grammatical gender\n[@dataset_en_poem_sentiment]\n\n\n32\nen\nen_per_sent\nnews\nIndo-European\nGermanic\ndefinite word distinct from demonstrative\nindefinite word distinct from one\n2\nSVO\nnegative particle\ninterrogative word order\nSNegVO\nstrongly suffixing\nplural suffix\nno grammatical gender\n[@dataset_en_per_sent]\n\n\n33\nen\nen_multilan_amazon\nreviews\nIndo-European\nGermanic\ndefinite word distinct from demonstrative\nindefinite word distinct from one\n2\nSVO\nnegative particle\ninterrogative word order\nSNegVO\nstrongly suffixing\nplural suffix\nno grammatical gender\n[@dataset_multilan_amazon]\n\n\n34\nen\nen_financial_phrasebank_sentences_75agree\nnews\nIndo-European\nGermanic\ndefinite word distinct from demonstrative\nindefinite word distinct from one\n2\nSVO\nnegative particle\ninterrogative word order\nSNegVO\nstrongly suffixing\nplural suffix\nno grammatical gender\n[@dataset_en_financial_phrasebank_sentences_75agree]\n\n\n35\nen\nen_dai_labor\nsocial_media\nIndo-European\nGermanic\ndefinite word distinct from demonstrative\nindefinite word distinct from one\n2\nSVO\nnegative particle\ninterrogative word order\nSNegVO\nstrongly suffixing\nplural suffix\nno grammatical gender\n[@dataset_dai_labor]\n\n\n36\nen\nen_amazon\nreviews\nIndo-European\nGermanic\ndefinite word distinct from demonstrative\nindefinite word distinct from one\n2\nSVO\nnegative particle\ninterrogative word order\nSNegVO\nstrongly suffixing\nplural suffix\nno grammatical gender\n[@dataset_en_amazon]\n\n\n37\nen\nen_silicone_meld_s\nchats\nIndo-European\nGermanic\ndefinite word distinct from demonstrative\nindefinite word distinct from one\n2\nSVO\nnegative particle\ninterrogative word order\nSNegVO\nstrongly suffixing\nplural suffix\nno grammatical gender\n[@dataset_en_silicone]\n\n\n38\nes\nes_twitter_sentiment\nsocial_media\nIndo-European\nRomance\ndefinite word distinct from demonstrative\nindefinite word same as one\nno morphological case-making\nSVO\nnegative particle\ninterrogative word order\nSNegVO\nstrongly suffixing\nplural suffix\nmasculine, feminine\n[@dataset_twitter_sentiment]\n\n\n39\nes\nes_semeval2020\nsocial_media\nIndo-European\nRomance\ndefinite word distinct from demonstrative\nindefinite word same as one\nno morphological case-making\nSVO\nnegative particle\ninterrogative word order\nSNegVO\nstrongly suffixing\nplural suffix\nmasculine, feminine\n[@dataset_semeval_2020]\n\n\n40\nes\nes_multilan_amazon\nreviews\nIndo-European\nRomance\ndefinite word distinct from demonstrative\nindefinite word same as one\nno morphological case-making\nSVO\nnegative particle\ninterrogative word order\nSNegVO\nstrongly suffixing\nplural suffix\nmasculine, feminine\n[@dataset_multilan_amazon]\n\n\n41\nes\nes_muchocine\nreviews\nIndo-European\nRomance\ndefinite word distinct from demonstrative\nindefinite word same as one\nno morphological case-making\nSVO\nnegative particle\ninterrogative word order\nSNegVO\nstrongly suffixing\nplural suffix\nmasculine, feminine\n[@dataset_es_muchocine]\n\n\n42\nes\nes_paper_reviews\nreviews\nIndo-European\nRomance\ndefinite word distinct from demonstrative\nindefinite word same as one\nno morphological case-making\nSVO\nnegative particle\ninterrogative word order\nSNegVO\nstrongly suffixing\nplural suffix\nmasculine, feminine\n[@dataset_es_paper_reviews]\n\n\n43\nfa\nfa_sentipers\nreviews\nIndo-European\nIranian\nno article\nindefinite word same as one\n2\nSOV\nnegative affix\nquestion particle\nMorphNeg\nweakly suffixing\nplural suffix\nno grammatical gender\n[@dataset_fa_sentipers]\n\n\n44\nfr\nfr_dai_labor\nsocial_media\nIndo-European\nRomance\ndefinite word distinct from demonstrative\nindefinite word same as one\nno morphological case-making\nSVO\nnegative particle\nquestion particle\nOptDoubleNeg\nstrongly suffixing\nplural suffix\nmasculine, feminine\n[@dataset_dai_labor]\n\n\n45\nfr\nfr_ifeel\nsocial_media\nIndo-European\nRomance\ndefinite word distinct from demonstrative\nindefinite word same as one\nno morphological case-making\nSVO\nnegative particle\nquestion particle\nOptDoubleNeg\nstrongly suffixing\nplural suffix\nmasculine, feminine\n[@dataset_dai_labor]\n\n\n46\nfr\nfr_multilan_amazon\nreviews\nIndo-European\nRomance\ndefinite word distinct from demonstrative\nindefinite word same as one\nno morphological case-making\nSVO\nnegative particle\nquestion particle\nOptDoubleNeg\nstrongly suffixing\nplural suffix\nmasculine, feminine\n[@dataset_multilan_amazon]\n\n\n47\nhe\nhe_hebrew_sentiment\nsocial_media\nAfro-Asiatic\nSemitic\ndefinite affix\nindefinite word same as one\nno morphological case-making\nSVO\nnegative particle\nquestion particle\nSNegVO\nweakly suffixing\nplural suffix\nmasculine, feminine\n[@dataset_he_hebrew_sentiment]\n\n\n48\nhi\nhi_semeval2020\nsocial_media\nIndo-European\nIndic\nno article\nno article\n3\nSOV\nnegative particle\nquestion particle\nSONegV\nstrongly suffixing\nplural suffix\nmasculine, feminine\n[@dataset_semeval_2020]\n\n\n49\nhr\nhr_sentiment_news_document\nnews\nIndo-European\nSlavic\nno article\nno article\n5\nSVO\nnegative particle\nquestion particle\nother\nstrongly suffixing\nplural suffix\nmasculine, feminine, neuter\n[@dataset_hr_sentiment_news_document]\n\n\n50\nhr\nhr_twitter_sentiment\nsocial_media\nIndo-European\nSlavic\nno article\nno article\n5\nSVO\nnegative particle\nquestion particle\nother\nstrongly suffixing\nplural suffix\nmasculine, feminine, neuter\n[@dataset_twitter_sentiment]\n\n\n51\nhu\nhu_twitter_sentiment\nsocial_media\nUralic\nUgric\ndefinite word distinct from demonstrative\nindefinite word distinct from one\n10 or more\nno dominant order\nnegative particle\nquestion particle\nSNegVO\nstrongly suffixing\nplural suffix\nno grammatical gender\n[@dataset_twitter_sentiment]\n\n\n52\nit\nit_evalita2016\nsocial_media\nIndo-European\nRomance\ndefinite word distinct from demonstrative\nindefinite word same as one\nno morphological case-making\nSVO\nnegative particle\ninterrogative intonation only\nSNegVO\nstrongly suffixing\nplural suffix\nmasculine, feminine\n[@dataset_it_evalita2016]\n\n\n53\nit\nit_multiemotions\nsocial_media\nIndo-European\nRomance\ndefinite word distinct from demonstrative\nindefinite word same as one\nno morphological case-making\nSVO\nnegative particle\ninterrogative intonation only\nSNegVO\nstrongly suffixing\nplural suffix\nmasculine, feminine\n[@dataset_it_multiemotions]\n\n\n54\nja\nja_multilan_amazon\nreviews\nJapanese\nJapanese\nno article\nindefinite word distinct from one\n8-9\nSOV\nnegative affix\nquestion particle\nMorphNeg\nstrongly suffixing\nplural suffix\nno grammatical gender\n[@dataset_multilan_amazon]\n\n\n55\nlv\nlv_ltec_sentiment\nsocial_media\nIndo-European\nBaltic\ndemonstrative word used as definite article\nindefinite word same as one\n5\nSVO\nnegative affix\nquestion particle\nMorphNeg\nweakly suffixing\nplural suffix\nmasculine, feminine\n[@dataset_lv_ltec_sentiment]\n\n\n56\npl\npl_twitter_sentiment\nsocial_media\nIndo-European\nSlavic\nno article\nno article\n6-7\nSVO\nnegative particle\nquestion particle\nSNegVO\nstrongly suffixing\nplural suffix\nmasculine, feminine, neuter\n[@dataset_twitter_sentiment]\n\n\n57\npl\npl_polemo\nreviews\nIndo-European\nSlavic\nno article\nno article\n6-7\nSVO\nnegative particle\nquestion particle\nSNegVO\nstrongly suffixing\nplural suffix\nmasculine, feminine, neuter\n[@dataset_pl_polemo]\n\n\n58\npl\npl_klej_allegro_reviews\nreviews\nIndo-European\nSlavic\nno article\nno article\n6-7\nSVO\nnegative particle\nquestion particle\nSNegVO\nstrongly suffixing\nplural suffix\nmasculine, feminine, neuter\n[@dataset_pl_klej_allegro_reviews]\n\n\n59\npl\npl_opi_lil_2012\nsocial_media\nIndo-European\nSlavic\nno article\nno article\n6-7\nSVO\nnegative particle\nquestion particle\nSNegVO\nstrongly suffixing\nplural suffix\nmasculine, feminine, neuter\n[@dataset_pl_opi_lil_2012]\n\n\n60\npt\npt_dai_labor\nsocial_media\nIndo-European\nRomance\ndefinite word distinct from demonstrative\nindefinite word same as one\nno morphological case-making\nSVO\nnegative particle\nquestion particle\nSNegVO\nstrongly suffixing\nplural suffix\nmasculine, feminine\n[@dataset_dai_labor]\n\n\n61\npt\npt_ifeel\nsocial_media\nIndo-European\nRomance\ndefinite word distinct from demonstrative\nindefinite word same as one\nno morphological case-making\nSVO\nnegative particle\nquestion particle\nSNegVO\nstrongly suffixing\nplural suffix\nmasculine, feminine\n[@dataset_dai_labor]\n\n\n62\npt\npt_tweet_sent_br\nsocial_media\nIndo-European\nRomance\ndefinite word distinct from demonstrative\nindefinite word same as one\nno morphological case-making\nSVO\nnegative particle\nquestion particle\nSNegVO\nstrongly suffixing\nplural suffix\nmasculine, feminine\n[@dataset_pt_tweet_sent_br]\n\n\n63\npt\npt_twitter_sentiment\nsocial_media\nIndo-European\nRomance\ndefinite word distinct from demonstrative\nindefinite word same as one\nno morphological case-making\nSVO\nnegative particle\nquestion particle\nSNegVO\nstrongly suffixing\nplural suffix\nmasculine, feminine\n[@dataset_twitter_sentiment]\n\n\n64\nru\nru_sentiment\nsocial_media\nIndo-European\nSlavic\nno article\nno article\n6-7\nSVO\nnegative particle\nquestion particle\nSNegVO\nstrongly suffixing\nplural suffix\nmasculine, feminine, neuter\n[@dataset_ru_sentiment]\n\n\n65\nru\nru_twitter_sentiment\nsocial_media\nIndo-European\nSlavic\nno article\nno article\n6-7\nSVO\nnegative particle\nquestion particle\nSNegVO\nstrongly suffixing\nplural suffix\nmasculine, feminine, neuter\n[@dataset_twitter_sentiment]\n\n\n66\nsk\nsk_twitter_sentiment\nsocial_media\nIndo-European\nSlavic\nno article\nno article\n6-7\nSVO\nnegative affix\ninterrogative word order\nMorphNeg\nweakly suffixing\nplural suffix\nmasculine, feminine, neuter\n[@dataset_twitter_sentiment]\n\n\n67\nsl\nsl_sentinews\nnews\nIndo-European\nSlavic\nno article\nno article\n6-7\nSVO\nnegative particle\nquestion particle\nSNegVO\nstrongly suffixing\nplural suffix\nmasculine, feminine, neuter\n[@Bučar2018]\n\n\n68\nsl\nsl_twitter_sentiment\nsocial_media\nIndo-European\nSlavic\nno article\nno article\n6-7\nSVO\nnegative particle\nquestion particle\nSNegVO\nstrongly suffixing\nplural suffix\nmasculine, feminine, neuter\n[@dataset_twitter_sentiment]\n\n\n69\nsq\nsq_twitter_sentiment\nsocial_media\nIndo-European\nAlbanian\ndefinite affix\nindefinite word distinct from one\n4\nSVO\nnegative particle\nquestion particle\nSNegVO\nstrongly suffixing\nplural suffix\nmasculine, feminine\n[@dataset_twitter_sentiment]\n\n\n70\nsr\nsr_movie_reviews\nreviews\nIndo-European\nSlavic\nno article\nno article\n5\nSVO\nnegative particle\nquestion particle\nother\nstrongly suffixing\nplural suffix\nmasculine, feminine, neuter\n[@dataset_sr_serb_movie_reviews]\n\n\n71\nsr\nsr_senticomments\nreviews\nIndo-European\nSlavic\nno article\nno article\n5\nSVO\nnegative particle\nquestion particle\nother\nstrongly suffixing\nplural suffix\nmasculine, feminine, neuter\n[@dataset_sr_senticomments]\n\n\n72\nsr\nsr_twitter_sentiment\nsocial_media\nIndo-European\nSlavic\nno article\nno article\n5\nSVO\nnegative particle\nquestion particle\nother\nstrongly suffixing\nplural suffix\nmasculine, feminine, neuter\n[@dataset_twitter_sentiment]\n\n\n73\nsv\nsv_twitter_sentiment\nsocial_media\nIndo-European\nGermanic\ndefinite affix\nindefinite word same as one\n2\nSVO\nnegative particle\ninterrogative word order\nmore than one position\nstrongly suffixing\nplural suffix\ncommon, neuter\n[@dataset_twitter_sentiment]\n\n\n74\nth\nth_wongnai_reviews\nreviews\nTai-Kadai\nKam-Tai\nno article\nindefinite word distinct from one\nno morphological case-making\nSVO\nnegative auxiliary verb\nquestion particle\nSNegVO\nlittle affixation\nmixed morphological plural\nnoun classifiers\n[@dataset_th_wongnai_reviews]\n\n\n75\nth\nth_wisesight_sentiment\nsocial_media\nTai-Kadai\nKam-Tai\nno article\nindefinite word distinct from one\nno morphological case-making\nSVO\nnegative auxiliary verb\nquestion particle\nSNegVO\nlittle affixation\nmixed morphological plural\nnoun classifiers\n[@dataset_th_wisesight_sentiment]\n\n\n76\nur\nur_roman_urdu\nmixed\nIndo-European\nIndic\nno article\nno article\n2\nSOV\nnegative affix\nquestion particle\nSONegV\nstrongly suffixing\nplural suffix\nmasculine, feminine\n[@dataset_ur_roman_urdu]\n\n\n77\nzh\nzh_hotel_reviews\nreviews\nSino-Tibetan\nChinese\nno article\nindefinite word same as one\nno morphological case-making\nSVO\nnegative particle\nquestion particle\nSNegVO\nlittle affixation\nno plural\nnoun classifiers\n[@dataset_zh_hotel_reviews]\n\n\n78\nzh\nzh_multilan_amazon\nreviews\nSino-Tibetan\nChinese\nno article\nindefinite word same as one\nno morphological case-making\nSVO\nnegative particle\nquestion particle\nSNegVO\nlittle affixation\nno plural\nnoun classifiers\n[@dataset_multilan_amazon]"
+ },
+ {
+ "objectID": "dataset_card.html#dataset-stats",
+ "href": "dataset_card.html#dataset-stats",
+ "title": "MMS Dataset Card",
+ "section": "Dataset Stats",
+ "text": "Dataset Stats\n\nDatasets per language\n\npd.DataFrame(mms_dataset_df.groupby(\"language\").original_dataset.nunique().sort_values(ascending=False))\n\n\n\n\n\n\n\n\noriginal_dataset\n\n\nlanguage\n\n\n\n\n\nen\n17\n\n\nar\n9\n\n\nde\n6\n\n\nes\n5\n\n\npl\n4\n\n\ncs\n4\n\n\npt\n4\n\n\nsr\n3\n\n\nfr\n3\n\n\nth\n2\n\n\nsl\n2\n\n\nru\n2\n\n\nit\n2\n\n\nhr\n2\n\n\nzh\n2\n\n\nbg\n1\n\n\nja\n1\n\n\nlv\n1\n\n\nhu\n1\n\n\nhi\n1\n\n\nsk\n1\n\n\nhe\n1\n\n\nsq\n1\n\n\nfa\n1\n\n\nsv\n1\n\n\nbs\n1\n\n\nur\n1\n\n\n\n\n\n\n\n\n\nLabels per language\n\npd.DataFrame(mms_dataset_df.groupby(by=[\"language\", \"label_name\"]).count()[\"text\"])\n\n\n\n\n\n\n\n\n\ntext\n\n\nlanguage\nlabel_name\n\n\n\n\n\nar\nnegative\n138899\n\n\nneutral\n192774\n\n\npositive\n600402\n\n\nbg\nnegative\n13930\n\n\nneutral\n28657\n\n\npositive\n19563\n\n\nbs\nnegative\n11974\n\n\nneutral\n11145\n\n\npositive\n13064\n\n\ncs\nnegative\n39674\n\n\nneutral\n59200\n\n\npositive\n97413\n\n\nde\nnegative\n104667\n\n\nneutral\n100071\n\n\npositive\n111149\n\n\nen\nnegative\n304939\n\n\nneutral\n290823\n\n\npositive\n1734724\n\n\nes\nnegative\n108733\n\n\nneutral\n122493\n\n\npositive\n187486\n\n\nfa\nnegative\n1602\n\n\nneutral\n5091\n\n\npositive\n6832\n\n\nfr\nnegative\n84187\n\n\nneutral\n43245\n\n\npositive\n83199\n\n\nhe\nnegative\n2279\n\n\nneutral\n243\n\n\npositive\n6097\n\n\nhi\nnegative\n4992\n\n\nneutral\n6392\n\n\npositive\n5615\n\n\nhr\nnegative\n19757\n\n\nneutral\n19470\n\n\npositive\n38367\n\n\nhu\nnegative\n8974\n\n\nneutral\n17621\n\n\npositive\n30087\n\n\nit\nnegative\n4043\n\n\nneutral\n4193\n\n\npositive\n3829\n\n\nja\nnegative\n83982\n\n\nneutral\n41979\n\n\npositive\n83819\n\n\nlv\nnegative\n1378\n\n\nneutral\n2618\n\n\npositive\n1794\n\n\npl\nnegative\n77422\n\n\nneutral\n62074\n\n\npositive\n97192\n\n\npt\nnegative\n56827\n\n\nneutral\n55165\n\n\npositive\n45842\n\n\nru\nnegative\n31770\n\n\nneutral\n48106\n\n\npositive\n31054\n\n\nsk\nnegative\n14431\n\n\nneutral\n12842\n\n\npositive\n29350\n\n\nsl\nnegative\n33694\n\n\nneutral\n50553\n\n\npositive\n29296\n\n\nsq\nnegative\n6889\n\n\nneutral\n14757\n\n\npositive\n22638\n\n\nsr\nnegative\n25089\n\n\nneutral\n32283\n\n\npositive\n18996\n\n\nsv\nnegative\n16266\n\n\nneutral\n13342\n\n\npositive\n11738\n\n\nth\nnegative\n9326\n\n\nneutral\n28616\n\n\npositive\n34377\n\n\nur\nnegative\n5239\n\n\nneutral\n8585\n\n\npositive\n5836\n\n\nzh\nnegative\n117967\n\n\nneutral\n69016\n\n\npositive\n144719\n\n\n\n\n\n\n\n\n\nTexts in Language Family and Genus\n\npd.DataFrame(mms_dataset_df.groupby(by=['Family', 'Genus',]).count()[\"text\"])\n\n\n\n\n\n\n\n\n\ntext\n\n\nFamily\nGenus\n\n\n\n\n\nAfro-Asiatic\nSemitic\n940694\n\n\nIndo-European\nAlbanian\n44284\n\n\nBaltic\n5790\n\n\nGermanic\n2687719\n\n\nIndic\n36659\n\n\nIranian\n13525\n\n\nRomance\n799242\n\n\nSlavic\n966366\n\n\nJapanese\nJapanese\n209780\n\n\nSino-Tibetan\nChinese\n331702\n\n\nTai-Kadai\nKam-Tai\n72319\n\n\nUralic\nUgric\n56682\n\n\n\n\n\n\n\n\n\nExamples per domain\n\npd.DataFrame(mms_dataset_df.groupby(by=[\"domain\"]).count()[\"text\"])\n\n\n\n\n\n\n\n\ntext\n\n\ndomain\n\n\n\n\n\nchats\n16781\n\n\nmixed\n94122\n\n\nnews\n26413\n\n\npoems\n1052\n\n\nreviews\n4510893\n\n\nsocial_media\n1515501"
+ },
+ {
+ "objectID": "dataset_card.html#hosting-licensing-and-maintenance-plan",
+ "href": "dataset_card.html#hosting-licensing-and-maintenance-plan",
+ "title": "MMS Dataset Card",
+ "section": "Hosting, Licensing, and Maintenance Plan",
+ "text": "Hosting, Licensing, and Maintenance Plan\n\nHosting: The datasets and benchmark will be hosted on a reliable and scalable cloud infrastructure to ensure accessibility and availability (HuggingFace Hub). The choice of hosting platform will be based on factors such as reliability, performance, and cost-effectiveness.\nLicensing: We will clearly state the data license under which the datasets are released, ensuring that the terms of use are explicitly defined. We will consider licenses that facilitate research and allow for derivative works, while also addressing potential ethical considerations. See the license in repository.\nMaintenance: We (see Dataset Curators section) are committed to providing ongoing maintenance and support for the datasets and benchmark. This includes regular updates, bug fixes, and addressing any user feedback or inquiries. We will also establish a communication channel for users to report issues or request assistance."
+ }
+]
\ No newline at end of file
diff --git a/site_libs/bootstrap/bootstrap-icons.css b/site_libs/bootstrap/bootstrap-icons.css
new file mode 100644
index 0000000..94f1940
--- /dev/null
+++ b/site_libs/bootstrap/bootstrap-icons.css
@@ -0,0 +1,2018 @@
+@font-face {
+ font-display: block;
+ font-family: "bootstrap-icons";
+ src:
+url("./bootstrap-icons.woff?2ab2cbbe07fcebb53bdaa7313bb290f2") format("woff");
+}
+
+.bi::before,
+[class^="bi-"]::before,
+[class*=" bi-"]::before {
+ display: inline-block;
+ font-family: bootstrap-icons !important;
+ font-style: normal;
+ font-weight: normal !important;
+ font-variant: normal;
+ text-transform: none;
+ line-height: 1;
+ vertical-align: -.125em;
+ -webkit-font-smoothing: antialiased;
+ -moz-osx-font-smoothing: grayscale;
+}
+
+.bi-123::before { content: "\f67f"; }
+.bi-alarm-fill::before { content: "\f101"; }
+.bi-alarm::before { content: "\f102"; }
+.bi-align-bottom::before { content: "\f103"; }
+.bi-align-center::before { content: "\f104"; }
+.bi-align-end::before { content: "\f105"; }
+.bi-align-middle::before { content: "\f106"; }
+.bi-align-start::before { content: "\f107"; }
+.bi-align-top::before { content: "\f108"; }
+.bi-alt::before { content: "\f109"; }
+.bi-app-indicator::before { content: "\f10a"; }
+.bi-app::before { content: "\f10b"; }
+.bi-archive-fill::before { content: "\f10c"; }
+.bi-archive::before { content: "\f10d"; }
+.bi-arrow-90deg-down::before { content: "\f10e"; }
+.bi-arrow-90deg-left::before { content: "\f10f"; }
+.bi-arrow-90deg-right::before { content: "\f110"; }
+.bi-arrow-90deg-up::before { content: "\f111"; }
+.bi-arrow-bar-down::before { content: "\f112"; }
+.bi-arrow-bar-left::before { content: "\f113"; }
+.bi-arrow-bar-right::before { content: "\f114"; }
+.bi-arrow-bar-up::before { content: "\f115"; }
+.bi-arrow-clockwise::before { content: "\f116"; }
+.bi-arrow-counterclockwise::before { content: "\f117"; }
+.bi-arrow-down-circle-fill::before { content: "\f118"; }
+.bi-arrow-down-circle::before { content: "\f119"; }
+.bi-arrow-down-left-circle-fill::before { content: "\f11a"; }
+.bi-arrow-down-left-circle::before { content: "\f11b"; }
+.bi-arrow-down-left-square-fill::before { content: "\f11c"; }
+.bi-arrow-down-left-square::before { content: "\f11d"; }
+.bi-arrow-down-left::before { content: "\f11e"; }
+.bi-arrow-down-right-circle-fill::before { content: "\f11f"; }
+.bi-arrow-down-right-circle::before { content: "\f120"; }
+.bi-arrow-down-right-square-fill::before { content: "\f121"; }
+.bi-arrow-down-right-square::before { content: "\f122"; }
+.bi-arrow-down-right::before { content: "\f123"; }
+.bi-arrow-down-short::before { content: "\f124"; }
+.bi-arrow-down-square-fill::before { content: "\f125"; }
+.bi-arrow-down-square::before { content: "\f126"; }
+.bi-arrow-down-up::before { content: "\f127"; }
+.bi-arrow-down::before { content: "\f128"; }
+.bi-arrow-left-circle-fill::before { content: "\f129"; }
+.bi-arrow-left-circle::before { content: "\f12a"; }
+.bi-arrow-left-right::before { content: "\f12b"; }
+.bi-arrow-left-short::before { content: "\f12c"; }
+.bi-arrow-left-square-fill::before { content: "\f12d"; }
+.bi-arrow-left-square::before { content: "\f12e"; }
+.bi-arrow-left::before { content: "\f12f"; }
+.bi-arrow-repeat::before { content: "\f130"; }
+.bi-arrow-return-left::before { content: "\f131"; }
+.bi-arrow-return-right::before { content: "\f132"; }
+.bi-arrow-right-circle-fill::before { content: "\f133"; }
+.bi-arrow-right-circle::before { content: "\f134"; }
+.bi-arrow-right-short::before { content: "\f135"; }
+.bi-arrow-right-square-fill::before { content: "\f136"; }
+.bi-arrow-right-square::before { content: "\f137"; }
+.bi-arrow-right::before { content: "\f138"; }
+.bi-arrow-up-circle-fill::before { content: "\f139"; }
+.bi-arrow-up-circle::before { content: "\f13a"; }
+.bi-arrow-up-left-circle-fill::before { content: "\f13b"; }
+.bi-arrow-up-left-circle::before { content: "\f13c"; }
+.bi-arrow-up-left-square-fill::before { content: "\f13d"; }
+.bi-arrow-up-left-square::before { content: "\f13e"; }
+.bi-arrow-up-left::before { content: "\f13f"; }
+.bi-arrow-up-right-circle-fill::before { content: "\f140"; }
+.bi-arrow-up-right-circle::before { content: "\f141"; }
+.bi-arrow-up-right-square-fill::before { content: "\f142"; }
+.bi-arrow-up-right-square::before { content: "\f143"; }
+.bi-arrow-up-right::before { content: "\f144"; }
+.bi-arrow-up-short::before { content: "\f145"; }
+.bi-arrow-up-square-fill::before { content: "\f146"; }
+.bi-arrow-up-square::before { content: "\f147"; }
+.bi-arrow-up::before { content: "\f148"; }
+.bi-arrows-angle-contract::before { content: "\f149"; }
+.bi-arrows-angle-expand::before { content: "\f14a"; }
+.bi-arrows-collapse::before { content: "\f14b"; }
+.bi-arrows-expand::before { content: "\f14c"; }
+.bi-arrows-fullscreen::before { content: "\f14d"; }
+.bi-arrows-move::before { content: "\f14e"; }
+.bi-aspect-ratio-fill::before { content: "\f14f"; }
+.bi-aspect-ratio::before { content: "\f150"; }
+.bi-asterisk::before { content: "\f151"; }
+.bi-at::before { content: "\f152"; }
+.bi-award-fill::before { content: "\f153"; }
+.bi-award::before { content: "\f154"; }
+.bi-back::before { content: "\f155"; }
+.bi-backspace-fill::before { content: "\f156"; }
+.bi-backspace-reverse-fill::before { content: "\f157"; }
+.bi-backspace-reverse::before { content: "\f158"; }
+.bi-backspace::before { content: "\f159"; }
+.bi-badge-3d-fill::before { content: "\f15a"; }
+.bi-badge-3d::before { content: "\f15b"; }
+.bi-badge-4k-fill::before { content: "\f15c"; }
+.bi-badge-4k::before { content: "\f15d"; }
+.bi-badge-8k-fill::before { content: "\f15e"; }
+.bi-badge-8k::before { content: "\f15f"; }
+.bi-badge-ad-fill::before { content: "\f160"; }
+.bi-badge-ad::before { content: "\f161"; }
+.bi-badge-ar-fill::before { content: "\f162"; }
+.bi-badge-ar::before { content: "\f163"; }
+.bi-badge-cc-fill::before { content: "\f164"; }
+.bi-badge-cc::before { content: "\f165"; }
+.bi-badge-hd-fill::before { content: "\f166"; }
+.bi-badge-hd::before { content: "\f167"; }
+.bi-badge-tm-fill::before { content: "\f168"; }
+.bi-badge-tm::before { content: "\f169"; }
+.bi-badge-vo-fill::before { content: "\f16a"; }
+.bi-badge-vo::before { content: "\f16b"; }
+.bi-badge-vr-fill::before { content: "\f16c"; }
+.bi-badge-vr::before { content: "\f16d"; }
+.bi-badge-wc-fill::before { content: "\f16e"; }
+.bi-badge-wc::before { content: "\f16f"; }
+.bi-bag-check-fill::before { content: "\f170"; }
+.bi-bag-check::before { content: "\f171"; }
+.bi-bag-dash-fill::before { content: "\f172"; }
+.bi-bag-dash::before { content: "\f173"; }
+.bi-bag-fill::before { content: "\f174"; }
+.bi-bag-plus-fill::before { content: "\f175"; }
+.bi-bag-plus::before { content: "\f176"; }
+.bi-bag-x-fill::before { content: "\f177"; }
+.bi-bag-x::before { content: "\f178"; }
+.bi-bag::before { content: "\f179"; }
+.bi-bar-chart-fill::before { content: "\f17a"; }
+.bi-bar-chart-line-fill::before { content: "\f17b"; }
+.bi-bar-chart-line::before { content: "\f17c"; }
+.bi-bar-chart-steps::before { content: "\f17d"; }
+.bi-bar-chart::before { content: "\f17e"; }
+.bi-basket-fill::before { content: "\f17f"; }
+.bi-basket::before { content: "\f180"; }
+.bi-basket2-fill::before { content: "\f181"; }
+.bi-basket2::before { content: "\f182"; }
+.bi-basket3-fill::before { content: "\f183"; }
+.bi-basket3::before { content: "\f184"; }
+.bi-battery-charging::before { content: "\f185"; }
+.bi-battery-full::before { content: "\f186"; }
+.bi-battery-half::before { content: "\f187"; }
+.bi-battery::before { content: "\f188"; }
+.bi-bell-fill::before { content: "\f189"; }
+.bi-bell::before { content: "\f18a"; }
+.bi-bezier::before { content: "\f18b"; }
+.bi-bezier2::before { content: "\f18c"; }
+.bi-bicycle::before { content: "\f18d"; }
+.bi-binoculars-fill::before { content: "\f18e"; }
+.bi-binoculars::before { content: "\f18f"; }
+.bi-blockquote-left::before { content: "\f190"; }
+.bi-blockquote-right::before { content: "\f191"; }
+.bi-book-fill::before { content: "\f192"; }
+.bi-book-half::before { content: "\f193"; }
+.bi-book::before { content: "\f194"; }
+.bi-bookmark-check-fill::before { content: "\f195"; }
+.bi-bookmark-check::before { content: "\f196"; }
+.bi-bookmark-dash-fill::before { content: "\f197"; }
+.bi-bookmark-dash::before { content: "\f198"; }
+.bi-bookmark-fill::before { content: "\f199"; }
+.bi-bookmark-heart-fill::before { content: "\f19a"; }
+.bi-bookmark-heart::before { content: "\f19b"; }
+.bi-bookmark-plus-fill::before { content: "\f19c"; }
+.bi-bookmark-plus::before { content: "\f19d"; }
+.bi-bookmark-star-fill::before { content: "\f19e"; }
+.bi-bookmark-star::before { content: "\f19f"; }
+.bi-bookmark-x-fill::before { content: "\f1a0"; }
+.bi-bookmark-x::before { content: "\f1a1"; }
+.bi-bookmark::before { content: "\f1a2"; }
+.bi-bookmarks-fill::before { content: "\f1a3"; }
+.bi-bookmarks::before { content: "\f1a4"; }
+.bi-bookshelf::before { content: "\f1a5"; }
+.bi-bootstrap-fill::before { content: "\f1a6"; }
+.bi-bootstrap-reboot::before { content: "\f1a7"; }
+.bi-bootstrap::before { content: "\f1a8"; }
+.bi-border-all::before { content: "\f1a9"; }
+.bi-border-bottom::before { content: "\f1aa"; }
+.bi-border-center::before { content: "\f1ab"; }
+.bi-border-inner::before { content: "\f1ac"; }
+.bi-border-left::before { content: "\f1ad"; }
+.bi-border-middle::before { content: "\f1ae"; }
+.bi-border-outer::before { content: "\f1af"; }
+.bi-border-right::before { content: "\f1b0"; }
+.bi-border-style::before { content: "\f1b1"; }
+.bi-border-top::before { content: "\f1b2"; }
+.bi-border-width::before { content: "\f1b3"; }
+.bi-border::before { content: "\f1b4"; }
+.bi-bounding-box-circles::before { content: "\f1b5"; }
+.bi-bounding-box::before { content: "\f1b6"; }
+.bi-box-arrow-down-left::before { content: "\f1b7"; }
+.bi-box-arrow-down-right::before { content: "\f1b8"; }
+.bi-box-arrow-down::before { content: "\f1b9"; }
+.bi-box-arrow-in-down-left::before { content: "\f1ba"; }
+.bi-box-arrow-in-down-right::before { content: "\f1bb"; }
+.bi-box-arrow-in-down::before { content: "\f1bc"; }
+.bi-box-arrow-in-left::before { content: "\f1bd"; }
+.bi-box-arrow-in-right::before { content: "\f1be"; }
+.bi-box-arrow-in-up-left::before { content: "\f1bf"; }
+.bi-box-arrow-in-up-right::before { content: "\f1c0"; }
+.bi-box-arrow-in-up::before { content: "\f1c1"; }
+.bi-box-arrow-left::before { content: "\f1c2"; }
+.bi-box-arrow-right::before { content: "\f1c3"; }
+.bi-box-arrow-up-left::before { content: "\f1c4"; }
+.bi-box-arrow-up-right::before { content: "\f1c5"; }
+.bi-box-arrow-up::before { content: "\f1c6"; }
+.bi-box-seam::before { content: "\f1c7"; }
+.bi-box::before { content: "\f1c8"; }
+.bi-braces::before { content: "\f1c9"; }
+.bi-bricks::before { content: "\f1ca"; }
+.bi-briefcase-fill::before { content: "\f1cb"; }
+.bi-briefcase::before { content: "\f1cc"; }
+.bi-brightness-alt-high-fill::before { content: "\f1cd"; }
+.bi-brightness-alt-high::before { content: "\f1ce"; }
+.bi-brightness-alt-low-fill::before { content: "\f1cf"; }
+.bi-brightness-alt-low::before { content: "\f1d0"; }
+.bi-brightness-high-fill::before { content: "\f1d1"; }
+.bi-brightness-high::before { content: "\f1d2"; }
+.bi-brightness-low-fill::before { content: "\f1d3"; }
+.bi-brightness-low::before { content: "\f1d4"; }
+.bi-broadcast-pin::before { content: "\f1d5"; }
+.bi-broadcast::before { content: "\f1d6"; }
+.bi-brush-fill::before { content: "\f1d7"; }
+.bi-brush::before { content: "\f1d8"; }
+.bi-bucket-fill::before { content: "\f1d9"; }
+.bi-bucket::before { content: "\f1da"; }
+.bi-bug-fill::before { content: "\f1db"; }
+.bi-bug::before { content: "\f1dc"; }
+.bi-building::before { content: "\f1dd"; }
+.bi-bullseye::before { content: "\f1de"; }
+.bi-calculator-fill::before { content: "\f1df"; }
+.bi-calculator::before { content: "\f1e0"; }
+.bi-calendar-check-fill::before { content: "\f1e1"; }
+.bi-calendar-check::before { content: "\f1e2"; }
+.bi-calendar-date-fill::before { content: "\f1e3"; }
+.bi-calendar-date::before { content: "\f1e4"; }
+.bi-calendar-day-fill::before { content: "\f1e5"; }
+.bi-calendar-day::before { content: "\f1e6"; }
+.bi-calendar-event-fill::before { content: "\f1e7"; }
+.bi-calendar-event::before { content: "\f1e8"; }
+.bi-calendar-fill::before { content: "\f1e9"; }
+.bi-calendar-minus-fill::before { content: "\f1ea"; }
+.bi-calendar-minus::before { content: "\f1eb"; }
+.bi-calendar-month-fill::before { content: "\f1ec"; }
+.bi-calendar-month::before { content: "\f1ed"; }
+.bi-calendar-plus-fill::before { content: "\f1ee"; }
+.bi-calendar-plus::before { content: "\f1ef"; }
+.bi-calendar-range-fill::before { content: "\f1f0"; }
+.bi-calendar-range::before { content: "\f1f1"; }
+.bi-calendar-week-fill::before { content: "\f1f2"; }
+.bi-calendar-week::before { content: "\f1f3"; }
+.bi-calendar-x-fill::before { content: "\f1f4"; }
+.bi-calendar-x::before { content: "\f1f5"; }
+.bi-calendar::before { content: "\f1f6"; }
+.bi-calendar2-check-fill::before { content: "\f1f7"; }
+.bi-calendar2-check::before { content: "\f1f8"; }
+.bi-calendar2-date-fill::before { content: "\f1f9"; }
+.bi-calendar2-date::before { content: "\f1fa"; }
+.bi-calendar2-day-fill::before { content: "\f1fb"; }
+.bi-calendar2-day::before { content: "\f1fc"; }
+.bi-calendar2-event-fill::before { content: "\f1fd"; }
+.bi-calendar2-event::before { content: "\f1fe"; }
+.bi-calendar2-fill::before { content: "\f1ff"; }
+.bi-calendar2-minus-fill::before { content: "\f200"; }
+.bi-calendar2-minus::before { content: "\f201"; }
+.bi-calendar2-month-fill::before { content: "\f202"; }
+.bi-calendar2-month::before { content: "\f203"; }
+.bi-calendar2-plus-fill::before { content: "\f204"; }
+.bi-calendar2-plus::before { content: "\f205"; }
+.bi-calendar2-range-fill::before { content: "\f206"; }
+.bi-calendar2-range::before { content: "\f207"; }
+.bi-calendar2-week-fill::before { content: "\f208"; }
+.bi-calendar2-week::before { content: "\f209"; }
+.bi-calendar2-x-fill::before { content: "\f20a"; }
+.bi-calendar2-x::before { content: "\f20b"; }
+.bi-calendar2::before { content: "\f20c"; }
+.bi-calendar3-event-fill::before { content: "\f20d"; }
+.bi-calendar3-event::before { content: "\f20e"; }
+.bi-calendar3-fill::before { content: "\f20f"; }
+.bi-calendar3-range-fill::before { content: "\f210"; }
+.bi-calendar3-range::before { content: "\f211"; }
+.bi-calendar3-week-fill::before { content: "\f212"; }
+.bi-calendar3-week::before { content: "\f213"; }
+.bi-calendar3::before { content: "\f214"; }
+.bi-calendar4-event::before { content: "\f215"; }
+.bi-calendar4-range::before { content: "\f216"; }
+.bi-calendar4-week::before { content: "\f217"; }
+.bi-calendar4::before { content: "\f218"; }
+.bi-camera-fill::before { content: "\f219"; }
+.bi-camera-reels-fill::before { content: "\f21a"; }
+.bi-camera-reels::before { content: "\f21b"; }
+.bi-camera-video-fill::before { content: "\f21c"; }
+.bi-camera-video-off-fill::before { content: "\f21d"; }
+.bi-camera-video-off::before { content: "\f21e"; }
+.bi-camera-video::before { content: "\f21f"; }
+.bi-camera::before { content: "\f220"; }
+.bi-camera2::before { content: "\f221"; }
+.bi-capslock-fill::before { content: "\f222"; }
+.bi-capslock::before { content: "\f223"; }
+.bi-card-checklist::before { content: "\f224"; }
+.bi-card-heading::before { content: "\f225"; }
+.bi-card-image::before { content: "\f226"; }
+.bi-card-list::before { content: "\f227"; }
+.bi-card-text::before { content: "\f228"; }
+.bi-caret-down-fill::before { content: "\f229"; }
+.bi-caret-down-square-fill::before { content: "\f22a"; }
+.bi-caret-down-square::before { content: "\f22b"; }
+.bi-caret-down::before { content: "\f22c"; }
+.bi-caret-left-fill::before { content: "\f22d"; }
+.bi-caret-left-square-fill::before { content: "\f22e"; }
+.bi-caret-left-square::before { content: "\f22f"; }
+.bi-caret-left::before { content: "\f230"; }
+.bi-caret-right-fill::before { content: "\f231"; }
+.bi-caret-right-square-fill::before { content: "\f232"; }
+.bi-caret-right-square::before { content: "\f233"; }
+.bi-caret-right::before { content: "\f234"; }
+.bi-caret-up-fill::before { content: "\f235"; }
+.bi-caret-up-square-fill::before { content: "\f236"; }
+.bi-caret-up-square::before { content: "\f237"; }
+.bi-caret-up::before { content: "\f238"; }
+.bi-cart-check-fill::before { content: "\f239"; }
+.bi-cart-check::before { content: "\f23a"; }
+.bi-cart-dash-fill::before { content: "\f23b"; }
+.bi-cart-dash::before { content: "\f23c"; }
+.bi-cart-fill::before { content: "\f23d"; }
+.bi-cart-plus-fill::before { content: "\f23e"; }
+.bi-cart-plus::before { content: "\f23f"; }
+.bi-cart-x-fill::before { content: "\f240"; }
+.bi-cart-x::before { content: "\f241"; }
+.bi-cart::before { content: "\f242"; }
+.bi-cart2::before { content: "\f243"; }
+.bi-cart3::before { content: "\f244"; }
+.bi-cart4::before { content: "\f245"; }
+.bi-cash-stack::before { content: "\f246"; }
+.bi-cash::before { content: "\f247"; }
+.bi-cast::before { content: "\f248"; }
+.bi-chat-dots-fill::before { content: "\f249"; }
+.bi-chat-dots::before { content: "\f24a"; }
+.bi-chat-fill::before { content: "\f24b"; }
+.bi-chat-left-dots-fill::before { content: "\f24c"; }
+.bi-chat-left-dots::before { content: "\f24d"; }
+.bi-chat-left-fill::before { content: "\f24e"; }
+.bi-chat-left-quote-fill::before { content: "\f24f"; }
+.bi-chat-left-quote::before { content: "\f250"; }
+.bi-chat-left-text-fill::before { content: "\f251"; }
+.bi-chat-left-text::before { content: "\f252"; }
+.bi-chat-left::before { content: "\f253"; }
+.bi-chat-quote-fill::before { content: "\f254"; }
+.bi-chat-quote::before { content: "\f255"; }
+.bi-chat-right-dots-fill::before { content: "\f256"; }
+.bi-chat-right-dots::before { content: "\f257"; }
+.bi-chat-right-fill::before { content: "\f258"; }
+.bi-chat-right-quote-fill::before { content: "\f259"; }
+.bi-chat-right-quote::before { content: "\f25a"; }
+.bi-chat-right-text-fill::before { content: "\f25b"; }
+.bi-chat-right-text::before { content: "\f25c"; }
+.bi-chat-right::before { content: "\f25d"; }
+.bi-chat-square-dots-fill::before { content: "\f25e"; }
+.bi-chat-square-dots::before { content: "\f25f"; }
+.bi-chat-square-fill::before { content: "\f260"; }
+.bi-chat-square-quote-fill::before { content: "\f261"; }
+.bi-chat-square-quote::before { content: "\f262"; }
+.bi-chat-square-text-fill::before { content: "\f263"; }
+.bi-chat-square-text::before { content: "\f264"; }
+.bi-chat-square::before { content: "\f265"; }
+.bi-chat-text-fill::before { content: "\f266"; }
+.bi-chat-text::before { content: "\f267"; }
+.bi-chat::before { content: "\f268"; }
+.bi-check-all::before { content: "\f269"; }
+.bi-check-circle-fill::before { content: "\f26a"; }
+.bi-check-circle::before { content: "\f26b"; }
+.bi-check-square-fill::before { content: "\f26c"; }
+.bi-check-square::before { content: "\f26d"; }
+.bi-check::before { content: "\f26e"; }
+.bi-check2-all::before { content: "\f26f"; }
+.bi-check2-circle::before { content: "\f270"; }
+.bi-check2-square::before { content: "\f271"; }
+.bi-check2::before { content: "\f272"; }
+.bi-chevron-bar-contract::before { content: "\f273"; }
+.bi-chevron-bar-down::before { content: "\f274"; }
+.bi-chevron-bar-expand::before { content: "\f275"; }
+.bi-chevron-bar-left::before { content: "\f276"; }
+.bi-chevron-bar-right::before { content: "\f277"; }
+.bi-chevron-bar-up::before { content: "\f278"; }
+.bi-chevron-compact-down::before { content: "\f279"; }
+.bi-chevron-compact-left::before { content: "\f27a"; }
+.bi-chevron-compact-right::before { content: "\f27b"; }
+.bi-chevron-compact-up::before { content: "\f27c"; }
+.bi-chevron-contract::before { content: "\f27d"; }
+.bi-chevron-double-down::before { content: "\f27e"; }
+.bi-chevron-double-left::before { content: "\f27f"; }
+.bi-chevron-double-right::before { content: "\f280"; }
+.bi-chevron-double-up::before { content: "\f281"; }
+.bi-chevron-down::before { content: "\f282"; }
+.bi-chevron-expand::before { content: "\f283"; }
+.bi-chevron-left::before { content: "\f284"; }
+.bi-chevron-right::before { content: "\f285"; }
+.bi-chevron-up::before { content: "\f286"; }
+.bi-circle-fill::before { content: "\f287"; }
+.bi-circle-half::before { content: "\f288"; }
+.bi-circle-square::before { content: "\f289"; }
+.bi-circle::before { content: "\f28a"; }
+.bi-clipboard-check::before { content: "\f28b"; }
+.bi-clipboard-data::before { content: "\f28c"; }
+.bi-clipboard-minus::before { content: "\f28d"; }
+.bi-clipboard-plus::before { content: "\f28e"; }
+.bi-clipboard-x::before { content: "\f28f"; }
+.bi-clipboard::before { content: "\f290"; }
+.bi-clock-fill::before { content: "\f291"; }
+.bi-clock-history::before { content: "\f292"; }
+.bi-clock::before { content: "\f293"; }
+.bi-cloud-arrow-down-fill::before { content: "\f294"; }
+.bi-cloud-arrow-down::before { content: "\f295"; }
+.bi-cloud-arrow-up-fill::before { content: "\f296"; }
+.bi-cloud-arrow-up::before { content: "\f297"; }
+.bi-cloud-check-fill::before { content: "\f298"; }
+.bi-cloud-check::before { content: "\f299"; }
+.bi-cloud-download-fill::before { content: "\f29a"; }
+.bi-cloud-download::before { content: "\f29b"; }
+.bi-cloud-drizzle-fill::before { content: "\f29c"; }
+.bi-cloud-drizzle::before { content: "\f29d"; }
+.bi-cloud-fill::before { content: "\f29e"; }
+.bi-cloud-fog-fill::before { content: "\f29f"; }
+.bi-cloud-fog::before { content: "\f2a0"; }
+.bi-cloud-fog2-fill::before { content: "\f2a1"; }
+.bi-cloud-fog2::before { content: "\f2a2"; }
+.bi-cloud-hail-fill::before { content: "\f2a3"; }
+.bi-cloud-hail::before { content: "\f2a4"; }
+.bi-cloud-haze-1::before { content: "\f2a5"; }
+.bi-cloud-haze-fill::before { content: "\f2a6"; }
+.bi-cloud-haze::before { content: "\f2a7"; }
+.bi-cloud-haze2-fill::before { content: "\f2a8"; }
+.bi-cloud-lightning-fill::before { content: "\f2a9"; }
+.bi-cloud-lightning-rain-fill::before { content: "\f2aa"; }
+.bi-cloud-lightning-rain::before { content: "\f2ab"; }
+.bi-cloud-lightning::before { content: "\f2ac"; }
+.bi-cloud-minus-fill::before { content: "\f2ad"; }
+.bi-cloud-minus::before { content: "\f2ae"; }
+.bi-cloud-moon-fill::before { content: "\f2af"; }
+.bi-cloud-moon::before { content: "\f2b0"; }
+.bi-cloud-plus-fill::before { content: "\f2b1"; }
+.bi-cloud-plus::before { content: "\f2b2"; }
+.bi-cloud-rain-fill::before { content: "\f2b3"; }
+.bi-cloud-rain-heavy-fill::before { content: "\f2b4"; }
+.bi-cloud-rain-heavy::before { content: "\f2b5"; }
+.bi-cloud-rain::before { content: "\f2b6"; }
+.bi-cloud-slash-fill::before { content: "\f2b7"; }
+.bi-cloud-slash::before { content: "\f2b8"; }
+.bi-cloud-sleet-fill::before { content: "\f2b9"; }
+.bi-cloud-sleet::before { content: "\f2ba"; }
+.bi-cloud-snow-fill::before { content: "\f2bb"; }
+.bi-cloud-snow::before { content: "\f2bc"; }
+.bi-cloud-sun-fill::before { content: "\f2bd"; }
+.bi-cloud-sun::before { content: "\f2be"; }
+.bi-cloud-upload-fill::before { content: "\f2bf"; }
+.bi-cloud-upload::before { content: "\f2c0"; }
+.bi-cloud::before { content: "\f2c1"; }
+.bi-clouds-fill::before { content: "\f2c2"; }
+.bi-clouds::before { content: "\f2c3"; }
+.bi-cloudy-fill::before { content: "\f2c4"; }
+.bi-cloudy::before { content: "\f2c5"; }
+.bi-code-slash::before { content: "\f2c6"; }
+.bi-code-square::before { content: "\f2c7"; }
+.bi-code::before { content: "\f2c8"; }
+.bi-collection-fill::before { content: "\f2c9"; }
+.bi-collection-play-fill::before { content: "\f2ca"; }
+.bi-collection-play::before { content: "\f2cb"; }
+.bi-collection::before { content: "\f2cc"; }
+.bi-columns-gap::before { content: "\f2cd"; }
+.bi-columns::before { content: "\f2ce"; }
+.bi-command::before { content: "\f2cf"; }
+.bi-compass-fill::before { content: "\f2d0"; }
+.bi-compass::before { content: "\f2d1"; }
+.bi-cone-striped::before { content: "\f2d2"; }
+.bi-cone::before { content: "\f2d3"; }
+.bi-controller::before { content: "\f2d4"; }
+.bi-cpu-fill::before { content: "\f2d5"; }
+.bi-cpu::before { content: "\f2d6"; }
+.bi-credit-card-2-back-fill::before { content: "\f2d7"; }
+.bi-credit-card-2-back::before { content: "\f2d8"; }
+.bi-credit-card-2-front-fill::before { content: "\f2d9"; }
+.bi-credit-card-2-front::before { content: "\f2da"; }
+.bi-credit-card-fill::before { content: "\f2db"; }
+.bi-credit-card::before { content: "\f2dc"; }
+.bi-crop::before { content: "\f2dd"; }
+.bi-cup-fill::before { content: "\f2de"; }
+.bi-cup-straw::before { content: "\f2df"; }
+.bi-cup::before { content: "\f2e0"; }
+.bi-cursor-fill::before { content: "\f2e1"; }
+.bi-cursor-text::before { content: "\f2e2"; }
+.bi-cursor::before { content: "\f2e3"; }
+.bi-dash-circle-dotted::before { content: "\f2e4"; }
+.bi-dash-circle-fill::before { content: "\f2e5"; }
+.bi-dash-circle::before { content: "\f2e6"; }
+.bi-dash-square-dotted::before { content: "\f2e7"; }
+.bi-dash-square-fill::before { content: "\f2e8"; }
+.bi-dash-square::before { content: "\f2e9"; }
+.bi-dash::before { content: "\f2ea"; }
+.bi-diagram-2-fill::before { content: "\f2eb"; }
+.bi-diagram-2::before { content: "\f2ec"; }
+.bi-diagram-3-fill::before { content: "\f2ed"; }
+.bi-diagram-3::before { content: "\f2ee"; }
+.bi-diamond-fill::before { content: "\f2ef"; }
+.bi-diamond-half::before { content: "\f2f0"; }
+.bi-diamond::before { content: "\f2f1"; }
+.bi-dice-1-fill::before { content: "\f2f2"; }
+.bi-dice-1::before { content: "\f2f3"; }
+.bi-dice-2-fill::before { content: "\f2f4"; }
+.bi-dice-2::before { content: "\f2f5"; }
+.bi-dice-3-fill::before { content: "\f2f6"; }
+.bi-dice-3::before { content: "\f2f7"; }
+.bi-dice-4-fill::before { content: "\f2f8"; }
+.bi-dice-4::before { content: "\f2f9"; }
+.bi-dice-5-fill::before { content: "\f2fa"; }
+.bi-dice-5::before { content: "\f2fb"; }
+.bi-dice-6-fill::before { content: "\f2fc"; }
+.bi-dice-6::before { content: "\f2fd"; }
+.bi-disc-fill::before { content: "\f2fe"; }
+.bi-disc::before { content: "\f2ff"; }
+.bi-discord::before { content: "\f300"; }
+.bi-display-fill::before { content: "\f301"; }
+.bi-display::before { content: "\f302"; }
+.bi-distribute-horizontal::before { content: "\f303"; }
+.bi-distribute-vertical::before { content: "\f304"; }
+.bi-door-closed-fill::before { content: "\f305"; }
+.bi-door-closed::before { content: "\f306"; }
+.bi-door-open-fill::before { content: "\f307"; }
+.bi-door-open::before { content: "\f308"; }
+.bi-dot::before { content: "\f309"; }
+.bi-download::before { content: "\f30a"; }
+.bi-droplet-fill::before { content: "\f30b"; }
+.bi-droplet-half::before { content: "\f30c"; }
+.bi-droplet::before { content: "\f30d"; }
+.bi-earbuds::before { content: "\f30e"; }
+.bi-easel-fill::before { content: "\f30f"; }
+.bi-easel::before { content: "\f310"; }
+.bi-egg-fill::before { content: "\f311"; }
+.bi-egg-fried::before { content: "\f312"; }
+.bi-egg::before { content: "\f313"; }
+.bi-eject-fill::before { content: "\f314"; }
+.bi-eject::before { content: "\f315"; }
+.bi-emoji-angry-fill::before { content: "\f316"; }
+.bi-emoji-angry::before { content: "\f317"; }
+.bi-emoji-dizzy-fill::before { content: "\f318"; }
+.bi-emoji-dizzy::before { content: "\f319"; }
+.bi-emoji-expressionless-fill::before { content: "\f31a"; }
+.bi-emoji-expressionless::before { content: "\f31b"; }
+.bi-emoji-frown-fill::before { content: "\f31c"; }
+.bi-emoji-frown::before { content: "\f31d"; }
+.bi-emoji-heart-eyes-fill::before { content: "\f31e"; }
+.bi-emoji-heart-eyes::before { content: "\f31f"; }
+.bi-emoji-laughing-fill::before { content: "\f320"; }
+.bi-emoji-laughing::before { content: "\f321"; }
+.bi-emoji-neutral-fill::before { content: "\f322"; }
+.bi-emoji-neutral::before { content: "\f323"; }
+.bi-emoji-smile-fill::before { content: "\f324"; }
+.bi-emoji-smile-upside-down-fill::before { content: "\f325"; }
+.bi-emoji-smile-upside-down::before { content: "\f326"; }
+.bi-emoji-smile::before { content: "\f327"; }
+.bi-emoji-sunglasses-fill::before { content: "\f328"; }
+.bi-emoji-sunglasses::before { content: "\f329"; }
+.bi-emoji-wink-fill::before { content: "\f32a"; }
+.bi-emoji-wink::before { content: "\f32b"; }
+.bi-envelope-fill::before { content: "\f32c"; }
+.bi-envelope-open-fill::before { content: "\f32d"; }
+.bi-envelope-open::before { content: "\f32e"; }
+.bi-envelope::before { content: "\f32f"; }
+.bi-eraser-fill::before { content: "\f330"; }
+.bi-eraser::before { content: "\f331"; }
+.bi-exclamation-circle-fill::before { content: "\f332"; }
+.bi-exclamation-circle::before { content: "\f333"; }
+.bi-exclamation-diamond-fill::before { content: "\f334"; }
+.bi-exclamation-diamond::before { content: "\f335"; }
+.bi-exclamation-octagon-fill::before { content: "\f336"; }
+.bi-exclamation-octagon::before { content: "\f337"; }
+.bi-exclamation-square-fill::before { content: "\f338"; }
+.bi-exclamation-square::before { content: "\f339"; }
+.bi-exclamation-triangle-fill::before { content: "\f33a"; }
+.bi-exclamation-triangle::before { content: "\f33b"; }
+.bi-exclamation::before { content: "\f33c"; }
+.bi-exclude::before { content: "\f33d"; }
+.bi-eye-fill::before { content: "\f33e"; }
+.bi-eye-slash-fill::before { content: "\f33f"; }
+.bi-eye-slash::before { content: "\f340"; }
+.bi-eye::before { content: "\f341"; }
+.bi-eyedropper::before { content: "\f342"; }
+.bi-eyeglasses::before { content: "\f343"; }
+.bi-facebook::before { content: "\f344"; }
+.bi-file-arrow-down-fill::before { content: "\f345"; }
+.bi-file-arrow-down::before { content: "\f346"; }
+.bi-file-arrow-up-fill::before { content: "\f347"; }
+.bi-file-arrow-up::before { content: "\f348"; }
+.bi-file-bar-graph-fill::before { content: "\f349"; }
+.bi-file-bar-graph::before { content: "\f34a"; }
+.bi-file-binary-fill::before { content: "\f34b"; }
+.bi-file-binary::before { content: "\f34c"; }
+.bi-file-break-fill::before { content: "\f34d"; }
+.bi-file-break::before { content: "\f34e"; }
+.bi-file-check-fill::before { content: "\f34f"; }
+.bi-file-check::before { content: "\f350"; }
+.bi-file-code-fill::before { content: "\f351"; }
+.bi-file-code::before { content: "\f352"; }
+.bi-file-diff-fill::before { content: "\f353"; }
+.bi-file-diff::before { content: "\f354"; }
+.bi-file-earmark-arrow-down-fill::before { content: "\f355"; }
+.bi-file-earmark-arrow-down::before { content: "\f356"; }
+.bi-file-earmark-arrow-up-fill::before { content: "\f357"; }
+.bi-file-earmark-arrow-up::before { content: "\f358"; }
+.bi-file-earmark-bar-graph-fill::before { content: "\f359"; }
+.bi-file-earmark-bar-graph::before { content: "\f35a"; }
+.bi-file-earmark-binary-fill::before { content: "\f35b"; }
+.bi-file-earmark-binary::before { content: "\f35c"; }
+.bi-file-earmark-break-fill::before { content: "\f35d"; }
+.bi-file-earmark-break::before { content: "\f35e"; }
+.bi-file-earmark-check-fill::before { content: "\f35f"; }
+.bi-file-earmark-check::before { content: "\f360"; }
+.bi-file-earmark-code-fill::before { content: "\f361"; }
+.bi-file-earmark-code::before { content: "\f362"; }
+.bi-file-earmark-diff-fill::before { content: "\f363"; }
+.bi-file-earmark-diff::before { content: "\f364"; }
+.bi-file-earmark-easel-fill::before { content: "\f365"; }
+.bi-file-earmark-easel::before { content: "\f366"; }
+.bi-file-earmark-excel-fill::before { content: "\f367"; }
+.bi-file-earmark-excel::before { content: "\f368"; }
+.bi-file-earmark-fill::before { content: "\f369"; }
+.bi-file-earmark-font-fill::before { content: "\f36a"; }
+.bi-file-earmark-font::before { content: "\f36b"; }
+.bi-file-earmark-image-fill::before { content: "\f36c"; }
+.bi-file-earmark-image::before { content: "\f36d"; }
+.bi-file-earmark-lock-fill::before { content: "\f36e"; }
+.bi-file-earmark-lock::before { content: "\f36f"; }
+.bi-file-earmark-lock2-fill::before { content: "\f370"; }
+.bi-file-earmark-lock2::before { content: "\f371"; }
+.bi-file-earmark-medical-fill::before { content: "\f372"; }
+.bi-file-earmark-medical::before { content: "\f373"; }
+.bi-file-earmark-minus-fill::before { content: "\f374"; }
+.bi-file-earmark-minus::before { content: "\f375"; }
+.bi-file-earmark-music-fill::before { content: "\f376"; }
+.bi-file-earmark-music::before { content: "\f377"; }
+.bi-file-earmark-person-fill::before { content: "\f378"; }
+.bi-file-earmark-person::before { content: "\f379"; }
+.bi-file-earmark-play-fill::before { content: "\f37a"; }
+.bi-file-earmark-play::before { content: "\f37b"; }
+.bi-file-earmark-plus-fill::before { content: "\f37c"; }
+.bi-file-earmark-plus::before { content: "\f37d"; }
+.bi-file-earmark-post-fill::before { content: "\f37e"; }
+.bi-file-earmark-post::before { content: "\f37f"; }
+.bi-file-earmark-ppt-fill::before { content: "\f380"; }
+.bi-file-earmark-ppt::before { content: "\f381"; }
+.bi-file-earmark-richtext-fill::before { content: "\f382"; }
+.bi-file-earmark-richtext::before { content: "\f383"; }
+.bi-file-earmark-ruled-fill::before { content: "\f384"; }
+.bi-file-earmark-ruled::before { content: "\f385"; }
+.bi-file-earmark-slides-fill::before { content: "\f386"; }
+.bi-file-earmark-slides::before { content: "\f387"; }
+.bi-file-earmark-spreadsheet-fill::before { content: "\f388"; }
+.bi-file-earmark-spreadsheet::before { content: "\f389"; }
+.bi-file-earmark-text-fill::before { content: "\f38a"; }
+.bi-file-earmark-text::before { content: "\f38b"; }
+.bi-file-earmark-word-fill::before { content: "\f38c"; }
+.bi-file-earmark-word::before { content: "\f38d"; }
+.bi-file-earmark-x-fill::before { content: "\f38e"; }
+.bi-file-earmark-x::before { content: "\f38f"; }
+.bi-file-earmark-zip-fill::before { content: "\f390"; }
+.bi-file-earmark-zip::before { content: "\f391"; }
+.bi-file-earmark::before { content: "\f392"; }
+.bi-file-easel-fill::before { content: "\f393"; }
+.bi-file-easel::before { content: "\f394"; }
+.bi-file-excel-fill::before { content: "\f395"; }
+.bi-file-excel::before { content: "\f396"; }
+.bi-file-fill::before { content: "\f397"; }
+.bi-file-font-fill::before { content: "\f398"; }
+.bi-file-font::before { content: "\f399"; }
+.bi-file-image-fill::before { content: "\f39a"; }
+.bi-file-image::before { content: "\f39b"; }
+.bi-file-lock-fill::before { content: "\f39c"; }
+.bi-file-lock::before { content: "\f39d"; }
+.bi-file-lock2-fill::before { content: "\f39e"; }
+.bi-file-lock2::before { content: "\f39f"; }
+.bi-file-medical-fill::before { content: "\f3a0"; }
+.bi-file-medical::before { content: "\f3a1"; }
+.bi-file-minus-fill::before { content: "\f3a2"; }
+.bi-file-minus::before { content: "\f3a3"; }
+.bi-file-music-fill::before { content: "\f3a4"; }
+.bi-file-music::before { content: "\f3a5"; }
+.bi-file-person-fill::before { content: "\f3a6"; }
+.bi-file-person::before { content: "\f3a7"; }
+.bi-file-play-fill::before { content: "\f3a8"; }
+.bi-file-play::before { content: "\f3a9"; }
+.bi-file-plus-fill::before { content: "\f3aa"; }
+.bi-file-plus::before { content: "\f3ab"; }
+.bi-file-post-fill::before { content: "\f3ac"; }
+.bi-file-post::before { content: "\f3ad"; }
+.bi-file-ppt-fill::before { content: "\f3ae"; }
+.bi-file-ppt::before { content: "\f3af"; }
+.bi-file-richtext-fill::before { content: "\f3b0"; }
+.bi-file-richtext::before { content: "\f3b1"; }
+.bi-file-ruled-fill::before { content: "\f3b2"; }
+.bi-file-ruled::before { content: "\f3b3"; }
+.bi-file-slides-fill::before { content: "\f3b4"; }
+.bi-file-slides::before { content: "\f3b5"; }
+.bi-file-spreadsheet-fill::before { content: "\f3b6"; }
+.bi-file-spreadsheet::before { content: "\f3b7"; }
+.bi-file-text-fill::before { content: "\f3b8"; }
+.bi-file-text::before { content: "\f3b9"; }
+.bi-file-word-fill::before { content: "\f3ba"; }
+.bi-file-word::before { content: "\f3bb"; }
+.bi-file-x-fill::before { content: "\f3bc"; }
+.bi-file-x::before { content: "\f3bd"; }
+.bi-file-zip-fill::before { content: "\f3be"; }
+.bi-file-zip::before { content: "\f3bf"; }
+.bi-file::before { content: "\f3c0"; }
+.bi-files-alt::before { content: "\f3c1"; }
+.bi-files::before { content: "\f3c2"; }
+.bi-film::before { content: "\f3c3"; }
+.bi-filter-circle-fill::before { content: "\f3c4"; }
+.bi-filter-circle::before { content: "\f3c5"; }
+.bi-filter-left::before { content: "\f3c6"; }
+.bi-filter-right::before { content: "\f3c7"; }
+.bi-filter-square-fill::before { content: "\f3c8"; }
+.bi-filter-square::before { content: "\f3c9"; }
+.bi-filter::before { content: "\f3ca"; }
+.bi-flag-fill::before { content: "\f3cb"; }
+.bi-flag::before { content: "\f3cc"; }
+.bi-flower1::before { content: "\f3cd"; }
+.bi-flower2::before { content: "\f3ce"; }
+.bi-flower3::before { content: "\f3cf"; }
+.bi-folder-check::before { content: "\f3d0"; }
+.bi-folder-fill::before { content: "\f3d1"; }
+.bi-folder-minus::before { content: "\f3d2"; }
+.bi-folder-plus::before { content: "\f3d3"; }
+.bi-folder-symlink-fill::before { content: "\f3d4"; }
+.bi-folder-symlink::before { content: "\f3d5"; }
+.bi-folder-x::before { content: "\f3d6"; }
+.bi-folder::before { content: "\f3d7"; }
+.bi-folder2-open::before { content: "\f3d8"; }
+.bi-folder2::before { content: "\f3d9"; }
+.bi-fonts::before { content: "\f3da"; }
+.bi-forward-fill::before { content: "\f3db"; }
+.bi-forward::before { content: "\f3dc"; }
+.bi-front::before { content: "\f3dd"; }
+.bi-fullscreen-exit::before { content: "\f3de"; }
+.bi-fullscreen::before { content: "\f3df"; }
+.bi-funnel-fill::before { content: "\f3e0"; }
+.bi-funnel::before { content: "\f3e1"; }
+.bi-gear-fill::before { content: "\f3e2"; }
+.bi-gear-wide-connected::before { content: "\f3e3"; }
+.bi-gear-wide::before { content: "\f3e4"; }
+.bi-gear::before { content: "\f3e5"; }
+.bi-gem::before { content: "\f3e6"; }
+.bi-geo-alt-fill::before { content: "\f3e7"; }
+.bi-geo-alt::before { content: "\f3e8"; }
+.bi-geo-fill::before { content: "\f3e9"; }
+.bi-geo::before { content: "\f3ea"; }
+.bi-gift-fill::before { content: "\f3eb"; }
+.bi-gift::before { content: "\f3ec"; }
+.bi-github::before { content: "\f3ed"; }
+.bi-globe::before { content: "\f3ee"; }
+.bi-globe2::before { content: "\f3ef"; }
+.bi-google::before { content: "\f3f0"; }
+.bi-graph-down::before { content: "\f3f1"; }
+.bi-graph-up::before { content: "\f3f2"; }
+.bi-grid-1x2-fill::before { content: "\f3f3"; }
+.bi-grid-1x2::before { content: "\f3f4"; }
+.bi-grid-3x2-gap-fill::before { content: "\f3f5"; }
+.bi-grid-3x2-gap::before { content: "\f3f6"; }
+.bi-grid-3x2::before { content: "\f3f7"; }
+.bi-grid-3x3-gap-fill::before { content: "\f3f8"; }
+.bi-grid-3x3-gap::before { content: "\f3f9"; }
+.bi-grid-3x3::before { content: "\f3fa"; }
+.bi-grid-fill::before { content: "\f3fb"; }
+.bi-grid::before { content: "\f3fc"; }
+.bi-grip-horizontal::before { content: "\f3fd"; }
+.bi-grip-vertical::before { content: "\f3fe"; }
+.bi-hammer::before { content: "\f3ff"; }
+.bi-hand-index-fill::before { content: "\f400"; }
+.bi-hand-index-thumb-fill::before { content: "\f401"; }
+.bi-hand-index-thumb::before { content: "\f402"; }
+.bi-hand-index::before { content: "\f403"; }
+.bi-hand-thumbs-down-fill::before { content: "\f404"; }
+.bi-hand-thumbs-down::before { content: "\f405"; }
+.bi-hand-thumbs-up-fill::before { content: "\f406"; }
+.bi-hand-thumbs-up::before { content: "\f407"; }
+.bi-handbag-fill::before { content: "\f408"; }
+.bi-handbag::before { content: "\f409"; }
+.bi-hash::before { content: "\f40a"; }
+.bi-hdd-fill::before { content: "\f40b"; }
+.bi-hdd-network-fill::before { content: "\f40c"; }
+.bi-hdd-network::before { content: "\f40d"; }
+.bi-hdd-rack-fill::before { content: "\f40e"; }
+.bi-hdd-rack::before { content: "\f40f"; }
+.bi-hdd-stack-fill::before { content: "\f410"; }
+.bi-hdd-stack::before { content: "\f411"; }
+.bi-hdd::before { content: "\f412"; }
+.bi-headphones::before { content: "\f413"; }
+.bi-headset::before { content: "\f414"; }
+.bi-heart-fill::before { content: "\f415"; }
+.bi-heart-half::before { content: "\f416"; }
+.bi-heart::before { content: "\f417"; }
+.bi-heptagon-fill::before { content: "\f418"; }
+.bi-heptagon-half::before { content: "\f419"; }
+.bi-heptagon::before { content: "\f41a"; }
+.bi-hexagon-fill::before { content: "\f41b"; }
+.bi-hexagon-half::before { content: "\f41c"; }
+.bi-hexagon::before { content: "\f41d"; }
+.bi-hourglass-bottom::before { content: "\f41e"; }
+.bi-hourglass-split::before { content: "\f41f"; }
+.bi-hourglass-top::before { content: "\f420"; }
+.bi-hourglass::before { content: "\f421"; }
+.bi-house-door-fill::before { content: "\f422"; }
+.bi-house-door::before { content: "\f423"; }
+.bi-house-fill::before { content: "\f424"; }
+.bi-house::before { content: "\f425"; }
+.bi-hr::before { content: "\f426"; }
+.bi-hurricane::before { content: "\f427"; }
+.bi-image-alt::before { content: "\f428"; }
+.bi-image-fill::before { content: "\f429"; }
+.bi-image::before { content: "\f42a"; }
+.bi-images::before { content: "\f42b"; }
+.bi-inbox-fill::before { content: "\f42c"; }
+.bi-inbox::before { content: "\f42d"; }
+.bi-inboxes-fill::before { content: "\f42e"; }
+.bi-inboxes::before { content: "\f42f"; }
+.bi-info-circle-fill::before { content: "\f430"; }
+.bi-info-circle::before { content: "\f431"; }
+.bi-info-square-fill::before { content: "\f432"; }
+.bi-info-square::before { content: "\f433"; }
+.bi-info::before { content: "\f434"; }
+.bi-input-cursor-text::before { content: "\f435"; }
+.bi-input-cursor::before { content: "\f436"; }
+.bi-instagram::before { content: "\f437"; }
+.bi-intersect::before { content: "\f438"; }
+.bi-journal-album::before { content: "\f439"; }
+.bi-journal-arrow-down::before { content: "\f43a"; }
+.bi-journal-arrow-up::before { content: "\f43b"; }
+.bi-journal-bookmark-fill::before { content: "\f43c"; }
+.bi-journal-bookmark::before { content: "\f43d"; }
+.bi-journal-check::before { content: "\f43e"; }
+.bi-journal-code::before { content: "\f43f"; }
+.bi-journal-medical::before { content: "\f440"; }
+.bi-journal-minus::before { content: "\f441"; }
+.bi-journal-plus::before { content: "\f442"; }
+.bi-journal-richtext::before { content: "\f443"; }
+.bi-journal-text::before { content: "\f444"; }
+.bi-journal-x::before { content: "\f445"; }
+.bi-journal::before { content: "\f446"; }
+.bi-journals::before { content: "\f447"; }
+.bi-joystick::before { content: "\f448"; }
+.bi-justify-left::before { content: "\f449"; }
+.bi-justify-right::before { content: "\f44a"; }
+.bi-justify::before { content: "\f44b"; }
+.bi-kanban-fill::before { content: "\f44c"; }
+.bi-kanban::before { content: "\f44d"; }
+.bi-key-fill::before { content: "\f44e"; }
+.bi-key::before { content: "\f44f"; }
+.bi-keyboard-fill::before { content: "\f450"; }
+.bi-keyboard::before { content: "\f451"; }
+.bi-ladder::before { content: "\f452"; }
+.bi-lamp-fill::before { content: "\f453"; }
+.bi-lamp::before { content: "\f454"; }
+.bi-laptop-fill::before { content: "\f455"; }
+.bi-laptop::before { content: "\f456"; }
+.bi-layer-backward::before { content: "\f457"; }
+.bi-layer-forward::before { content: "\f458"; }
+.bi-layers-fill::before { content: "\f459"; }
+.bi-layers-half::before { content: "\f45a"; }
+.bi-layers::before { content: "\f45b"; }
+.bi-layout-sidebar-inset-reverse::before { content: "\f45c"; }
+.bi-layout-sidebar-inset::before { content: "\f45d"; }
+.bi-layout-sidebar-reverse::before { content: "\f45e"; }
+.bi-layout-sidebar::before { content: "\f45f"; }
+.bi-layout-split::before { content: "\f460"; }
+.bi-layout-text-sidebar-reverse::before { content: "\f461"; }
+.bi-layout-text-sidebar::before { content: "\f462"; }
+.bi-layout-text-window-reverse::before { content: "\f463"; }
+.bi-layout-text-window::before { content: "\f464"; }
+.bi-layout-three-columns::before { content: "\f465"; }
+.bi-layout-wtf::before { content: "\f466"; }
+.bi-life-preserver::before { content: "\f467"; }
+.bi-lightbulb-fill::before { content: "\f468"; }
+.bi-lightbulb-off-fill::before { content: "\f469"; }
+.bi-lightbulb-off::before { content: "\f46a"; }
+.bi-lightbulb::before { content: "\f46b"; }
+.bi-lightning-charge-fill::before { content: "\f46c"; }
+.bi-lightning-charge::before { content: "\f46d"; }
+.bi-lightning-fill::before { content: "\f46e"; }
+.bi-lightning::before { content: "\f46f"; }
+.bi-link-45deg::before { content: "\f470"; }
+.bi-link::before { content: "\f471"; }
+.bi-linkedin::before { content: "\f472"; }
+.bi-list-check::before { content: "\f473"; }
+.bi-list-nested::before { content: "\f474"; }
+.bi-list-ol::before { content: "\f475"; }
+.bi-list-stars::before { content: "\f476"; }
+.bi-list-task::before { content: "\f477"; }
+.bi-list-ul::before { content: "\f478"; }
+.bi-list::before { content: "\f479"; }
+.bi-lock-fill::before { content: "\f47a"; }
+.bi-lock::before { content: "\f47b"; }
+.bi-mailbox::before { content: "\f47c"; }
+.bi-mailbox2::before { content: "\f47d"; }
+.bi-map-fill::before { content: "\f47e"; }
+.bi-map::before { content: "\f47f"; }
+.bi-markdown-fill::before { content: "\f480"; }
+.bi-markdown::before { content: "\f481"; }
+.bi-mask::before { content: "\f482"; }
+.bi-megaphone-fill::before { content: "\f483"; }
+.bi-megaphone::before { content: "\f484"; }
+.bi-menu-app-fill::before { content: "\f485"; }
+.bi-menu-app::before { content: "\f486"; }
+.bi-menu-button-fill::before { content: "\f487"; }
+.bi-menu-button-wide-fill::before { content: "\f488"; }
+.bi-menu-button-wide::before { content: "\f489"; }
+.bi-menu-button::before { content: "\f48a"; }
+.bi-menu-down::before { content: "\f48b"; }
+.bi-menu-up::before { content: "\f48c"; }
+.bi-mic-fill::before { content: "\f48d"; }
+.bi-mic-mute-fill::before { content: "\f48e"; }
+.bi-mic-mute::before { content: "\f48f"; }
+.bi-mic::before { content: "\f490"; }
+.bi-minecart-loaded::before { content: "\f491"; }
+.bi-minecart::before { content: "\f492"; }
+.bi-moisture::before { content: "\f493"; }
+.bi-moon-fill::before { content: "\f494"; }
+.bi-moon-stars-fill::before { content: "\f495"; }
+.bi-moon-stars::before { content: "\f496"; }
+.bi-moon::before { content: "\f497"; }
+.bi-mouse-fill::before { content: "\f498"; }
+.bi-mouse::before { content: "\f499"; }
+.bi-mouse2-fill::before { content: "\f49a"; }
+.bi-mouse2::before { content: "\f49b"; }
+.bi-mouse3-fill::before { content: "\f49c"; }
+.bi-mouse3::before { content: "\f49d"; }
+.bi-music-note-beamed::before { content: "\f49e"; }
+.bi-music-note-list::before { content: "\f49f"; }
+.bi-music-note::before { content: "\f4a0"; }
+.bi-music-player-fill::before { content: "\f4a1"; }
+.bi-music-player::before { content: "\f4a2"; }
+.bi-newspaper::before { content: "\f4a3"; }
+.bi-node-minus-fill::before { content: "\f4a4"; }
+.bi-node-minus::before { content: "\f4a5"; }
+.bi-node-plus-fill::before { content: "\f4a6"; }
+.bi-node-plus::before { content: "\f4a7"; }
+.bi-nut-fill::before { content: "\f4a8"; }
+.bi-nut::before { content: "\f4a9"; }
+.bi-octagon-fill::before { content: "\f4aa"; }
+.bi-octagon-half::before { content: "\f4ab"; }
+.bi-octagon::before { content: "\f4ac"; }
+.bi-option::before { content: "\f4ad"; }
+.bi-outlet::before { content: "\f4ae"; }
+.bi-paint-bucket::before { content: "\f4af"; }
+.bi-palette-fill::before { content: "\f4b0"; }
+.bi-palette::before { content: "\f4b1"; }
+.bi-palette2::before { content: "\f4b2"; }
+.bi-paperclip::before { content: "\f4b3"; }
+.bi-paragraph::before { content: "\f4b4"; }
+.bi-patch-check-fill::before { content: "\f4b5"; }
+.bi-patch-check::before { content: "\f4b6"; }
+.bi-patch-exclamation-fill::before { content: "\f4b7"; }
+.bi-patch-exclamation::before { content: "\f4b8"; }
+.bi-patch-minus-fill::before { content: "\f4b9"; }
+.bi-patch-minus::before { content: "\f4ba"; }
+.bi-patch-plus-fill::before { content: "\f4bb"; }
+.bi-patch-plus::before { content: "\f4bc"; }
+.bi-patch-question-fill::before { content: "\f4bd"; }
+.bi-patch-question::before { content: "\f4be"; }
+.bi-pause-btn-fill::before { content: "\f4bf"; }
+.bi-pause-btn::before { content: "\f4c0"; }
+.bi-pause-circle-fill::before { content: "\f4c1"; }
+.bi-pause-circle::before { content: "\f4c2"; }
+.bi-pause-fill::before { content: "\f4c3"; }
+.bi-pause::before { content: "\f4c4"; }
+.bi-peace-fill::before { content: "\f4c5"; }
+.bi-peace::before { content: "\f4c6"; }
+.bi-pen-fill::before { content: "\f4c7"; }
+.bi-pen::before { content: "\f4c8"; }
+.bi-pencil-fill::before { content: "\f4c9"; }
+.bi-pencil-square::before { content: "\f4ca"; }
+.bi-pencil::before { content: "\f4cb"; }
+.bi-pentagon-fill::before { content: "\f4cc"; }
+.bi-pentagon-half::before { content: "\f4cd"; }
+.bi-pentagon::before { content: "\f4ce"; }
+.bi-people-fill::before { content: "\f4cf"; }
+.bi-people::before { content: "\f4d0"; }
+.bi-percent::before { content: "\f4d1"; }
+.bi-person-badge-fill::before { content: "\f4d2"; }
+.bi-person-badge::before { content: "\f4d3"; }
+.bi-person-bounding-box::before { content: "\f4d4"; }
+.bi-person-check-fill::before { content: "\f4d5"; }
+.bi-person-check::before { content: "\f4d6"; }
+.bi-person-circle::before { content: "\f4d7"; }
+.bi-person-dash-fill::before { content: "\f4d8"; }
+.bi-person-dash::before { content: "\f4d9"; }
+.bi-person-fill::before { content: "\f4da"; }
+.bi-person-lines-fill::before { content: "\f4db"; }
+.bi-person-plus-fill::before { content: "\f4dc"; }
+.bi-person-plus::before { content: "\f4dd"; }
+.bi-person-square::before { content: "\f4de"; }
+.bi-person-x-fill::before { content: "\f4df"; }
+.bi-person-x::before { content: "\f4e0"; }
+.bi-person::before { content: "\f4e1"; }
+.bi-phone-fill::before { content: "\f4e2"; }
+.bi-phone-landscape-fill::before { content: "\f4e3"; }
+.bi-phone-landscape::before { content: "\f4e4"; }
+.bi-phone-vibrate-fill::before { content: "\f4e5"; }
+.bi-phone-vibrate::before { content: "\f4e6"; }
+.bi-phone::before { content: "\f4e7"; }
+.bi-pie-chart-fill::before { content: "\f4e8"; }
+.bi-pie-chart::before { content: "\f4e9"; }
+.bi-pin-angle-fill::before { content: "\f4ea"; }
+.bi-pin-angle::before { content: "\f4eb"; }
+.bi-pin-fill::before { content: "\f4ec"; }
+.bi-pin::before { content: "\f4ed"; }
+.bi-pip-fill::before { content: "\f4ee"; }
+.bi-pip::before { content: "\f4ef"; }
+.bi-play-btn-fill::before { content: "\f4f0"; }
+.bi-play-btn::before { content: "\f4f1"; }
+.bi-play-circle-fill::before { content: "\f4f2"; }
+.bi-play-circle::before { content: "\f4f3"; }
+.bi-play-fill::before { content: "\f4f4"; }
+.bi-play::before { content: "\f4f5"; }
+.bi-plug-fill::before { content: "\f4f6"; }
+.bi-plug::before { content: "\f4f7"; }
+.bi-plus-circle-dotted::before { content: "\f4f8"; }
+.bi-plus-circle-fill::before { content: "\f4f9"; }
+.bi-plus-circle::before { content: "\f4fa"; }
+.bi-plus-square-dotted::before { content: "\f4fb"; }
+.bi-plus-square-fill::before { content: "\f4fc"; }
+.bi-plus-square::before { content: "\f4fd"; }
+.bi-plus::before { content: "\f4fe"; }
+.bi-power::before { content: "\f4ff"; }
+.bi-printer-fill::before { content: "\f500"; }
+.bi-printer::before { content: "\f501"; }
+.bi-puzzle-fill::before { content: "\f502"; }
+.bi-puzzle::before { content: "\f503"; }
+.bi-question-circle-fill::before { content: "\f504"; }
+.bi-question-circle::before { content: "\f505"; }
+.bi-question-diamond-fill::before { content: "\f506"; }
+.bi-question-diamond::before { content: "\f507"; }
+.bi-question-octagon-fill::before { content: "\f508"; }
+.bi-question-octagon::before { content: "\f509"; }
+.bi-question-square-fill::before { content: "\f50a"; }
+.bi-question-square::before { content: "\f50b"; }
+.bi-question::before { content: "\f50c"; }
+.bi-rainbow::before { content: "\f50d"; }
+.bi-receipt-cutoff::before { content: "\f50e"; }
+.bi-receipt::before { content: "\f50f"; }
+.bi-reception-0::before { content: "\f510"; }
+.bi-reception-1::before { content: "\f511"; }
+.bi-reception-2::before { content: "\f512"; }
+.bi-reception-3::before { content: "\f513"; }
+.bi-reception-4::before { content: "\f514"; }
+.bi-record-btn-fill::before { content: "\f515"; }
+.bi-record-btn::before { content: "\f516"; }
+.bi-record-circle-fill::before { content: "\f517"; }
+.bi-record-circle::before { content: "\f518"; }
+.bi-record-fill::before { content: "\f519"; }
+.bi-record::before { content: "\f51a"; }
+.bi-record2-fill::before { content: "\f51b"; }
+.bi-record2::before { content: "\f51c"; }
+.bi-reply-all-fill::before { content: "\f51d"; }
+.bi-reply-all::before { content: "\f51e"; }
+.bi-reply-fill::before { content: "\f51f"; }
+.bi-reply::before { content: "\f520"; }
+.bi-rss-fill::before { content: "\f521"; }
+.bi-rss::before { content: "\f522"; }
+.bi-rulers::before { content: "\f523"; }
+.bi-save-fill::before { content: "\f524"; }
+.bi-save::before { content: "\f525"; }
+.bi-save2-fill::before { content: "\f526"; }
+.bi-save2::before { content: "\f527"; }
+.bi-scissors::before { content: "\f528"; }
+.bi-screwdriver::before { content: "\f529"; }
+.bi-search::before { content: "\f52a"; }
+.bi-segmented-nav::before { content: "\f52b"; }
+.bi-server::before { content: "\f52c"; }
+.bi-share-fill::before { content: "\f52d"; }
+.bi-share::before { content: "\f52e"; }
+.bi-shield-check::before { content: "\f52f"; }
+.bi-shield-exclamation::before { content: "\f530"; }
+.bi-shield-fill-check::before { content: "\f531"; }
+.bi-shield-fill-exclamation::before { content: "\f532"; }
+.bi-shield-fill-minus::before { content: "\f533"; }
+.bi-shield-fill-plus::before { content: "\f534"; }
+.bi-shield-fill-x::before { content: "\f535"; }
+.bi-shield-fill::before { content: "\f536"; }
+.bi-shield-lock-fill::before { content: "\f537"; }
+.bi-shield-lock::before { content: "\f538"; }
+.bi-shield-minus::before { content: "\f539"; }
+.bi-shield-plus::before { content: "\f53a"; }
+.bi-shield-shaded::before { content: "\f53b"; }
+.bi-shield-slash-fill::before { content: "\f53c"; }
+.bi-shield-slash::before { content: "\f53d"; }
+.bi-shield-x::before { content: "\f53e"; }
+.bi-shield::before { content: "\f53f"; }
+.bi-shift-fill::before { content: "\f540"; }
+.bi-shift::before { content: "\f541"; }
+.bi-shop-window::before { content: "\f542"; }
+.bi-shop::before { content: "\f543"; }
+.bi-shuffle::before { content: "\f544"; }
+.bi-signpost-2-fill::before { content: "\f545"; }
+.bi-signpost-2::before { content: "\f546"; }
+.bi-signpost-fill::before { content: "\f547"; }
+.bi-signpost-split-fill::before { content: "\f548"; }
+.bi-signpost-split::before { content: "\f549"; }
+.bi-signpost::before { content: "\f54a"; }
+.bi-sim-fill::before { content: "\f54b"; }
+.bi-sim::before { content: "\f54c"; }
+.bi-skip-backward-btn-fill::before { content: "\f54d"; }
+.bi-skip-backward-btn::before { content: "\f54e"; }
+.bi-skip-backward-circle-fill::before { content: "\f54f"; }
+.bi-skip-backward-circle::before { content: "\f550"; }
+.bi-skip-backward-fill::before { content: "\f551"; }
+.bi-skip-backward::before { content: "\f552"; }
+.bi-skip-end-btn-fill::before { content: "\f553"; }
+.bi-skip-end-btn::before { content: "\f554"; }
+.bi-skip-end-circle-fill::before { content: "\f555"; }
+.bi-skip-end-circle::before { content: "\f556"; }
+.bi-skip-end-fill::before { content: "\f557"; }
+.bi-skip-end::before { content: "\f558"; }
+.bi-skip-forward-btn-fill::before { content: "\f559"; }
+.bi-skip-forward-btn::before { content: "\f55a"; }
+.bi-skip-forward-circle-fill::before { content: "\f55b"; }
+.bi-skip-forward-circle::before { content: "\f55c"; }
+.bi-skip-forward-fill::before { content: "\f55d"; }
+.bi-skip-forward::before { content: "\f55e"; }
+.bi-skip-start-btn-fill::before { content: "\f55f"; }
+.bi-skip-start-btn::before { content: "\f560"; }
+.bi-skip-start-circle-fill::before { content: "\f561"; }
+.bi-skip-start-circle::before { content: "\f562"; }
+.bi-skip-start-fill::before { content: "\f563"; }
+.bi-skip-start::before { content: "\f564"; }
+.bi-slack::before { content: "\f565"; }
+.bi-slash-circle-fill::before { content: "\f566"; }
+.bi-slash-circle::before { content: "\f567"; }
+.bi-slash-square-fill::before { content: "\f568"; }
+.bi-slash-square::before { content: "\f569"; }
+.bi-slash::before { content: "\f56a"; }
+.bi-sliders::before { content: "\f56b"; }
+.bi-smartwatch::before { content: "\f56c"; }
+.bi-snow::before { content: "\f56d"; }
+.bi-snow2::before { content: "\f56e"; }
+.bi-snow3::before { content: "\f56f"; }
+.bi-sort-alpha-down-alt::before { content: "\f570"; }
+.bi-sort-alpha-down::before { content: "\f571"; }
+.bi-sort-alpha-up-alt::before { content: "\f572"; }
+.bi-sort-alpha-up::before { content: "\f573"; }
+.bi-sort-down-alt::before { content: "\f574"; }
+.bi-sort-down::before { content: "\f575"; }
+.bi-sort-numeric-down-alt::before { content: "\f576"; }
+.bi-sort-numeric-down::before { content: "\f577"; }
+.bi-sort-numeric-up-alt::before { content: "\f578"; }
+.bi-sort-numeric-up::before { content: "\f579"; }
+.bi-sort-up-alt::before { content: "\f57a"; }
+.bi-sort-up::before { content: "\f57b"; }
+.bi-soundwave::before { content: "\f57c"; }
+.bi-speaker-fill::before { content: "\f57d"; }
+.bi-speaker::before { content: "\f57e"; }
+.bi-speedometer::before { content: "\f57f"; }
+.bi-speedometer2::before { content: "\f580"; }
+.bi-spellcheck::before { content: "\f581"; }
+.bi-square-fill::before { content: "\f582"; }
+.bi-square-half::before { content: "\f583"; }
+.bi-square::before { content: "\f584"; }
+.bi-stack::before { content: "\f585"; }
+.bi-star-fill::before { content: "\f586"; }
+.bi-star-half::before { content: "\f587"; }
+.bi-star::before { content: "\f588"; }
+.bi-stars::before { content: "\f589"; }
+.bi-stickies-fill::before { content: "\f58a"; }
+.bi-stickies::before { content: "\f58b"; }
+.bi-sticky-fill::before { content: "\f58c"; }
+.bi-sticky::before { content: "\f58d"; }
+.bi-stop-btn-fill::before { content: "\f58e"; }
+.bi-stop-btn::before { content: "\f58f"; }
+.bi-stop-circle-fill::before { content: "\f590"; }
+.bi-stop-circle::before { content: "\f591"; }
+.bi-stop-fill::before { content: "\f592"; }
+.bi-stop::before { content: "\f593"; }
+.bi-stoplights-fill::before { content: "\f594"; }
+.bi-stoplights::before { content: "\f595"; }
+.bi-stopwatch-fill::before { content: "\f596"; }
+.bi-stopwatch::before { content: "\f597"; }
+.bi-subtract::before { content: "\f598"; }
+.bi-suit-club-fill::before { content: "\f599"; }
+.bi-suit-club::before { content: "\f59a"; }
+.bi-suit-diamond-fill::before { content: "\f59b"; }
+.bi-suit-diamond::before { content: "\f59c"; }
+.bi-suit-heart-fill::before { content: "\f59d"; }
+.bi-suit-heart::before { content: "\f59e"; }
+.bi-suit-spade-fill::before { content: "\f59f"; }
+.bi-suit-spade::before { content: "\f5a0"; }
+.bi-sun-fill::before { content: "\f5a1"; }
+.bi-sun::before { content: "\f5a2"; }
+.bi-sunglasses::before { content: "\f5a3"; }
+.bi-sunrise-fill::before { content: "\f5a4"; }
+.bi-sunrise::before { content: "\f5a5"; }
+.bi-sunset-fill::before { content: "\f5a6"; }
+.bi-sunset::before { content: "\f5a7"; }
+.bi-symmetry-horizontal::before { content: "\f5a8"; }
+.bi-symmetry-vertical::before { content: "\f5a9"; }
+.bi-table::before { content: "\f5aa"; }
+.bi-tablet-fill::before { content: "\f5ab"; }
+.bi-tablet-landscape-fill::before { content: "\f5ac"; }
+.bi-tablet-landscape::before { content: "\f5ad"; }
+.bi-tablet::before { content: "\f5ae"; }
+.bi-tag-fill::before { content: "\f5af"; }
+.bi-tag::before { content: "\f5b0"; }
+.bi-tags-fill::before { content: "\f5b1"; }
+.bi-tags::before { content: "\f5b2"; }
+.bi-telegram::before { content: "\f5b3"; }
+.bi-telephone-fill::before { content: "\f5b4"; }
+.bi-telephone-forward-fill::before { content: "\f5b5"; }
+.bi-telephone-forward::before { content: "\f5b6"; }
+.bi-telephone-inbound-fill::before { content: "\f5b7"; }
+.bi-telephone-inbound::before { content: "\f5b8"; }
+.bi-telephone-minus-fill::before { content: "\f5b9"; }
+.bi-telephone-minus::before { content: "\f5ba"; }
+.bi-telephone-outbound-fill::before { content: "\f5bb"; }
+.bi-telephone-outbound::before { content: "\f5bc"; }
+.bi-telephone-plus-fill::before { content: "\f5bd"; }
+.bi-telephone-plus::before { content: "\f5be"; }
+.bi-telephone-x-fill::before { content: "\f5bf"; }
+.bi-telephone-x::before { content: "\f5c0"; }
+.bi-telephone::before { content: "\f5c1"; }
+.bi-terminal-fill::before { content: "\f5c2"; }
+.bi-terminal::before { content: "\f5c3"; }
+.bi-text-center::before { content: "\f5c4"; }
+.bi-text-indent-left::before { content: "\f5c5"; }
+.bi-text-indent-right::before { content: "\f5c6"; }
+.bi-text-left::before { content: "\f5c7"; }
+.bi-text-paragraph::before { content: "\f5c8"; }
+.bi-text-right::before { content: "\f5c9"; }
+.bi-textarea-resize::before { content: "\f5ca"; }
+.bi-textarea-t::before { content: "\f5cb"; }
+.bi-textarea::before { content: "\f5cc"; }
+.bi-thermometer-half::before { content: "\f5cd"; }
+.bi-thermometer-high::before { content: "\f5ce"; }
+.bi-thermometer-low::before { content: "\f5cf"; }
+.bi-thermometer-snow::before { content: "\f5d0"; }
+.bi-thermometer-sun::before { content: "\f5d1"; }
+.bi-thermometer::before { content: "\f5d2"; }
+.bi-three-dots-vertical::before { content: "\f5d3"; }
+.bi-three-dots::before { content: "\f5d4"; }
+.bi-toggle-off::before { content: "\f5d5"; }
+.bi-toggle-on::before { content: "\f5d6"; }
+.bi-toggle2-off::before { content: "\f5d7"; }
+.bi-toggle2-on::before { content: "\f5d8"; }
+.bi-toggles::before { content: "\f5d9"; }
+.bi-toggles2::before { content: "\f5da"; }
+.bi-tools::before { content: "\f5db"; }
+.bi-tornado::before { content: "\f5dc"; }
+.bi-trash-fill::before { content: "\f5dd"; }
+.bi-trash::before { content: "\f5de"; }
+.bi-trash2-fill::before { content: "\f5df"; }
+.bi-trash2::before { content: "\f5e0"; }
+.bi-tree-fill::before { content: "\f5e1"; }
+.bi-tree::before { content: "\f5e2"; }
+.bi-triangle-fill::before { content: "\f5e3"; }
+.bi-triangle-half::before { content: "\f5e4"; }
+.bi-triangle::before { content: "\f5e5"; }
+.bi-trophy-fill::before { content: "\f5e6"; }
+.bi-trophy::before { content: "\f5e7"; }
+.bi-tropical-storm::before { content: "\f5e8"; }
+.bi-truck-flatbed::before { content: "\f5e9"; }
+.bi-truck::before { content: "\f5ea"; }
+.bi-tsunami::before { content: "\f5eb"; }
+.bi-tv-fill::before { content: "\f5ec"; }
+.bi-tv::before { content: "\f5ed"; }
+.bi-twitch::before { content: "\f5ee"; }
+.bi-twitter::before { content: "\f5ef"; }
+.bi-type-bold::before { content: "\f5f0"; }
+.bi-type-h1::before { content: "\f5f1"; }
+.bi-type-h2::before { content: "\f5f2"; }
+.bi-type-h3::before { content: "\f5f3"; }
+.bi-type-italic::before { content: "\f5f4"; }
+.bi-type-strikethrough::before { content: "\f5f5"; }
+.bi-type-underline::before { content: "\f5f6"; }
+.bi-type::before { content: "\f5f7"; }
+.bi-ui-checks-grid::before { content: "\f5f8"; }
+.bi-ui-checks::before { content: "\f5f9"; }
+.bi-ui-radios-grid::before { content: "\f5fa"; }
+.bi-ui-radios::before { content: "\f5fb"; }
+.bi-umbrella-fill::before { content: "\f5fc"; }
+.bi-umbrella::before { content: "\f5fd"; }
+.bi-union::before { content: "\f5fe"; }
+.bi-unlock-fill::before { content: "\f5ff"; }
+.bi-unlock::before { content: "\f600"; }
+.bi-upc-scan::before { content: "\f601"; }
+.bi-upc::before { content: "\f602"; }
+.bi-upload::before { content: "\f603"; }
+.bi-vector-pen::before { content: "\f604"; }
+.bi-view-list::before { content: "\f605"; }
+.bi-view-stacked::before { content: "\f606"; }
+.bi-vinyl-fill::before { content: "\f607"; }
+.bi-vinyl::before { content: "\f608"; }
+.bi-voicemail::before { content: "\f609"; }
+.bi-volume-down-fill::before { content: "\f60a"; }
+.bi-volume-down::before { content: "\f60b"; }
+.bi-volume-mute-fill::before { content: "\f60c"; }
+.bi-volume-mute::before { content: "\f60d"; }
+.bi-volume-off-fill::before { content: "\f60e"; }
+.bi-volume-off::before { content: "\f60f"; }
+.bi-volume-up-fill::before { content: "\f610"; }
+.bi-volume-up::before { content: "\f611"; }
+.bi-vr::before { content: "\f612"; }
+.bi-wallet-fill::before { content: "\f613"; }
+.bi-wallet::before { content: "\f614"; }
+.bi-wallet2::before { content: "\f615"; }
+.bi-watch::before { content: "\f616"; }
+.bi-water::before { content: "\f617"; }
+.bi-whatsapp::before { content: "\f618"; }
+.bi-wifi-1::before { content: "\f619"; }
+.bi-wifi-2::before { content: "\f61a"; }
+.bi-wifi-off::before { content: "\f61b"; }
+.bi-wifi::before { content: "\f61c"; }
+.bi-wind::before { content: "\f61d"; }
+.bi-window-dock::before { content: "\f61e"; }
+.bi-window-sidebar::before { content: "\f61f"; }
+.bi-window::before { content: "\f620"; }
+.bi-wrench::before { content: "\f621"; }
+.bi-x-circle-fill::before { content: "\f622"; }
+.bi-x-circle::before { content: "\f623"; }
+.bi-x-diamond-fill::before { content: "\f624"; }
+.bi-x-diamond::before { content: "\f625"; }
+.bi-x-octagon-fill::before { content: "\f626"; }
+.bi-x-octagon::before { content: "\f627"; }
+.bi-x-square-fill::before { content: "\f628"; }
+.bi-x-square::before { content: "\f629"; }
+.bi-x::before { content: "\f62a"; }
+.bi-youtube::before { content: "\f62b"; }
+.bi-zoom-in::before { content: "\f62c"; }
+.bi-zoom-out::before { content: "\f62d"; }
+.bi-bank::before { content: "\f62e"; }
+.bi-bank2::before { content: "\f62f"; }
+.bi-bell-slash-fill::before { content: "\f630"; }
+.bi-bell-slash::before { content: "\f631"; }
+.bi-cash-coin::before { content: "\f632"; }
+.bi-check-lg::before { content: "\f633"; }
+.bi-coin::before { content: "\f634"; }
+.bi-currency-bitcoin::before { content: "\f635"; }
+.bi-currency-dollar::before { content: "\f636"; }
+.bi-currency-euro::before { content: "\f637"; }
+.bi-currency-exchange::before { content: "\f638"; }
+.bi-currency-pound::before { content: "\f639"; }
+.bi-currency-yen::before { content: "\f63a"; }
+.bi-dash-lg::before { content: "\f63b"; }
+.bi-exclamation-lg::before { content: "\f63c"; }
+.bi-file-earmark-pdf-fill::before { content: "\f63d"; }
+.bi-file-earmark-pdf::before { content: "\f63e"; }
+.bi-file-pdf-fill::before { content: "\f63f"; }
+.bi-file-pdf::before { content: "\f640"; }
+.bi-gender-ambiguous::before { content: "\f641"; }
+.bi-gender-female::before { content: "\f642"; }
+.bi-gender-male::before { content: "\f643"; }
+.bi-gender-trans::before { content: "\f644"; }
+.bi-headset-vr::before { content: "\f645"; }
+.bi-info-lg::before { content: "\f646"; }
+.bi-mastodon::before { content: "\f647"; }
+.bi-messenger::before { content: "\f648"; }
+.bi-piggy-bank-fill::before { content: "\f649"; }
+.bi-piggy-bank::before { content: "\f64a"; }
+.bi-pin-map-fill::before { content: "\f64b"; }
+.bi-pin-map::before { content: "\f64c"; }
+.bi-plus-lg::before { content: "\f64d"; }
+.bi-question-lg::before { content: "\f64e"; }
+.bi-recycle::before { content: "\f64f"; }
+.bi-reddit::before { content: "\f650"; }
+.bi-safe-fill::before { content: "\f651"; }
+.bi-safe2-fill::before { content: "\f652"; }
+.bi-safe2::before { content: "\f653"; }
+.bi-sd-card-fill::before { content: "\f654"; }
+.bi-sd-card::before { content: "\f655"; }
+.bi-skype::before { content: "\f656"; }
+.bi-slash-lg::before { content: "\f657"; }
+.bi-translate::before { content: "\f658"; }
+.bi-x-lg::before { content: "\f659"; }
+.bi-safe::before { content: "\f65a"; }
+.bi-apple::before { content: "\f65b"; }
+.bi-microsoft::before { content: "\f65d"; }
+.bi-windows::before { content: "\f65e"; }
+.bi-behance::before { content: "\f65c"; }
+.bi-dribbble::before { content: "\f65f"; }
+.bi-line::before { content: "\f660"; }
+.bi-medium::before { content: "\f661"; }
+.bi-paypal::before { content: "\f662"; }
+.bi-pinterest::before { content: "\f663"; }
+.bi-signal::before { content: "\f664"; }
+.bi-snapchat::before { content: "\f665"; }
+.bi-spotify::before { content: "\f666"; }
+.bi-stack-overflow::before { content: "\f667"; }
+.bi-strava::before { content: "\f668"; }
+.bi-wordpress::before { content: "\f669"; }
+.bi-vimeo::before { content: "\f66a"; }
+.bi-activity::before { content: "\f66b"; }
+.bi-easel2-fill::before { content: "\f66c"; }
+.bi-easel2::before { content: "\f66d"; }
+.bi-easel3-fill::before { content: "\f66e"; }
+.bi-easel3::before { content: "\f66f"; }
+.bi-fan::before { content: "\f670"; }
+.bi-fingerprint::before { content: "\f671"; }
+.bi-graph-down-arrow::before { content: "\f672"; }
+.bi-graph-up-arrow::before { content: "\f673"; }
+.bi-hypnotize::before { content: "\f674"; }
+.bi-magic::before { content: "\f675"; }
+.bi-person-rolodex::before { content: "\f676"; }
+.bi-person-video::before { content: "\f677"; }
+.bi-person-video2::before { content: "\f678"; }
+.bi-person-video3::before { content: "\f679"; }
+.bi-person-workspace::before { content: "\f67a"; }
+.bi-radioactive::before { content: "\f67b"; }
+.bi-webcam-fill::before { content: "\f67c"; }
+.bi-webcam::before { content: "\f67d"; }
+.bi-yin-yang::before { content: "\f67e"; }
+.bi-bandaid-fill::before { content: "\f680"; }
+.bi-bandaid::before { content: "\f681"; }
+.bi-bluetooth::before { content: "\f682"; }
+.bi-body-text::before { content: "\f683"; }
+.bi-boombox::before { content: "\f684"; }
+.bi-boxes::before { content: "\f685"; }
+.bi-dpad-fill::before { content: "\f686"; }
+.bi-dpad::before { content: "\f687"; }
+.bi-ear-fill::before { content: "\f688"; }
+.bi-ear::before { content: "\f689"; }
+.bi-envelope-check-1::before { content: "\f68a"; }
+.bi-envelope-check-fill::before { content: "\f68b"; }
+.bi-envelope-check::before { content: "\f68c"; }
+.bi-envelope-dash-1::before { content: "\f68d"; }
+.bi-envelope-dash-fill::before { content: "\f68e"; }
+.bi-envelope-dash::before { content: "\f68f"; }
+.bi-envelope-exclamation-1::before { content: "\f690"; }
+.bi-envelope-exclamation-fill::before { content: "\f691"; }
+.bi-envelope-exclamation::before { content: "\f692"; }
+.bi-envelope-plus-fill::before { content: "\f693"; }
+.bi-envelope-plus::before { content: "\f694"; }
+.bi-envelope-slash-1::before { content: "\f695"; }
+.bi-envelope-slash-fill::before { content: "\f696"; }
+.bi-envelope-slash::before { content: "\f697"; }
+.bi-envelope-x-1::before { content: "\f698"; }
+.bi-envelope-x-fill::before { content: "\f699"; }
+.bi-envelope-x::before { content: "\f69a"; }
+.bi-explicit-fill::before { content: "\f69b"; }
+.bi-explicit::before { content: "\f69c"; }
+.bi-git::before { content: "\f69d"; }
+.bi-infinity::before { content: "\f69e"; }
+.bi-list-columns-reverse::before { content: "\f69f"; }
+.bi-list-columns::before { content: "\f6a0"; }
+.bi-meta::before { content: "\f6a1"; }
+.bi-mortorboard-fill::before { content: "\f6a2"; }
+.bi-mortorboard::before { content: "\f6a3"; }
+.bi-nintendo-switch::before { content: "\f6a4"; }
+.bi-pc-display-horizontal::before { content: "\f6a5"; }
+.bi-pc-display::before { content: "\f6a6"; }
+.bi-pc-horizontal::before { content: "\f6a7"; }
+.bi-pc::before { content: "\f6a8"; }
+.bi-playstation::before { content: "\f6a9"; }
+.bi-plus-slash-minus::before { content: "\f6aa"; }
+.bi-projector-fill::before { content: "\f6ab"; }
+.bi-projector::before { content: "\f6ac"; }
+.bi-qr-code-scan::before { content: "\f6ad"; }
+.bi-qr-code::before { content: "\f6ae"; }
+.bi-quora::before { content: "\f6af"; }
+.bi-quote::before { content: "\f6b0"; }
+.bi-robot::before { content: "\f6b1"; }
+.bi-send-check-fill::before { content: "\f6b2"; }
+.bi-send-check::before { content: "\f6b3"; }
+.bi-send-dash-fill::before { content: "\f6b4"; }
+.bi-send-dash::before { content: "\f6b5"; }
+.bi-send-exclamation-1::before { content: "\f6b6"; }
+.bi-send-exclamation-fill::before { content: "\f6b7"; }
+.bi-send-exclamation::before { content: "\f6b8"; }
+.bi-send-fill::before { content: "\f6b9"; }
+.bi-send-plus-fill::before { content: "\f6ba"; }
+.bi-send-plus::before { content: "\f6bb"; }
+.bi-send-slash-fill::before { content: "\f6bc"; }
+.bi-send-slash::before { content: "\f6bd"; }
+.bi-send-x-fill::before { content: "\f6be"; }
+.bi-send-x::before { content: "\f6bf"; }
+.bi-send::before { content: "\f6c0"; }
+.bi-steam::before { content: "\f6c1"; }
+.bi-terminal-dash-1::before { content: "\f6c2"; }
+.bi-terminal-dash::before { content: "\f6c3"; }
+.bi-terminal-plus::before { content: "\f6c4"; }
+.bi-terminal-split::before { content: "\f6c5"; }
+.bi-ticket-detailed-fill::before { content: "\f6c6"; }
+.bi-ticket-detailed::before { content: "\f6c7"; }
+.bi-ticket-fill::before { content: "\f6c8"; }
+.bi-ticket-perforated-fill::before { content: "\f6c9"; }
+.bi-ticket-perforated::before { content: "\f6ca"; }
+.bi-ticket::before { content: "\f6cb"; }
+.bi-tiktok::before { content: "\f6cc"; }
+.bi-window-dash::before { content: "\f6cd"; }
+.bi-window-desktop::before { content: "\f6ce"; }
+.bi-window-fullscreen::before { content: "\f6cf"; }
+.bi-window-plus::before { content: "\f6d0"; }
+.bi-window-split::before { content: "\f6d1"; }
+.bi-window-stack::before { content: "\f6d2"; }
+.bi-window-x::before { content: "\f6d3"; }
+.bi-xbox::before { content: "\f6d4"; }
+.bi-ethernet::before { content: "\f6d5"; }
+.bi-hdmi-fill::before { content: "\f6d6"; }
+.bi-hdmi::before { content: "\f6d7"; }
+.bi-usb-c-fill::before { content: "\f6d8"; }
+.bi-usb-c::before { content: "\f6d9"; }
+.bi-usb-fill::before { content: "\f6da"; }
+.bi-usb-plug-fill::before { content: "\f6db"; }
+.bi-usb-plug::before { content: "\f6dc"; }
+.bi-usb-symbol::before { content: "\f6dd"; }
+.bi-usb::before { content: "\f6de"; }
+.bi-boombox-fill::before { content: "\f6df"; }
+.bi-displayport-1::before { content: "\f6e0"; }
+.bi-displayport::before { content: "\f6e1"; }
+.bi-gpu-card::before { content: "\f6e2"; }
+.bi-memory::before { content: "\f6e3"; }
+.bi-modem-fill::before { content: "\f6e4"; }
+.bi-modem::before { content: "\f6e5"; }
+.bi-motherboard-fill::before { content: "\f6e6"; }
+.bi-motherboard::before { content: "\f6e7"; }
+.bi-optical-audio-fill::before { content: "\f6e8"; }
+.bi-optical-audio::before { content: "\f6e9"; }
+.bi-pci-card::before { content: "\f6ea"; }
+.bi-router-fill::before { content: "\f6eb"; }
+.bi-router::before { content: "\f6ec"; }
+.bi-ssd-fill::before { content: "\f6ed"; }
+.bi-ssd::before { content: "\f6ee"; }
+.bi-thunderbolt-fill::before { content: "\f6ef"; }
+.bi-thunderbolt::before { content: "\f6f0"; }
+.bi-usb-drive-fill::before { content: "\f6f1"; }
+.bi-usb-drive::before { content: "\f6f2"; }
+.bi-usb-micro-fill::before { content: "\f6f3"; }
+.bi-usb-micro::before { content: "\f6f4"; }
+.bi-usb-mini-fill::before { content: "\f6f5"; }
+.bi-usb-mini::before { content: "\f6f6"; }
+.bi-cloud-haze2::before { content: "\f6f7"; }
+.bi-device-hdd-fill::before { content: "\f6f8"; }
+.bi-device-hdd::before { content: "\f6f9"; }
+.bi-device-ssd-fill::before { content: "\f6fa"; }
+.bi-device-ssd::before { content: "\f6fb"; }
+.bi-displayport-fill::before { content: "\f6fc"; }
+.bi-mortarboard-fill::before { content: "\f6fd"; }
+.bi-mortarboard::before { content: "\f6fe"; }
+.bi-terminal-x::before { content: "\f6ff"; }
+.bi-arrow-through-heart-fill::before { content: "\f700"; }
+.bi-arrow-through-heart::before { content: "\f701"; }
+.bi-badge-sd-fill::before { content: "\f702"; }
+.bi-badge-sd::before { content: "\f703"; }
+.bi-bag-heart-fill::before { content: "\f704"; }
+.bi-bag-heart::before { content: "\f705"; }
+.bi-balloon-fill::before { content: "\f706"; }
+.bi-balloon-heart-fill::before { content: "\f707"; }
+.bi-balloon-heart::before { content: "\f708"; }
+.bi-balloon::before { content: "\f709"; }
+.bi-box2-fill::before { content: "\f70a"; }
+.bi-box2-heart-fill::before { content: "\f70b"; }
+.bi-box2-heart::before { content: "\f70c"; }
+.bi-box2::before { content: "\f70d"; }
+.bi-braces-asterisk::before { content: "\f70e"; }
+.bi-calendar-heart-fill::before { content: "\f70f"; }
+.bi-calendar-heart::before { content: "\f710"; }
+.bi-calendar2-heart-fill::before { content: "\f711"; }
+.bi-calendar2-heart::before { content: "\f712"; }
+.bi-chat-heart-fill::before { content: "\f713"; }
+.bi-chat-heart::before { content: "\f714"; }
+.bi-chat-left-heart-fill::before { content: "\f715"; }
+.bi-chat-left-heart::before { content: "\f716"; }
+.bi-chat-right-heart-fill::before { content: "\f717"; }
+.bi-chat-right-heart::before { content: "\f718"; }
+.bi-chat-square-heart-fill::before { content: "\f719"; }
+.bi-chat-square-heart::before { content: "\f71a"; }
+.bi-clipboard-check-fill::before { content: "\f71b"; }
+.bi-clipboard-data-fill::before { content: "\f71c"; }
+.bi-clipboard-fill::before { content: "\f71d"; }
+.bi-clipboard-heart-fill::before { content: "\f71e"; }
+.bi-clipboard-heart::before { content: "\f71f"; }
+.bi-clipboard-minus-fill::before { content: "\f720"; }
+.bi-clipboard-plus-fill::before { content: "\f721"; }
+.bi-clipboard-pulse::before { content: "\f722"; }
+.bi-clipboard-x-fill::before { content: "\f723"; }
+.bi-clipboard2-check-fill::before { content: "\f724"; }
+.bi-clipboard2-check::before { content: "\f725"; }
+.bi-clipboard2-data-fill::before { content: "\f726"; }
+.bi-clipboard2-data::before { content: "\f727"; }
+.bi-clipboard2-fill::before { content: "\f728"; }
+.bi-clipboard2-heart-fill::before { content: "\f729"; }
+.bi-clipboard2-heart::before { content: "\f72a"; }
+.bi-clipboard2-minus-fill::before { content: "\f72b"; }
+.bi-clipboard2-minus::before { content: "\f72c"; }
+.bi-clipboard2-plus-fill::before { content: "\f72d"; }
+.bi-clipboard2-plus::before { content: "\f72e"; }
+.bi-clipboard2-pulse-fill::before { content: "\f72f"; }
+.bi-clipboard2-pulse::before { content: "\f730"; }
+.bi-clipboard2-x-fill::before { content: "\f731"; }
+.bi-clipboard2-x::before { content: "\f732"; }
+.bi-clipboard2::before { content: "\f733"; }
+.bi-emoji-kiss-fill::before { content: "\f734"; }
+.bi-emoji-kiss::before { content: "\f735"; }
+.bi-envelope-heart-fill::before { content: "\f736"; }
+.bi-envelope-heart::before { content: "\f737"; }
+.bi-envelope-open-heart-fill::before { content: "\f738"; }
+.bi-envelope-open-heart::before { content: "\f739"; }
+.bi-envelope-paper-fill::before { content: "\f73a"; }
+.bi-envelope-paper-heart-fill::before { content: "\f73b"; }
+.bi-envelope-paper-heart::before { content: "\f73c"; }
+.bi-envelope-paper::before { content: "\f73d"; }
+.bi-filetype-aac::before { content: "\f73e"; }
+.bi-filetype-ai::before { content: "\f73f"; }
+.bi-filetype-bmp::before { content: "\f740"; }
+.bi-filetype-cs::before { content: "\f741"; }
+.bi-filetype-css::before { content: "\f742"; }
+.bi-filetype-csv::before { content: "\f743"; }
+.bi-filetype-doc::before { content: "\f744"; }
+.bi-filetype-docx::before { content: "\f745"; }
+.bi-filetype-exe::before { content: "\f746"; }
+.bi-filetype-gif::before { content: "\f747"; }
+.bi-filetype-heic::before { content: "\f748"; }
+.bi-filetype-html::before { content: "\f749"; }
+.bi-filetype-java::before { content: "\f74a"; }
+.bi-filetype-jpg::before { content: "\f74b"; }
+.bi-filetype-js::before { content: "\f74c"; }
+.bi-filetype-jsx::before { content: "\f74d"; }
+.bi-filetype-key::before { content: "\f74e"; }
+.bi-filetype-m4p::before { content: "\f74f"; }
+.bi-filetype-md::before { content: "\f750"; }
+.bi-filetype-mdx::before { content: "\f751"; }
+.bi-filetype-mov::before { content: "\f752"; }
+.bi-filetype-mp3::before { content: "\f753"; }
+.bi-filetype-mp4::before { content: "\f754"; }
+.bi-filetype-otf::before { content: "\f755"; }
+.bi-filetype-pdf::before { content: "\f756"; }
+.bi-filetype-php::before { content: "\f757"; }
+.bi-filetype-png::before { content: "\f758"; }
+.bi-filetype-ppt-1::before { content: "\f759"; }
+.bi-filetype-ppt::before { content: "\f75a"; }
+.bi-filetype-psd::before { content: "\f75b"; }
+.bi-filetype-py::before { content: "\f75c"; }
+.bi-filetype-raw::before { content: "\f75d"; }
+.bi-filetype-rb::before { content: "\f75e"; }
+.bi-filetype-sass::before { content: "\f75f"; }
+.bi-filetype-scss::before { content: "\f760"; }
+.bi-filetype-sh::before { content: "\f761"; }
+.bi-filetype-svg::before { content: "\f762"; }
+.bi-filetype-tiff::before { content: "\f763"; }
+.bi-filetype-tsx::before { content: "\f764"; }
+.bi-filetype-ttf::before { content: "\f765"; }
+.bi-filetype-txt::before { content: "\f766"; }
+.bi-filetype-wav::before { content: "\f767"; }
+.bi-filetype-woff::before { content: "\f768"; }
+.bi-filetype-xls-1::before { content: "\f769"; }
+.bi-filetype-xls::before { content: "\f76a"; }
+.bi-filetype-xml::before { content: "\f76b"; }
+.bi-filetype-yml::before { content: "\f76c"; }
+.bi-heart-arrow::before { content: "\f76d"; }
+.bi-heart-pulse-fill::before { content: "\f76e"; }
+.bi-heart-pulse::before { content: "\f76f"; }
+.bi-heartbreak-fill::before { content: "\f770"; }
+.bi-heartbreak::before { content: "\f771"; }
+.bi-hearts::before { content: "\f772"; }
+.bi-hospital-fill::before { content: "\f773"; }
+.bi-hospital::before { content: "\f774"; }
+.bi-house-heart-fill::before { content: "\f775"; }
+.bi-house-heart::before { content: "\f776"; }
+.bi-incognito::before { content: "\f777"; }
+.bi-magnet-fill::before { content: "\f778"; }
+.bi-magnet::before { content: "\f779"; }
+.bi-person-heart::before { content: "\f77a"; }
+.bi-person-hearts::before { content: "\f77b"; }
+.bi-phone-flip::before { content: "\f77c"; }
+.bi-plugin::before { content: "\f77d"; }
+.bi-postage-fill::before { content: "\f77e"; }
+.bi-postage-heart-fill::before { content: "\f77f"; }
+.bi-postage-heart::before { content: "\f780"; }
+.bi-postage::before { content: "\f781"; }
+.bi-postcard-fill::before { content: "\f782"; }
+.bi-postcard-heart-fill::before { content: "\f783"; }
+.bi-postcard-heart::before { content: "\f784"; }
+.bi-postcard::before { content: "\f785"; }
+.bi-search-heart-fill::before { content: "\f786"; }
+.bi-search-heart::before { content: "\f787"; }
+.bi-sliders2-vertical::before { content: "\f788"; }
+.bi-sliders2::before { content: "\f789"; }
+.bi-trash3-fill::before { content: "\f78a"; }
+.bi-trash3::before { content: "\f78b"; }
+.bi-valentine::before { content: "\f78c"; }
+.bi-valentine2::before { content: "\f78d"; }
+.bi-wrench-adjustable-circle-fill::before { content: "\f78e"; }
+.bi-wrench-adjustable-circle::before { content: "\f78f"; }
+.bi-wrench-adjustable::before { content: "\f790"; }
+.bi-filetype-json::before { content: "\f791"; }
+.bi-filetype-pptx::before { content: "\f792"; }
+.bi-filetype-xlsx::before { content: "\f793"; }
+.bi-1-circle-1::before { content: "\f794"; }
+.bi-1-circle-fill-1::before { content: "\f795"; }
+.bi-1-circle-fill::before { content: "\f796"; }
+.bi-1-circle::before { content: "\f797"; }
+.bi-1-square-fill::before { content: "\f798"; }
+.bi-1-square::before { content: "\f799"; }
+.bi-2-circle-1::before { content: "\f79a"; }
+.bi-2-circle-fill-1::before { content: "\f79b"; }
+.bi-2-circle-fill::before { content: "\f79c"; }
+.bi-2-circle::before { content: "\f79d"; }
+.bi-2-square-fill::before { content: "\f79e"; }
+.bi-2-square::before { content: "\f79f"; }
+.bi-3-circle-1::before { content: "\f7a0"; }
+.bi-3-circle-fill-1::before { content: "\f7a1"; }
+.bi-3-circle-fill::before { content: "\f7a2"; }
+.bi-3-circle::before { content: "\f7a3"; }
+.bi-3-square-fill::before { content: "\f7a4"; }
+.bi-3-square::before { content: "\f7a5"; }
+.bi-4-circle-1::before { content: "\f7a6"; }
+.bi-4-circle-fill-1::before { content: "\f7a7"; }
+.bi-4-circle-fill::before { content: "\f7a8"; }
+.bi-4-circle::before { content: "\f7a9"; }
+.bi-4-square-fill::before { content: "\f7aa"; }
+.bi-4-square::before { content: "\f7ab"; }
+.bi-5-circle-1::before { content: "\f7ac"; }
+.bi-5-circle-fill-1::before { content: "\f7ad"; }
+.bi-5-circle-fill::before { content: "\f7ae"; }
+.bi-5-circle::before { content: "\f7af"; }
+.bi-5-square-fill::before { content: "\f7b0"; }
+.bi-5-square::before { content: "\f7b1"; }
+.bi-6-circle-1::before { content: "\f7b2"; }
+.bi-6-circle-fill-1::before { content: "\f7b3"; }
+.bi-6-circle-fill::before { content: "\f7b4"; }
+.bi-6-circle::before { content: "\f7b5"; }
+.bi-6-square-fill::before { content: "\f7b6"; }
+.bi-6-square::before { content: "\f7b7"; }
+.bi-7-circle-1::before { content: "\f7b8"; }
+.bi-7-circle-fill-1::before { content: "\f7b9"; }
+.bi-7-circle-fill::before { content: "\f7ba"; }
+.bi-7-circle::before { content: "\f7bb"; }
+.bi-7-square-fill::before { content: "\f7bc"; }
+.bi-7-square::before { content: "\f7bd"; }
+.bi-8-circle-1::before { content: "\f7be"; }
+.bi-8-circle-fill-1::before { content: "\f7bf"; }
+.bi-8-circle-fill::before { content: "\f7c0"; }
+.bi-8-circle::before { content: "\f7c1"; }
+.bi-8-square-fill::before { content: "\f7c2"; }
+.bi-8-square::before { content: "\f7c3"; }
+.bi-9-circle-1::before { content: "\f7c4"; }
+.bi-9-circle-fill-1::before { content: "\f7c5"; }
+.bi-9-circle-fill::before { content: "\f7c6"; }
+.bi-9-circle::before { content: "\f7c7"; }
+.bi-9-square-fill::before { content: "\f7c8"; }
+.bi-9-square::before { content: "\f7c9"; }
+.bi-airplane-engines-fill::before { content: "\f7ca"; }
+.bi-airplane-engines::before { content: "\f7cb"; }
+.bi-airplane-fill::before { content: "\f7cc"; }
+.bi-airplane::before { content: "\f7cd"; }
+.bi-alexa::before { content: "\f7ce"; }
+.bi-alipay::before { content: "\f7cf"; }
+.bi-android::before { content: "\f7d0"; }
+.bi-android2::before { content: "\f7d1"; }
+.bi-box-fill::before { content: "\f7d2"; }
+.bi-box-seam-fill::before { content: "\f7d3"; }
+.bi-browser-chrome::before { content: "\f7d4"; }
+.bi-browser-edge::before { content: "\f7d5"; }
+.bi-browser-firefox::before { content: "\f7d6"; }
+.bi-browser-safari::before { content: "\f7d7"; }
+.bi-c-circle-1::before { content: "\f7d8"; }
+.bi-c-circle-fill-1::before { content: "\f7d9"; }
+.bi-c-circle-fill::before { content: "\f7da"; }
+.bi-c-circle::before { content: "\f7db"; }
+.bi-c-square-fill::before { content: "\f7dc"; }
+.bi-c-square::before { content: "\f7dd"; }
+.bi-capsule-pill::before { content: "\f7de"; }
+.bi-capsule::before { content: "\f7df"; }
+.bi-car-front-fill::before { content: "\f7e0"; }
+.bi-car-front::before { content: "\f7e1"; }
+.bi-cassette-fill::before { content: "\f7e2"; }
+.bi-cassette::before { content: "\f7e3"; }
+.bi-cc-circle-1::before { content: "\f7e4"; }
+.bi-cc-circle-fill-1::before { content: "\f7e5"; }
+.bi-cc-circle-fill::before { content: "\f7e6"; }
+.bi-cc-circle::before { content: "\f7e7"; }
+.bi-cc-square-fill::before { content: "\f7e8"; }
+.bi-cc-square::before { content: "\f7e9"; }
+.bi-cup-hot-fill::before { content: "\f7ea"; }
+.bi-cup-hot::before { content: "\f7eb"; }
+.bi-currency-rupee::before { content: "\f7ec"; }
+.bi-dropbox::before { content: "\f7ed"; }
+.bi-escape::before { content: "\f7ee"; }
+.bi-fast-forward-btn-fill::before { content: "\f7ef"; }
+.bi-fast-forward-btn::before { content: "\f7f0"; }
+.bi-fast-forward-circle-fill::before { content: "\f7f1"; }
+.bi-fast-forward-circle::before { content: "\f7f2"; }
+.bi-fast-forward-fill::before { content: "\f7f3"; }
+.bi-fast-forward::before { content: "\f7f4"; }
+.bi-filetype-sql::before { content: "\f7f5"; }
+.bi-fire::before { content: "\f7f6"; }
+.bi-google-play::before { content: "\f7f7"; }
+.bi-h-circle-1::before { content: "\f7f8"; }
+.bi-h-circle-fill-1::before { content: "\f7f9"; }
+.bi-h-circle-fill::before { content: "\f7fa"; }
+.bi-h-circle::before { content: "\f7fb"; }
+.bi-h-square-fill::before { content: "\f7fc"; }
+.bi-h-square::before { content: "\f7fd"; }
+.bi-indent::before { content: "\f7fe"; }
+.bi-lungs-fill::before { content: "\f7ff"; }
+.bi-lungs::before { content: "\f800"; }
+.bi-microsoft-teams::before { content: "\f801"; }
+.bi-p-circle-1::before { content: "\f802"; }
+.bi-p-circle-fill-1::before { content: "\f803"; }
+.bi-p-circle-fill::before { content: "\f804"; }
+.bi-p-circle::before { content: "\f805"; }
+.bi-p-square-fill::before { content: "\f806"; }
+.bi-p-square::before { content: "\f807"; }
+.bi-pass-fill::before { content: "\f808"; }
+.bi-pass::before { content: "\f809"; }
+.bi-prescription::before { content: "\f80a"; }
+.bi-prescription2::before { content: "\f80b"; }
+.bi-r-circle-1::before { content: "\f80c"; }
+.bi-r-circle-fill-1::before { content: "\f80d"; }
+.bi-r-circle-fill::before { content: "\f80e"; }
+.bi-r-circle::before { content: "\f80f"; }
+.bi-r-square-fill::before { content: "\f810"; }
+.bi-r-square::before { content: "\f811"; }
+.bi-repeat-1::before { content: "\f812"; }
+.bi-repeat::before { content: "\f813"; }
+.bi-rewind-btn-fill::before { content: "\f814"; }
+.bi-rewind-btn::before { content: "\f815"; }
+.bi-rewind-circle-fill::before { content: "\f816"; }
+.bi-rewind-circle::before { content: "\f817"; }
+.bi-rewind-fill::before { content: "\f818"; }
+.bi-rewind::before { content: "\f819"; }
+.bi-train-freight-front-fill::before { content: "\f81a"; }
+.bi-train-freight-front::before { content: "\f81b"; }
+.bi-train-front-fill::before { content: "\f81c"; }
+.bi-train-front::before { content: "\f81d"; }
+.bi-train-lightrail-front-fill::before { content: "\f81e"; }
+.bi-train-lightrail-front::before { content: "\f81f"; }
+.bi-truck-front-fill::before { content: "\f820"; }
+.bi-truck-front::before { content: "\f821"; }
+.bi-ubuntu::before { content: "\f822"; }
+.bi-unindent::before { content: "\f823"; }
+.bi-unity::before { content: "\f824"; }
+.bi-universal-access-circle::before { content: "\f825"; }
+.bi-universal-access::before { content: "\f826"; }
+.bi-virus::before { content: "\f827"; }
+.bi-virus2::before { content: "\f828"; }
+.bi-wechat::before { content: "\f829"; }
+.bi-yelp::before { content: "\f82a"; }
+.bi-sign-stop-fill::before { content: "\f82b"; }
+.bi-sign-stop-lights-fill::before { content: "\f82c"; }
+.bi-sign-stop-lights::before { content: "\f82d"; }
+.bi-sign-stop::before { content: "\f82e"; }
+.bi-sign-turn-left-fill::before { content: "\f82f"; }
+.bi-sign-turn-left::before { content: "\f830"; }
+.bi-sign-turn-right-fill::before { content: "\f831"; }
+.bi-sign-turn-right::before { content: "\f832"; }
+.bi-sign-turn-slight-left-fill::before { content: "\f833"; }
+.bi-sign-turn-slight-left::before { content: "\f834"; }
+.bi-sign-turn-slight-right-fill::before { content: "\f835"; }
+.bi-sign-turn-slight-right::before { content: "\f836"; }
+.bi-sign-yield-fill::before { content: "\f837"; }
+.bi-sign-yield::before { content: "\f838"; }
+.bi-ev-station-fill::before { content: "\f839"; }
+.bi-ev-station::before { content: "\f83a"; }
+.bi-fuel-pump-diesel-fill::before { content: "\f83b"; }
+.bi-fuel-pump-diesel::before { content: "\f83c"; }
+.bi-fuel-pump-fill::before { content: "\f83d"; }
+.bi-fuel-pump::before { content: "\f83e"; }
+.bi-0-circle-fill::before { content: "\f83f"; }
+.bi-0-circle::before { content: "\f840"; }
+.bi-0-square-fill::before { content: "\f841"; }
+.bi-0-square::before { content: "\f842"; }
+.bi-rocket-fill::before { content: "\f843"; }
+.bi-rocket-takeoff-fill::before { content: "\f844"; }
+.bi-rocket-takeoff::before { content: "\f845"; }
+.bi-rocket::before { content: "\f846"; }
+.bi-stripe::before { content: "\f847"; }
+.bi-subscript::before { content: "\f848"; }
+.bi-superscript::before { content: "\f849"; }
+.bi-trello::before { content: "\f84a"; }
+.bi-envelope-at-fill::before { content: "\f84b"; }
+.bi-envelope-at::before { content: "\f84c"; }
+.bi-regex::before { content: "\f84d"; }
+.bi-text-wrap::before { content: "\f84e"; }
+.bi-sign-dead-end-fill::before { content: "\f84f"; }
+.bi-sign-dead-end::before { content: "\f850"; }
+.bi-sign-do-not-enter-fill::before { content: "\f851"; }
+.bi-sign-do-not-enter::before { content: "\f852"; }
+.bi-sign-intersection-fill::before { content: "\f853"; }
+.bi-sign-intersection-side-fill::before { content: "\f854"; }
+.bi-sign-intersection-side::before { content: "\f855"; }
+.bi-sign-intersection-t-fill::before { content: "\f856"; }
+.bi-sign-intersection-t::before { content: "\f857"; }
+.bi-sign-intersection-y-fill::before { content: "\f858"; }
+.bi-sign-intersection-y::before { content: "\f859"; }
+.bi-sign-intersection::before { content: "\f85a"; }
+.bi-sign-merge-left-fill::before { content: "\f85b"; }
+.bi-sign-merge-left::before { content: "\f85c"; }
+.bi-sign-merge-right-fill::before { content: "\f85d"; }
+.bi-sign-merge-right::before { content: "\f85e"; }
+.bi-sign-no-left-turn-fill::before { content: "\f85f"; }
+.bi-sign-no-left-turn::before { content: "\f860"; }
+.bi-sign-no-parking-fill::before { content: "\f861"; }
+.bi-sign-no-parking::before { content: "\f862"; }
+.bi-sign-no-right-turn-fill::before { content: "\f863"; }
+.bi-sign-no-right-turn::before { content: "\f864"; }
+.bi-sign-railroad-fill::before { content: "\f865"; }
+.bi-sign-railroad::before { content: "\f866"; }
+.bi-building-add::before { content: "\f867"; }
+.bi-building-check::before { content: "\f868"; }
+.bi-building-dash::before { content: "\f869"; }
+.bi-building-down::before { content: "\f86a"; }
+.bi-building-exclamation::before { content: "\f86b"; }
+.bi-building-fill-add::before { content: "\f86c"; }
+.bi-building-fill-check::before { content: "\f86d"; }
+.bi-building-fill-dash::before { content: "\f86e"; }
+.bi-building-fill-down::before { content: "\f86f"; }
+.bi-building-fill-exclamation::before { content: "\f870"; }
+.bi-building-fill-gear::before { content: "\f871"; }
+.bi-building-fill-lock::before { content: "\f872"; }
+.bi-building-fill-slash::before { content: "\f873"; }
+.bi-building-fill-up::before { content: "\f874"; }
+.bi-building-fill-x::before { content: "\f875"; }
+.bi-building-fill::before { content: "\f876"; }
+.bi-building-gear::before { content: "\f877"; }
+.bi-building-lock::before { content: "\f878"; }
+.bi-building-slash::before { content: "\f879"; }
+.bi-building-up::before { content: "\f87a"; }
+.bi-building-x::before { content: "\f87b"; }
+.bi-buildings-fill::before { content: "\f87c"; }
+.bi-buildings::before { content: "\f87d"; }
+.bi-bus-front-fill::before { content: "\f87e"; }
+.bi-bus-front::before { content: "\f87f"; }
+.bi-ev-front-fill::before { content: "\f880"; }
+.bi-ev-front::before { content: "\f881"; }
+.bi-globe-americas::before { content: "\f882"; }
+.bi-globe-asia-australia::before { content: "\f883"; }
+.bi-globe-central-south-asia::before { content: "\f884"; }
+.bi-globe-europe-africa::before { content: "\f885"; }
+.bi-house-add-fill::before { content: "\f886"; }
+.bi-house-add::before { content: "\f887"; }
+.bi-house-check-fill::before { content: "\f888"; }
+.bi-house-check::before { content: "\f889"; }
+.bi-house-dash-fill::before { content: "\f88a"; }
+.bi-house-dash::before { content: "\f88b"; }
+.bi-house-down-fill::before { content: "\f88c"; }
+.bi-house-down::before { content: "\f88d"; }
+.bi-house-exclamation-fill::before { content: "\f88e"; }
+.bi-house-exclamation::before { content: "\f88f"; }
+.bi-house-gear-fill::before { content: "\f890"; }
+.bi-house-gear::before { content: "\f891"; }
+.bi-house-lock-fill::before { content: "\f892"; }
+.bi-house-lock::before { content: "\f893"; }
+.bi-house-slash-fill::before { content: "\f894"; }
+.bi-house-slash::before { content: "\f895"; }
+.bi-house-up-fill::before { content: "\f896"; }
+.bi-house-up::before { content: "\f897"; }
+.bi-house-x-fill::before { content: "\f898"; }
+.bi-house-x::before { content: "\f899"; }
+.bi-person-add::before { content: "\f89a"; }
+.bi-person-down::before { content: "\f89b"; }
+.bi-person-exclamation::before { content: "\f89c"; }
+.bi-person-fill-add::before { content: "\f89d"; }
+.bi-person-fill-check::before { content: "\f89e"; }
+.bi-person-fill-dash::before { content: "\f89f"; }
+.bi-person-fill-down::before { content: "\f8a0"; }
+.bi-person-fill-exclamation::before { content: "\f8a1"; }
+.bi-person-fill-gear::before { content: "\f8a2"; }
+.bi-person-fill-lock::before { content: "\f8a3"; }
+.bi-person-fill-slash::before { content: "\f8a4"; }
+.bi-person-fill-up::before { content: "\f8a5"; }
+.bi-person-fill-x::before { content: "\f8a6"; }
+.bi-person-gear::before { content: "\f8a7"; }
+.bi-person-lock::before { content: "\f8a8"; }
+.bi-person-slash::before { content: "\f8a9"; }
+.bi-person-up::before { content: "\f8aa"; }
+.bi-scooter::before { content: "\f8ab"; }
+.bi-taxi-front-fill::before { content: "\f8ac"; }
+.bi-taxi-front::before { content: "\f8ad"; }
+.bi-amd::before { content: "\f8ae"; }
+.bi-database-add::before { content: "\f8af"; }
+.bi-database-check::before { content: "\f8b0"; }
+.bi-database-dash::before { content: "\f8b1"; }
+.bi-database-down::before { content: "\f8b2"; }
+.bi-database-exclamation::before { content: "\f8b3"; }
+.bi-database-fill-add::before { content: "\f8b4"; }
+.bi-database-fill-check::before { content: "\f8b5"; }
+.bi-database-fill-dash::before { content: "\f8b6"; }
+.bi-database-fill-down::before { content: "\f8b7"; }
+.bi-database-fill-exclamation::before { content: "\f8b8"; }
+.bi-database-fill-gear::before { content: "\f8b9"; }
+.bi-database-fill-lock::before { content: "\f8ba"; }
+.bi-database-fill-slash::before { content: "\f8bb"; }
+.bi-database-fill-up::before { content: "\f8bc"; }
+.bi-database-fill-x::before { content: "\f8bd"; }
+.bi-database-fill::before { content: "\f8be"; }
+.bi-database-gear::before { content: "\f8bf"; }
+.bi-database-lock::before { content: "\f8c0"; }
+.bi-database-slash::before { content: "\f8c1"; }
+.bi-database-up::before { content: "\f8c2"; }
+.bi-database-x::before { content: "\f8c3"; }
+.bi-database::before { content: "\f8c4"; }
+.bi-houses-fill::before { content: "\f8c5"; }
+.bi-houses::before { content: "\f8c6"; }
+.bi-nvidia::before { content: "\f8c7"; }
+.bi-person-vcard-fill::before { content: "\f8c8"; }
+.bi-person-vcard::before { content: "\f8c9"; }
+.bi-sina-weibo::before { content: "\f8ca"; }
+.bi-tencent-qq::before { content: "\f8cb"; }
+.bi-wikipedia::before { content: "\f8cc"; }
diff --git a/site_libs/bootstrap/bootstrap-icons.woff b/site_libs/bootstrap/bootstrap-icons.woff
new file mode 100644
index 0000000000000000000000000000000000000000..18d21d457558d4dc2e231a8f6ee585fada9c6bab
GIT binary patch
literal 164168
zcmZ5ncR1B;+*d-G4I^alol(fj-s=dFnS*SRbU+;5W_s3^_zxVIt%5{$Cd3i}|9?~s3>EP3
zu3QJc6gW?qV>l4H20|jhQvzBZ94lF3*s+a^wL9>l@bHA!@$g)(t9@-$vUm2g!^0DO
zg?IJ3I37W#R(0^&?h9LMINnvMaxe#W;5~d=p8NO(Fo8D@G`Fm`T
zkOO@Q~6X8NytmGN{-1UHIQ?LLA7M?ZTq2;&Dn5sNq4g*2C7BpFe;9{JA=Q?ly8b
zbm-3Aqq_mLcT?{^O{1+24G|lojKF824bHS4zT#0pJ4FkBEyfnj%84h#PaF##*f(=(
zYJbLXSnU*O}$41t136;734{uP?C@+>)%vJN?lkyd*|)1~USGqnAdxERjX~)j?t;acl3K;Zc--a1Cqvb<
z!*275rk$L%QsSK%KFje;fq`UOzS@zA-|HXOYn*)!{0=;)*_g7czK<`3ia9DfY(
zZxfwKXwM1GT2?maH~e$C)vm!X6y980FtOuo`;qfmj?2JDd;eOYx-h@N0Hrq08RSg1
zTMrYKso!Uzd8hSQ_4xH!{ChsexBi#i!48IF1H2>UPhwyd8eZHZCBvU#yBZaI`zj^)
z1v%X3I%(0iyh$adh2Ci=w&{ruhJ}i0uC|4VCa|S85vlL%3I2R#yrre3g{5V5019x$
zh|)I4T)I+~(i+G2>7{n1jgEPyrADRoj`_b!y-QnhxsOV9O6zd%n@U|vn{j!SdNPJW
zBhU8r0}bUyEXnlnN0=WxCDT_Nx&Oe-yhNoK<(NoU(N$dIm`PW~S^U-!onBs8T;iDC
zq@rysI$ZBqm|kF4Ch1t2UbIw30ItGNmvK0P=dCp89U=B=H7#+~D;sw7$~Vm)E%kD2
zZBm~qe^?xcGxEx4GM~zOSSB@Mj&rS7p32`ed^Qq@lix@FE@U){FD@F<*^fmSZNQpG
zJRRc^7OlAlr8Fb5`)Gv8hH+Jy_;3bJVE-dRwY6;8fT=WoxEpt8zvM(Ku(D0hvb1V=
z3`f6T@hG>=V5W>|I3CBfU-zgu$RP5Gd{VJe0k1(LZ|Tek6Ha$O<>c9U{>6xflgoz@
z9e;*b!;z~U`?s1B1uJ@2*!J~LUIfMpR_Trwtr+Y(oV+rZ&&eAcwqLE=muz}3YivA3
zvl`=NYp!hhK4ZFmC6Wa6g>580RLMtize2DfS
z^Y*-%;jI;)egBid^Vb)8!5F#GoE6=DniI|QqzlvF{Pq!|J)aZR^MnhN%lE+}MEh>0
zjch5IGwi+2COKP5pJWk)!
z^81CCo_e-O{>*gL5w}mT)ABOt7#6G7axv&0evp#ht0iMFW9CYi8c~RHa86GxEKGB7
zHBC(}OmeXKo$g)Ox@z?(U8k^a^?6geYhm-Mb>)2-ZJ}S2d%}U*a=&Is@8kC~i;j~D
zEB4