OSCARavr. 27, 2016Aller sur le site du projet Image credit: Alix ChaguéCorpus LinguisticsPedro Ortiz SuarezChercheur SeniorJe suis chercheur senior au sein de la fondation Common Crawl.PublicationsQuality at a Glance: An Audit of Web-Crawled Multilingual DatasetsWe audit 5 multilingual corpora, finding that lower-resource corpora have systematic issues.Julia Kreutzer, Isaac Caswell, Lisa Wang, Ahsan Wahab, Daan van Esch, Nasanbayar Ulzii-Orshikh, Allahsera Tapo, Nishant Subramani, Artem Sokolov, Claytone Sikasote, Monang Setyawan, Supheakmungkol Sarin, Sokhar Samb, Benoît Sagot, Clara Rivera, Annette Rios, Isabel Papadimitriou, Salomey Osei, Pedro Ortiz Suarez, Iroro Orife, Kelechi Ogueji, Andre Niyongabo Rubungo, Toan Q. Nguyen, Mathias Müller, André Müller, Shamsuddeen Hassan Muhammad, Nanda Muhammad, Ayanda Mnyakeni, Jamshidbek Mirzakhalov, Tapiwanashe Matangira, Colin Leong, Nze Lawson, Sneha Kudugunta, Yacine Jernite, Mathias Jenny, Orhan Firat, Bonaventure F. P. Dossou, Sakhile Dlamini, Nisansa de Silva, Sakine Çabuk Ballı, Stella Biderman, Alessia Battisti, Ahmed Baruwa, Ankur Bapna, Pallavi Baljekar, Israel Abebe Azime, Ayodele Awokoya, Duygu Ataman, Orevaoghene Ahia, Oghenefego Ahia, Sweta Agrawal, Mofetoluwa AdeyemiPDF Citation Projet DOI TACL HAL arXivA Monolingual Approach to Contextualized Word Embeddings for Mid-Resource LanguagesWe explore the impact of the training corpus on contextualized word embeddings in five mid-resource languages.Pedro Ortiz Suarez, Laurent Romary, Benoît SagotPDF Citation Jeu de données Projet Vidéo DOI ACL Anthology ACL 2020 HAL arXivAsynchronous Pipeline for Processing Huge Corpora on Medium to Low Resource InfrastructuresWe propose a new pipeline to filter, clean and classify Common Crawl by language, we publish the final corpus under the name OSCAR.Pedro Ortiz Suarez, Benoît Sagot, Laurent RomaryPDF Citation Code Jeu de données Projet Diapositives DOI CMLC-7 Website HAL
Image credit: Alix Chagué
Image credit: Alix Chagué
Image credit: Alix Chagué
Image credit: Alix Chagué
