Select Language

AI社区

公开数据集

乌尔都语Stopwords列表

乌尔都语Stopwords列表

0.01M
601 浏览
0 喜欢
0 次下载
0 条讨论
Social Science,Linguistics,India,Languages Classification

数据结构 ? 0.01M

    Data Structure ?

    * 以上分析是由系统提取分析形成的结果,具体实际数据为准。

    README.md

    Context Urdu is an indo-Aryan language with over 100 million speakers. It is mainly used in Pakistan. While often mutually intelligible with Hindi, the two languages use different scripts and as a result NLP tools developed for Hindi are often not extendible to Urdu. Some words, like “the” or “and” in English, are used a lot in speech and writing. For most Natural Language Processing applications, you will want to remove these very frequent words. This is usually done using a list of “stopwords” which has been complied by hand. Content This dataset is a list of 517 high-frequency Urdu words. Very high frequency words are not generally useful for most NLP tasks and are generally removed as part of pre-processing. The .json and .txt files have the same words in them. Acknowledgements: This dataset is Copyright (c) 2016 Gene Diaz and distributed here under an MIT license. See the attached license file for more information. Inspiration: This is more of a utility NLP dataset than one that is interesting in its own right. Try using it with these other Urdu datasets: * [Urdu-Nepali Parallel Corpus: A part of speech tagged corpus for Urdu & Nepali](https://www.kaggle.com/rtatman/urdunepali-parallel-corpus) * [The Holy Quran (in 21 languages, including Urdu)](https://www.kaggle.com/zusmani/the-holy-quran) * [Old Newspapers: A cleaned subset of HC Corpora newspapers](https://www.kaggle.com/alvations/old-newspapers)
    ×

    帕依提提提温馨提示

    该数据集正在整理中,为您准备了其他渠道,请您使用

    注:部分数据正在处理中,未能直接提供下载,还请大家理解和支持。
    暂无相关内容。
    暂无相关内容。
    • 分享你的想法
    去分享你的想法~~

    全部内容

      欢迎交流分享
      开始分享您的观点和意见,和大家一起交流分享.
    所需积分:0 去赚积分?
    • 601浏览
    • 0下载
    • 0点赞
    • 收藏
    • 分享