公开数据集
数据结构 ? 0.01M
Data Structure ?
* 以上分析是由系统提取分析形成的结果,具体实际数据为准。
README.md
Context
Urdu is an indo-Aryan language with over 100 million speakers. It is mainly used in Pakistan. While often mutually intelligible with Hindi, the two languages use different scripts and as a result NLP tools developed for Hindi are often not extendible to Urdu.
Some words, like “the” or “and” in English, are used a lot in speech and writing. For most Natural Language Processing applications, you will want to remove these very frequent words. This is usually done using a list of “stopwords” which has been complied by hand.
Content
This dataset is a list of 517 high-frequency Urdu words. Very high frequency words are not generally useful for most NLP tasks and are generally removed as part of pre-processing.
The .json and .txt files have the same words in them.
Acknowledgements:
This dataset is Copyright (c) 2016 Gene Diaz and distributed here under an MIT license. See the attached license file for more information.
Inspiration:
This is more of a utility NLP dataset than one that is interesting in its own right. Try using it with these other Urdu datasets:
* [Urdu-Nepali Parallel Corpus: A part of speech tagged corpus for Urdu & Nepali](https://www.kaggle.com/rtatman/urdunepali-parallel-corpus)
* [The Holy Quran (in 21 languages, including Urdu)](https://www.kaggle.com/zusmani/the-holy-quran)
* [Old Newspapers: A cleaned subset of HC Corpora newspapers](https://www.kaggle.com/alvations/old-newspapers)
×
帕依提提提温馨提示
该数据集正在整理中,为您准备了其他渠道,请您使用
注:部分数据正在处理中,未能直接提供下载,还请大家理解和支持。
暂无相关内容。
暂无相关内容。
- 分享你的想法
去分享你的想法~~
全部内容
欢迎交流分享
开始分享您的观点和意见,和大家一起交流分享.
数据使用声明:
- 1、该数据来自于互联网数据采集或服务商的提供,本平台为用户提供数据集的展示与浏览。
- 2、本平台仅作为数据集的基本信息展示、包括但不限于图像、文本、视频、音频等文件类型。
- 3、数据集基本信息来自数据原地址或数据提供方提供的信息,如数据集描述中有描述差异,请以数据原地址或服务商原地址为准。
- 1、本站中的所有数据集的版权都归属于原数据发布者或数据提供方所有。
- 1、如您需要转载本站数据,请保留原数据地址及相关版权声明。
- 1、如本站中的部分数据涉及侵权展示,请及时联系本站,我们会安排进行数据下线。