Select Language

AI社区

公开数据集

单词难度预测

单词难度预测

1.85M
280 浏览
0 喜欢
0 次下载
0 条讨论
Computer Science,Games,NLP,Text Data,Languages Classification

数据结构 ? 1.85M

    Data Structure ?

    * 以上分析是由系统提取分析形成的结果,具体实际数据为准。

    README.md

    Context Most text-simplification systems require an indicator of the complexity of the words. The prevalent approaches to word difficulty prediction are based on manual feature engineering. Using deep learning based models are largely left unexplored due to their comparatively poor performance. We have explored the use of one of such in predicting the difficulty of words. We have treated the problem as a binary classification problem. We have trained traditional machine learning models and evaluated their performance on the task. Removing dependency on frequency of previously acquired words for measuring difficulty was one of our primary aims. Then we analyzed a convolutional neural network based prediction model which operates at the character level and evaluate its efficiency compared to others. This dataset contains 40481 data instances. The various column headers are as follows: * Word * Length * Freq_HAL * Log_Freq_HAL * I_Mean_RT * I_Zscore * I_SD * Obs * I_Mean_Accuracy I_Zscore determines the difficulty of the word. This value fluctuates between 0 & 1 for a word with 0 being SIMPLE & 1 being DIFFICULT Content The data is in CSV format. Please check the [research paper](https://github.com/garain/Word-Difficulty-Prediction/blob/master/WORD_DIFFICULTY.pdf) for obtaining the difficulty label from the I_Z score. Acknowledgements Thank you AvishekGarain, Arpan Basu & Sudip KumarNaskar [citation] (https://ieee-dataport.org/open-access/dataset-word-difficulty-prediction) The other details of the dataset and the method to obtain the difficulty labels are present in the research publication whose link is attached. For getting open-access to the publication visit https://garain.codes Inspiration Your data will be in front of the world's largest data science community. What questions do you want to see answered?
    ×

    帕依提提提温馨提示

    该数据集正在整理中,为您准备了其他渠道,请您使用

    注:部分数据正在处理中,未能直接提供下载,还请大家理解和支持。
    暂无相关内容。
    暂无相关内容。
    • 分享你的想法
    去分享你的想法~~

    全部内容

      欢迎交流分享
      开始分享您的观点和意见,和大家一起交流分享.
    所需积分:0 去赚积分?
    • 280浏览
    • 0下载
    • 0点赞
    • 收藏
    • 分享