Python 英文词频统计 |
您所在的位置：网站首页 › python英文字频统计 › Python 英文词频统计 |
Python 英文词频统计
六云
博客园
::
首页
::
新随笔
::
联系 ::
订阅
::
管理
公告
Python 英文词频统计
词频统计预处理
下载一首英文的歌词或文章
将所有,.？！’:等分隔符全部替换为空格
将所有大写转换为小写
生成单词列表
生成词频统计
排序
排除语法型词汇，代词、冠词、连词
输出词频最大TOP10
article ='''
Big data analytics and business analytics
by Duan, Lian; Xiong, Ye
Over the past few decades, with the development of automatic identification, data capture and storage technologies,
people generate data much faster and collect data much bigger than ever before in business, science, engineering, education and other areas.
Big data has emerged as an important area of study for both practitioners and researchers.
It has huge impacts on data-related problems.
In this paper, we identify the key issues related to big data analytics and then investigate its applications specifically related to business problems.
'''
split = article.split()
print(split)
#使用空格替换标点符号
article = article.replace(",","").replace(".","").replace(":","").replace(";","").replace("?","")
#大写字母转换成小写字母
exchange = article.lower();
print(exchange)
#生成单词列表
list = exchange.split()
print(list)
#生成词频统计
dic = {}
for i in list:
count = list.count(i)
dic[i] = count
print(dic)
#排除特定单词
word = {'and','the','with','in','by','its','for','of','an','to'}
for i in word:
del(dic[i])
print(dic)
#排序
dic1= sorted(dic.items(),key=lambda d:d[1],reverse= True)
print(dic1)
#输出词频最大的前十位单词
for i in range(10):
print(dic1[i])
posted on 2018-03-26 16:24 流XC 阅读(6997) 评论(0) 编辑 收藏 举报 会员力量，点亮园子希望 刷新页面返回顶部 
|
【本文地址】
今日新闻 |
推荐新闻 |