微博情感分析評測總結

1、微博情感分析評測總結任務設置觀點句識別情感傾向性判斷針對觀點句情感要素抽取針對觀點句數(shù)據(jù)集來自騰訊微博數(shù)據(jù)原始數(shù)據(jù)集20話題主要是熱門事件，如“三亞春節(jié)宰客”約17500條微博約32000個句子數(shù)據(jù)集數(shù)據(jù)標注三標注者對同一數(shù)據(jù)標注數(shù)據(jù)集大小2023條微博3416個句子1209個非觀點句2207個觀點句407正面、1766負面、34其他2361個對象441正面、1910負面、10其他數(shù)據(jù)集標注標準關于觀點句個人意愿、心情不是觀點句，如“我感到很高興”表達了明顯觀點的反問句屬于觀點句，如“體育競技有不殘酷的嗎？”關于觀點句傾向性正面、負面，其他(Other)三類，“其他”表示中性或無法確定正負的情

2、況不進行數(shù)據(jù)集標注標準關于觀點句情感對象情感對象優(yōu)先從當前句子抽取，但可以跨越當前句子從前面的句子或后面的句子中抽?。ㄇ懊娴泥徑渥觾?yōu)先）情感對象盡可能完整和明確，事件按細粒度標注： “ipad的屏幕很棒！”- “ipad的屏幕” “官二代陶汝坤:作案動機極其卑劣”- “作案動機”對象本身不是情感表達： ”#官二代求愛不成將少女毀容# 這種畜生是怎么被教育出來的??！” - “官二代”人稱代詞需要盡可能在當前微博內(nèi)進行指代消解： “小明就讀于北京大學，他是名優(yōu)秀的學生?！?”小明“抽取出句子中每個情感片段所對應的情感對象： “你根本已經(jīng)不是個人了，你比蛇還冷血，你比畜生還畜生?！?- “你” “

3、你” “你”參評單位34支隊伍包括全國重點高校與科研機構觀點句識別：53組情感傾向判斷：48組情感對象抽?。?2組觀點句識別任務要求識別每條微博中各個句子是觀點句還是非觀點句評價標準準確率、召回率、F值微平均宏平均觀點句識別微平均0.5000.5500.6000.6500.7000.7500.8000.8500.9000.9501.0000.0000.2000.4000.6000.8001.000PrecisionPrecisionRecallRecall觀點句識別微平均0.0%5.0%10.0%15.0%20.0%25.0%0.00-0.050.05-0.100.10-0.150.15-0.

4、200.20-0.250.25-0.300.30-0.350.35-0.400.40-0.450.45-0.500.50-0.550.55-0.600.60-0.650.65-0.700.70-0.750.75-0.800.80-0.850.85-0.900.90-0.950.95-1.00百百分分比比F-measureF-measure觀點句識別宏平均0.5000.5500.6000.6500.7000.7500.8000.8500.9000.9501.0000.0000.1000.2000.3000.4000.5000.6000.7000.8000.9001.000PrecisionPre

5、cisionRecallRecall觀點句識別宏平均0.0%5.0%10.0%15.0%20.0%25.0%0.00-0.050.05-0.100.10-0.150.15-0.200.20-0.250.25-0.300.30-0.350.35-0.400.40-0.450.45-0.500.50-0.550.55-0.600.60-0.650.65-0.700.70-0.750.75-0.800.80-0.850.85-0.900.90-0.950.95-1.00百百分分比比F-measureF-measure情感傾向性判斷任務要求判斷微博中每條觀點句的情感傾向正面、負面、其他評價標準準確率、

6、召回率、F值微平均宏平均情感傾向性判斷微平均0.0000.1000.2000.3000.4000.5000.6000.7000.8000.9001.0000.0000.1000.2000.3000.4000.5000.6000.7000.8000.900PrecisionPrecisionRecallRecall情感傾向性判斷微平均0.0%2.0%4.0%6.0%8.0%10.0%12.0%14.0%16.0%0.00-0.050.05-0.100.10-0.150.15-0.200.20-0.250.25-0.300.30-0.350.35-0.400.40-0.450.45-0.500.5

7、0-0.550.55-0.600.60-0.650.65-0.700.70-0.750.75-0.800.80-0.850.85-0.900.90-0.950.95-1.00百百分分比比F-measureF-measure情感傾向性判斷宏平均0.0000.1000.2000.3000.4000.5000.6000.7000.8000.9001.0000.0000.1000.2000.3000.4000.5000.6000.7000.8000.900PrecisionPrecisionRecallRecall情感傾向性判斷宏平均0.0%2.0%4.0%6.0%8.0%10.0%12.0%14.0

8、%16.0%0.00-0.050.05-0.100.10-0.150.15-0.200.20-0.250.25-0.300.30-0.350.35-0.400.40-0.450.45-0.500.50-0.550.55-0.600.60-0.650.65-0.700.70-0.750.75-0.800.80-0.850.85-0.900.90-0.950.95-1.00百百分分比比F-measureF-measure情感要素抽取任務要求找出微博中每條觀點句作者的評價對象判斷針對情感對象的觀點極性評價標準精確評價寬松評價準確率、召回率、F值情感要素抽取嚴格評價微平均0.0000.1000.200

9、0.3000.4000.5000.6000.0000.0500.1000.1500.2000.2500.300PrecisionPrecisionRecallRecall情感要素抽取嚴格評價微平均0.0%5.0%10.0%15.0%20.0%25.0%30.0%35.0%0.00-0.050.05-0.100.10-0.150.15-0.200.20-0.250.25-0.300.30-0.350.35-0.400.40-0.450.45-0.500.50-0.550.55-0.600.60-0.650.65-0.700.70-0.750.75-0.800.80-0.850.85-0.900.

10、90-0.950.95-1.00百百分分比比F-measureF-measure情感要素抽取嚴格評價宏平均0.0000.0500.1000.1500.2000.2500.3000.3500.4000.4500.5000.0000.0500.1000.1500.2000.2500.300PrecisionPrecisionRecallRecall情感要素抽取嚴格評價宏平均0.0%5.0%10.0%15.0%20.0%25.0%30.0%0.00-0.050.05-0.100.10-0.150.15-0.200.20-0.250.25-0.300.30-0.350.35-0.400.40-0.45

11、0.45-0.500.50-0.550.55-0.600.60-0.650.65-0.700.70-0.750.75-0.800.80-0.850.85-0.900.90-0.950.95-1.00百百分分比比F-measureF-measure情感要素抽取寬松評價微平均0.0000.1000.2000.3000.4000.5000.6000.7000.0000.0500.1000.1500.2000.2500.3000.3500.400PrecisionPrecisionRecallRecall情感要素抽取寬松評價微平均0.0%5.0%10.0%15.0%20.0%25.0%0.00-0.0

12、50.05-0.100.10-0.150.15-0.200.20-0.250.25-0.300.30-0.350.35-0.400.40-0.450.45-0.500.50-0.550.55-0.600.60-0.650.65-0.700.70-0.750.75-0.800.80-0.850.85-0.90百百分分比比F-measureF-measure情感要素抽取寬松評價宏平均0.0000.1000.2000.3000.4000.5000.6000.7000.0000.0500.1000.1500.2000.2500.3000.3500.400PrecisionPrecisionRecallRecall情感要素抽取寬松評價宏平均0.0%5.0%10.0%15.0%20.0%25.0%0.00-0.050.05-0.100.10-0.150.15-0.200.20-0.250.25-0.300.30-0.350.35-0.400.40-0.450.45-0.500.50-0.550.55-0.600.60-0.650.65-0.700.70-0.750.75-0.800.80-0.850.85-0.900.90-0.950.95-1.00百百分分比比F-measureF-measure小結微博情感分析相當具有挑戰(zhàn)性不同于產(chǎn)品評論數(shù)據(jù)，微博數(shù)據(jù)領域