Spoken dialog summarization system with HAPPINESS/SUFFERING factor recognition

doi:10.1007/s11704-016-6190-2

Front. Comput. Sci.

2017, Vol. 11

Issue (3) : 429-443 https://doi.org/10.1007/s11704-016-6190-2

RESEARCH ARTICLE

Spoken dialog summarization system with HAPPINESS/SUFFERING factor recognition

Yang-Yen OU¹, Ta-Wen KUAN¹, Anand PAUL², Jhing-Fa WANG^1,³, An-Chao TSAI³(

)

¹. Department of Electronic Engineering, Cheng Kung University, Tainan 701, China
². Department of Computer Science and Engineering, Kyungpook National Univeristy, Daegu 702-701, Korea
³. Department of Digital Multimedia Design, Tajen University, Pingtung 741, China

Download: PDF(1109 KB)
Export: BibTeX | EndNote | Reference Manager | ProCite | RefWorks

Abstract

This work presents a spoken dialog summarization system with HAPPINESS/SUFFERING factor recognition. The semantic content is compressed and classified by factor categories from spoken dialog. The transcription of automatic speech recognition is then processed through Chinese Knowledge and Information Processing segmentation system. The proposed system also adopts the part-of-speech tags to effectively select and rank the keywords. Finally, the HAPPINESS/SUFFERING factor recognition is done by the proposed point-wise mutual information. Compared with the original method, the performance is improved by applying the significant scores of keywords. The experimental results show that the average precision rate for factor recognition in outside test can reach 73.5% which demonstrates the possibility and potential of the proposed system.

Keywords spoken dialog summarization keyword extraction natural language processing (NLP) sentiment analysis

Corresponding Author(s): An-Chao TSAI

Just Accepted Date: 03 November 2016 Issue Date: 25 May 2017

Cite this article:

Yang-Yen OU,Ta-Wen KUAN,Anand PAUL, et al. Spoken dialog summarization system with HAPPINESS/SUFFERING factor recognition[J]. Front. Comput. Sci., 2017, 11(3): 429-443.

URL:

https://academic.hep.com.cn/fcs/EN/10.1007/s11704-016-6190-2
https://academic.hep.com.cn/fcs/EN/Y2017/V11/I3/429

1	LeeH, ShiangS R, YehC F, Chen Y N, HuangY , KongS Y, LeeL S. Spoken knowledge organization by semantic structuring and a prototype course lecture system for personalized learning. IEEE/ACM Transactions on Audio, Speech and Language Processing (TASLP), 2014, 22(5), 883–898
2	HuangC L, WuC H. Spoken document retrieval using multilevel knowledge and semantic verification. IEEE Transactions on Audio, Speech, and Language Processing, 2007, 15(8): 2551–2560 https://doi.org/10.1109/TASL.2007.907429
3	WangJ F, ChenBW, FanW K, Li C H. Emotion-aware assistive system for humanistic care based on the orange computing concept. Applied Computational Intelligence and Soft Computing, 2012 https://doi.org/10.1155/2012/183610
4	KoolagudiS G, KumarN, RaoK S. Speech emotion recognition using segmental level prosodic analysis. In: Proceedings of IEEE International Conference on Devices and Communication. 2011, 1–5 https://doi.org/10.1109/icdecom.2011.5738536
5	AhmedT, IslamM, AhmadM. Human emotion modeling based on salient global features of EEG signal. In: Proceedings of IEEE International Conference on Advances in Electrical Engineering. 2013, 246–251 https://doi.org/10.1109/icaee.2013.6750341
6	TsaiH C, FanW K, ChenB W, Wang J F, LinP C . A real-time awareness system for happiness expression based on the multilayer histogram of oriented gradients. In: Proceedings of the 4th International Conference on Awareness Science and Technology. 2012, 289–293 https://doi.org/10.1109/iCAwST.2012.6469628
7	ParkJ S, JangG J, KimJ H. Multistage utterance verification for keyword recognition-based online spoken content retrieval. IEEE Transactions on Consumer Electronics, 2012, 58(3), 1000–1005 https://doi.org/10.1109/TCE.2012.6311348
8	LiuF, LiuF F, LiuY. A supervised framework for keyword extraction from meeting transcripts. IEEE Transactions on Audio, Speech, and Language Processing, 2011, 19(3), 538–548 https://doi.org/10.1109/TASL.2010.2052119
9	LiuF, LiuY. Towards abstractive speech summarization: exploring unsupervised and supervised approaches for spoken utterance compression. IEEE Transactions on Audio, Speech, and Language Processing, 2013, 21(7), 1469–1480 https://doi.org/10.1109/TASL.2013.2255279
10	QinY. Applying frequency and location information to keyword extraction in single document. In: Proceedings of the 2nd IEEE International Conference on Cloud Computing and Intelligent Systems. 2012, 1398–1402 https://doi.org/10.1109/ccis.2012.6664615
11	WartenaC, Brussee R, SlakhorstW . Keyword extraction using word co-occurrence. In: Proceedings of IEEE Workshops on Database and Expert Systems Applications. 2010, 54–58 https://doi.org/10.1109/dexa.2010.32
12	JiaoH, LiuQ, JiaH B. Chinese keyword extraction based on n-gram and word co-occurrence. In: Proceedings of IEEE International Conference on Computational Intelligence and Security Workshops. 2007, 152–155 https://doi.org/10.1109/cisw.2007.4425468
13	GuptaA, DixitA, SharmaA K. A novel statistical and linguistic features based technique for keyword extraction. In: Proceedings of IEEE International Conference on Information Systems and Computer Networks. 2014, 55–59 https://doi.org/10.1109/iciscon.2014.6965218
14	HuX H, WuB. Automatic keyword extraction using linguistic features. In: Proceedings of the 6th IEEE International Conference on Data Mining Workshops. 2006, 19–23 https://doi.org/10.1109/icdmw.2006.36
15	ChenB W, RhoS, GuizaniM, Fan W K. Cognitive sensors based on kernel ridge phase-smoothing localization and multiregional histograms of oriented gradients. IEEE Transactions on Emerging Topics in Computing, 2016 https://doi.org/10.1109/TETC.2016.2585040
16	TroykaL Q, Thweatt J W. Structured Reading. Englewood Cliffs, NJ: Prentice Hall, 2003
17	HuangC L, HsiehC H, WuC H. Spoken document summarization using acoustic, prosodic and semantic information. In: Proceedings of IEEE International Conference on Multimedia. 2005
18	KurmiR, JainP. Text summarization using enhanced MMR technique. In: Proceedings of International Conference on Computer Communication and Informatics. 2014, 1–5 https://doi.org/10.1109/iccci.2014.6921769
19	LiY B, Merialdo B. Multi-video summarization based on Video- MMR. In: Proceedings of the 11th International Workshop on Image Analysis for Multimedia Interactive Services, 2010, 1–4
20	FerreiraR, Freitas F, CabralL S , LinsR D, LimaR, Fran�aG, Simskez S J, FavaroL . A four dimension graph model for automatic text summarization. In: Proceedings of IEEE/WIC/ACM International Joint Conferences onWeb Intelligence (WI) and Intelligent Agent Technologies. 2013, 389–396 https://doi.org/10.1109/wi-iat.2013.55
21	CambriaE, Schuller B, XiaY Q , HavasiC. New avenues in opinion mining and sentiment analysis. IEEE Intelligent Systems, 2013, 15–21 https://doi.org/10.1109/MIS.2013.30
22	OrtonyA, CloreG L, CollinsA. The Cognitive Structure of Emotions. Cambridge: Cambridge University Press, 1990
23	StevensonR A, MikelsJ A, JamesT W. Characterization of the affective norms for English words by discrete emotional categories. Behavior Research Methods, 2007, 39(4): 1020–1024 https://doi.org/10.3758/BF03192999
24	GrassiM, Cambria E, HussainA , PiazzaF. Sentic web: a new paradigm for managing social media affective information. Cognitive Computation, 2011, 3(3), 480–489 https://doi.org/10.1007/s12559-011-9101-8
25	ChenB W, HeX Y, JiW, RhoS, KungS Y. Support vector analysis of large-scale data based on kernels with iteratively increasing order. Journal of Supercomputing, 2016, 72(9): 3297–3311 https://doi.org/10.1007/s11227-015-1404-1
26	OlsherD J. Full spectrum opinion mining: integrating domain, syntactic and lexical knowledge. In: Proceedings of the 12th IEEE International Conference on Data Mining Workshops. 2012, 693–700 https://doi.org/10.1109/icdmw.2012.166
27	WuC H, LiangW B. Emotion recognition of affective speech based on multiple classifiers using acoustic-prosodic information and semantic labels. IEEE Transactions on Affective Computing, 2011, 2(1): 10–21 https://doi.org/10.1109/T-AFFC.2010.16
28	XieS S, LiuY. Using n-best lists and confusion networks for meeting summarization.IEEE Transactions on Audio, Speech, and Language Processing, 2011, 19(5), 1160–1169 https://doi.org/10.1109/TASL.2010.2082534
29	ChenB W, JiW. Intelligent marketing in smart cities: crowdsourced data for geo-conquesting. IT Professional, 2016, 18(4): 18–24 https://doi.org/10.1109/MITP.2016.64

[1]

FCS-0429-16190-YYO_suppl_1

Download

[1]	Ebuka IBEKE, Chenghua LIN, Adam WYNER, Mohamad Hardyman BARAWI. A unified latent variable model for contrastive opinion mining[J]. Front. Comput. Sci., 2020, 14(2): 404-416.
[2]	Rongrong JI,Donglin CAO,Yiyi ZHOU,Fuhai CHEN. Survey of visual sentiment prediction for social media analysis[J]. Front. Comput. Sci., 2016, 10(4): 602-611.
[3]	Wenge RONG,Baolin PENG,Yuanxin OUYANG,Chao LI,Zhang XIONG. Structural information aware deep semi-supervised recurrent neural network for sentiment analysis[J]. Front. Comput. Sci., 2015, 9(2): 171-184.
[4]	Zhiyuan LIU, Xinxiong CHEN, Maosong SUN. Mining the interests of Chinese microbloggers via keyword extraction[J]. Front Comput Sci, 2012, 6(1): 76-87.

Viewed

Full text

Abstract

Cited

Shared

Discussed