Nurul Lubis

Dr. Nurul Lubis

Universitätsstr. 1 Gebäude 25.12.01.34, Düsseldorf, Germany 40225
lubis [at] hhu [dot] de

Hello, I'm Nurul, a postdoctoral researcher with the Dialog Systems and Machine Learning Group at Heinrich Heine University Düsseldorf, Germany. My research centers around creating an intelligent Human-Computer Interaction that is adaptive and affect-sensitive. I've previously worked on learning a dialogue strategy to improve user's emotional state through a dialogue system interaction.

I'm currently working with Milica Gašić. During my master's and Ph.D. my supervisors were Satoshi Nakamura, Sakriani Sakti, and Koichiro Yoshino. In the past I have also worked with Graham Neubig, Randy Gomez, Dessi Lestari, and Ayu Purwarianti.

Education

Nara Institute of Science and Technology, Japan

Ph.D.

2017 - 2019
Information Science

M.Eng.

2015 - 2017
Information Science
GPA: 2.96/3.00

Institut Teknologi Bandung, Indonesia

B.Sc., cum laude

2010 - 2014
Informatics
GPA: 3.50/4.00

Projects and Experiences

Postdoctoral Researcher

Dialog Systems and Machine Learning

May 2019 - present
Towards intelligent dialogue systems

Project Researcher

SCOPE Project

October 2016 - 2018
End-to-end affective dialogue systems with awareness of emotional context

Intern Researcher

Honda Research Institute Japan

July - September 2015
Audio-visual emotion recognition in Japanese

Intern Researcher

Nara Institute Of Science and Technology

June - August 2013
Study of emotion and elicited emotion in spontaneous conversational data

Languages

Indonesian

Native

English

Proficient
TOEIC: 985/990, TOEFL:113/120

Japanese

Elementary
JLPT: N5 157/180

German

Elementary
A2
Honors and Awards

NAIST Best Student Award

Nara Institute of Science and Technology

March 2019

MEXT Scholarship

The Japanese Ministry of Education, Culture, Sports, Science and Technology

October 2014 - March 2019

TAF Travel Grant

The Technological Advancement Foundation

April 2017

Best-Rated Poster Presentation Award

IEEE Spoken Language Technology Committee

December 2014, South Lake Tahoe, United States of America

Best Student Paper Award

International Committee for the Co-ordination and Standardization of Speech Databases and Assessment Techniques

October 2014, Phuket, Thailand

JASSO Scholarship

Japan Student Services Organization

June - August 2013

Bank Indonesia Scholarship

Bank Indonesia

July 2007 - June 2010

Published Works

Journals

Nurul Lubis, Sakriani Sakti, Koichiro Yoshino, and Satoshi Nakamura. "Positive Emotion Elicitation in Chat-Based Dialogue Systems." IEEE/ACM Transactions on Audio, Speech and Language Processing, Volume: 27, Issue: 4, Pp 866-877, April 2019. (PDF)

Nurul Lubis, Dessi Lestari, Sakriani Sakti, Ayu Purwarianti, and Satoshi Nakamura. "Construction of Spontaneous Emotion Corpus from Indonesian TV Talk Shows and Its Application on Multimodal Emotion Recognition." Transactions on Information and Systems, Institute of Electronics, Information and Communication Engineers (IEICE) Vol.E101-D No.8, pp.2092-2100, August 2018. (PDF)

Nurul Lubis, Sakriani Sakti, Koichiro Yoshino, and Satoshi Nakamura. "Emotional Triggers and Responses in Spontaneous Affective Interaction: Recognition, Prediction, and Analysis." Transactions of the Japanese Society for Artificial Intelligence 33, no. 1 (2018): DSH-D_1-10. (PDF)

International Conferences

Nurul Lubis, Sakriani Sakti, Koichiro Yoshino, Satoshi Nakamura. "Dialogue Model and Response Generation for Emotion Improvement Elicitation." Proceedings of the 3rd Conversational AI Workshop. 2019. (to appear)

Nurul Lubis, Sakriani Sakti, Koichiro Yoshino, Satoshi Nakamura. "Optimizing Neural Response Generator with Emotional Impact Information." Proceedings of 2018 IEEE Spoken Language Technology Workshop (SLT). IEEE, 2018. (HTML)

Nurul Lubis, Sakriani Sakti, Koichiro Yoshino, Satoshi Nakamura. "Unsupervised Counselor Dialogue Clustering for Positive Emotion Elicitation in Neural Dialogue System." Proceedings of the 19th Annual Meeting of the Special Interest Group on Discourse and Dialogue (SIGDIAL). 2018. (PDF)

Nurul Lubis, Sakriani Sakti, Koichiro Yoshino, Satoshi Nakamura. "Eliciting Positive Emotion through Affect-Sensitive Dialogue Response Generation: A Neural Network Approach." Proceedings of the Thirty-Second AAAI Conference on Artificial Intelligence (AAAI-18). Association for the Advancement of Artificial Intelligence (AAAI), 2018. (PDF)

Nurul Lubis, Michael Heck, Sakriani Sakti, Koichiro Yoshino, Satoshi Nakamura. "Processing Negative Emotions Through Social Communication: Multimodal Database Construction and Analysis." Proceedings of the Seventh International Conference on Affective Computing and Intelligent Interaction (ACII2017). Association for the Advancement of Affective Computing (AAAC), 2017. (HTML)

Nurul Lubis, Sakriani Sakti, Koichiro Yoshino, Satoshi Nakamura. "Eliciting Positive Emotional Impact in Dialogue Response Selection." Proceedings of the International Workshop on Spoken Dialog System Technology (IWSDS), 2017. (PDF)

Nurul Lubis, Randy Gomez, Sakriani Sakti, Keisuke Nakamura, Koichiro Yoshino, Satoshi Nakamura, Kazuhiro Nakadai. "Construction of Japanese Audio-Visual Emotion Database and Its Application in Emotion Recognition." Proceedings of the Tenth International Conference on Language Resources and Evaluation (LREC 2016). European Language Resources Association (ELRA), 2016. (PDF)

Nurul Lubis, Sakriani Sakti, Graham Neubig, Tomoki Toda, Ayu Purwarianti, and Satoshi Nakamura. "Emotion and Its Triggers in Human Spoken Dialogue: Recognition and Analysis." Situated Dialog in Speech-Based Human-Computer Interaction. Springer International Publishing, 2016. (PDF)

Nurul Lubis, Sakriani Sakti, Graham Neubig, Koichiro Yoshino, Tomoki Toda, Satoshi Nakamura. "A Study of Social-Affective Communication: Automatic Prediction of Emotion Triggers and Responses in Television Talk Shows." Proceedings of ASRU 2015. IEEE, 2015. (PDF)

Nurul Lubis, Sakriani Sakti, Graham Neubig, Tomoki Toda, and Satoshi Nakamura. "Construction and Analysis of Social-Affective Interaction Corpus in English and Indonesian." Proceedings of the 18th Oriental Chapter of the International Committee for the Co-ordination and Standardization of Speech Databases and Assessment Techniques (COCOSDA), 2015. (HTML)

Nurul Lubis, Dessi Lestari, Ayu Purwarianti, Sakriani Sakti, and Satoshi Nakamura. "Emotion Recognition on Indonesian Television Talk Shows." Proceedings of Spoken Language Technology Workshop (SLT) 2014. IEEE, 2014. (HTML)

Nurul Lubis, Dessi Lestari, Ayu Purwarianti, Sakriani Sakti, and Satoshi Nakamura. "Construction and analysis of Indonesian emotional speech corpus." Proceedings of the 17th Oriental Chapter of the International Committee for the Co-ordination and Standardization of Speech Databases and Assessment Techniques (COCOSDA), 2014. IEEE, 2014. (HTML)

Technical Reports

Nurul Lubis, Michael Heck, Sakriani Sakti, Koichiro Yoshino, Satoshi Nakamura. "Multimodal Database of Negative Emotion Recovery in Dyadic Interactions: Construction and Analysis." ASJ, Sep, 2018.

Nurul Lubis, Sakriani Sakti, Koichiro Yoshino, Satoshi Nakamura. "Positive Emotion Elicitation in an Example-Based Dialogue System." SIG-SLP, Feb, 2018.

Nurul Lubis, Sakriani Sakti, Koichiro Yoshino, Satoshi Nakamura. "Dialogue Modeling for Eliciting Positive Emotion." ASJ, pp. 7 - 8, Mar, 2016.

Nurul Lubis, Randy Gomez, Sakriani Sakti, Keisuke Nakamura, Koichiro Yoshino, Satoshi Nakamura, and Kazuhiro Nakadai. "Constructing a Japanese Multimodal Corpus From Emotional Monologues and Dialogues." IEICE-SP, Dec, 2016.

Nurul Lubis, Sakriani Sakti, Graham Neubig, Koichiro Yoshino, Satoshi Nakamura. "Predicting Emotional Responses from Spontaneous Social-Affective Interaction Data." ASJ, pp. 7 - 8, Mar, 2016.

Nurul Lubis, Sakriani Sakti, Graham Neubig, Tomoki Toda, Dessi Lestari, Ayu Purwarianti, and Satoshi Nakamura. "Recognition and Analysis of Emotion in Indonesian Conversational Speech." SLP, 2014-SLP-104(1), pp. 1-6. 2014

Theses and Dissertation

Doctoral

Nurul Lubis. "Eliciting Emotion Improvements with Chat-based Dialogue Systems." 2019.

Master

Nurul Lubis. "Study of Social-Affective Communication: Emotion Recognition, Emotional Triggers Prediction, and Dialogue Response Selection." 2017.

Bachelor

Nurul Lubis. "Speech-based Emotion Recognition in Indonesian." 2014.

Nurul Lubis © 2019