In this study, we investigate syntactic and prosodic features of the speaker's speech at points where turn-taking and backchannels occur, on the basis of our analysis of Japanese spontaneous dialogs. Specifically, we focus on features such as part of speech, duration, F0 contour pattern, relative height of the peak F0, energy trajectory pattern, and relative height of the peak energy at the final part of speech segments. We examine, first, the relationship between turn-taking/backchannels and each feature of speech segments independently, showing that the features examined in this study are all related to turn-taking or backchannels and that the way they correlate is fairly consistent with previous studies. Next, we explore the inter-relationship among the features with respect to turn-taking and backchannels. We show that in both turn-taking and backchannels, (I) some instances of syntactic features make extremely strong contributions, and (2) in general, syntax has a stronger contribution than any individual prosodic feature, although the whole prosody contributes as strongly as, or even more strongly than, syntax. We also discuss some implications of our results, comparing them with previous models that have mentioned roles of syntax and prosody in turn-taking and backchannels.
ANDERSON, A. H., BADER, M., BARD, E. G., DOHERTY, G., GARROD, S., ISARD, S., KOWTKO, J., MCALLISTER, J., MILLER, J., SOTILLO, C., THOMPSON, H., & WEINERT, R. (1991). The HCRC Map Task Corpus. Language and Speech, 34, 351–366.
2.
AONO, M., ICHIKAWA, A., KOISO, H., SATOH, S., NAKA, M., TUTIYA, S., YAGI, K., WATANABE, N., ISHIZAKI, M., OKADA, M., SUZUKI, H., NAKANO, Y., & NONAKA, K. (1994). The Japanese Map Task Corpus: An interim report (in Japanese). In Spoken language understanding and discourse processing (Research Notes No. SIG-SLUD-9402, pp. 25–30). Japanese Society for Artificial Intelligence.
3.
AUER, P. (1996). On the prosody and syntax of turn-continuations. In E. Couper-Kuhlen & M. Selting (Eds.), Prosody in conversation (pp. 57–100). Cambridge, U.K.: Cambridge University Press.
4.
BALL, P. (1975). Listener's response to filled pauses in relation to floor apportionment. British Journal of Social and Clinical Psychology, 14, 423–424.
5.
BEATTIE, G. (1983). Talk: An analysis of speech and nonverbal behavior in conversation. Milton Keynes, U.K.: Open University Press.
6.
BROWN, G. (1977). Listening to spoken English. New York: Longman.
7.
CAMPBELL, N. (1996). Autolabclling Japanese ToBI. In Proceedings of the fourth International Conference on Spoken Language Processing (pp. 2399-2402). Philadelphia.
8.
CARLETTA, J., ISARD, A., ISARD, S., KOWTKO, J. C., DOHERTY-SNEDDON, G., & ANDERSON, A. H. (1997). The reliability of a dialog structure coding scheme. Computational Linguistics, 23, 13–31.
9.
DUNCAN Jr., S., & FISKE, D. W. (1977). Face-to-face interaction: Research, methods, and theory. Hillsdale, NJ: Lawrence Erlbaum.
10.
EDELSKY, C. (1981). Who's got the floor. Language in Society, 10, 383–421.
11.
FORD, C. E., & THOMPSON, S. A. (1996). Interactional units in conversation: Syntactic, intonational, and pragmatic resources for the management of turns. In E. Ochs, E. A. Schegloff, & S. A. Thompson (Eds.), Interaction and grammar (pp. 134–184). Cambridge, U.K.: Cambridge University Press.
12.
GOODWIN, C. (1981). Conversational organization: Interaction between speakers and hearers. New York: Academic Press.
13.
HARUNO, M., SHIRAI, S., & OOYAMA, Y. (1998). Using decision trees to construct a practical parser. In Proceedings of the 17th International Conference on Computational Linguistics and the 36th Annual Meeting of the Association for Computational Linguistics (pp. 505-511). Montréal.
14.
HAYASHI, C., DIDAY, E., JAMBU, M., & OHSUMI, N. (1988). Recent development in clustering and data analysis. New York: Academic Press.
15.
HINDS, J. (1978). Conversational structure: An investigation based on Japanese interview discourse. In J. Hinds & I. Howard (Eds.), Problems in Japanese syntax and semantics (pp. 79–121). Tokyo: Kaitakusha.
16.
HIRSCHBERG, J., & NAKATANI, C. H. (1996). A prosodic analysis of discourse segments in direction-giving monologues. In Proceedings of the 34th Annual Meeting of the Association for Computational Linguistics (pp. 286-293). Santa Cruz.
17.
IMAISHI, S. (1994). The use of aizuchi in natural Japanese discourse (in Japanese.)Nihongakuho, 13, 107–121. Osaka University, Japan.
18.
INOUE, H. (1997). Sociality in intonation (in Japanese). In T. Kunihiro, H. Hirose, & M. Kohno (Eds.), Accent, intonation, rhythm, and pause (pp. 169–202). Tokyo: Sanseido.
19.
KOOPMANS-van BEINUM, F. J., & van DONZEL, M. E. (1996.) Relationship between discourse structure and dynamic speech rate. In Proceedings of the fourth International Conference on Spoken Language Processing (pp. 1724-1727). Philadelphia.
20.
KOORI, S. (1996). Studies on sentence in the view of characteristics of a phonetic sound (in Japanese). Nihongogaku, 15, 60–70.
21.
KOORI, S. (1997). Intonation in Japanese—its form and function (in Japanese). In T. Kunihiro, H. Hirose, & M. Kohno (Eds.), Accent, intonation, rhythm, and pause (pp. 143–168). Tokyo: Sanseido.
22.
MAYNARD, S. (1986). On back-channel behavior in Japanese and English casual conversation. Linguistics, 24, 1079–1108.
23.
MAYNARD, S. (1989). Japanese conversation: Self contextualization through structure and interactional management. Norwood, NJ: Ablex Publishing Corporation.
24.
MIZUTANI, N. (1988). Discussion on backchannels (in Japanese). Nihongogaku, 7, 4–11.
25.
NAKAJIMA, S., & TSUKADA, H. (1997). Prosodic features of utterances in task-oriented dialogues. In Y. Sagisaka, N. Campbell, & N. Higuchi (Eds.), Computing prosody: Computational models for processing spontaneous speech (pp. 81–93). New York: Springer-Verlag.
26.
NAKANO, Y. I., NAKA, M., HORIUCHI, Y., YOSHINO, A., TUTIYA, S., ICHIKAWA, A., ISHIZAKI, M., OKADA, M., KOISO, H., & SUZUKI, H. (1997). Basic statistics of the Japanese Map Task Corpus (1) (in Japanese.) In Spoken language understanding and discourse processing (Research Notes No. SIG-SLUD-9701, pp. 19–24). Japanese Society for Artificial Intelligence.
27.
ORESTRÖM, B. (1983). Turn-taking in English conversation. Lund: CWK Gleerup.
28.
PIERREHUMBERT, J. B., & HIRSCHBERG, J. (1990). The meaning of intonational contours in the interpretation of discourse. In O. R. Cohen, J. Morgan, & M. E. Pollack (Eds.), Intentions in communication (pp. 271–311). Cambridge, MA: MIT Press.
29.
QUINLAN, R. J. (1992). C4.5: Programs for machine learning. San Mateo, CA: Morgan Kaufmann.
30.
SACKS, H., SCHEGLOFF, E. A., & JEFFERSON, G. (1974). A simplest systematics for the organization of turn-taking for conversation. Language, 50, 696–735.
31.
SCHEGLOFF, E. (1982). Discourse as an interactional achievement: Some use of “UH-HUH” and other things that come between sentences. In D. Tannen (Ed.), Analyzing discourse: Text and talk (pp. 71–93). Washington, DC. Georgetown University Press.
32.
SCHEGLOFF, E. A. (1996). Turn organization: One intersection of grammar and interaction. In E. Ochs, E. A. Schegloff, & S. A. Thompson (Eds.), Interaction and grammar (pp. 52–133). Cambridge, U.K.: Cambridge University Press.
33.
SUGITO, M. (1989). Pause and intonation in discourse (in Japanese). In Sugito, et al. (Eds.), Japanese and the education of Japanese (pp. 343–364). Tokyo: Meijishoin.
34.
THE NATIONAL LANGUAGE RESEARCH INSTITUTE. (1960.) A research for making sentence patterns in colloquial Japanese (I): On materials in conversation. Tokyo: Shuuei Shuppan.
35.
WARD, N. (1996). Using prosodic clues to decide when to produce back-channel utterances. In Proceedings of the fourth International Conference on Spoken Language Processing (pp. 1728-1731). Philadelphia.
36.
WIGHTMAN, C. W., & OSTENDORF, M. (1994). Automatic labeling of prosodic patterns. IEEE Transactions on Speech and Audio Processing, 2, 469–481.
37.
YNGVE, V. H. (1970). On getting a word in edgewise. In the Proceedings of the Sixth Regional Meeting of the Chicago Linguistics Society (pp. 567-577). Chicago.
