Multimodal literacy, or the capability to critically produce, interpret and interact with the various forms of semiotic resources, has become one of the essential skills in contemporary discourse practice. Employing Multimodal Discourse Analysis and the Engagement System of Appraisal, this article discusses how the engagement choices used in popular Japanese TV commercials have constructed certain axiological positions, how they convince and motivate the audience, and how they reflect dominant ideologies in a given society. The findings reveal three dimensions of engagement choices: viewer alignment, dialogic engagement and reflection of ideologies. The study also offers an analytical framework of voice system, in examining the dialogic engagement and the mechanisms of how the socio-cultural ideologies such as beliefs, values and expectations are reflected in advertising discourse.
BakhtinMM (1981) The Dialogic Imagination: Four Essays, ed. HolquistM, trans. EmersonCHolquistM. Austin: University of Texas Press.
2.
BaldryAP (2004) Phase and transition, type and instance: Patterns in media texts as seen through a multimodal concordance. In: O’HalloranKL (ed.) Multimodal Discourse Analysis: Systemic-Functional Perspectives. London: Continuum, 83–108.
3.
BaldryAPThibaultPJ (2006) Multimodal Transcription and Text Analysis: A Multimedia Toolkit and Coursebook. London: Equinox.
4.
BarthesR (1967) Elements of Semiology, trans. LaversASmithC. London: Cape.
5.
BarthesR (1977) Rhetoric of the image. In: BarthesR (ed.) and HeathS (trans.) Image Music Text. London: Fontana, 32–51.
6.
BarthesR (1987[1957]) Mythologies. New York: Hill & Wang.
7.
BasilMD (1996) Identification as a mediator of celebrity effects. Journal of Broadcasting & Electronic Media40(4): 478–495. DOI: 10.1080/08838159609364370.
8.
BatemanJDelinJ (2006) Rhetorical structure theory. In: BrownK (ed.) Encyclopedia of Language and Linguistics, Vol. 10. Oxford: Elsevier, 589–597.
9.
BatemanJA (2013) Hallidayan systemic-functional semiotics and the analysis of the moving audiovisual image. Text & Talk33(4/5): 641–663.
10.
BatemanJA (2014) Text and Image: A Critical Introduction to the Visual/Verbal Divide. London: Routledge.
11.
BeasleyRDanesiM (2002) Persuasive Signs: The Semiotics of Advertising. Berlin: De Gruyter.
12.
BelkRWBryceWJ (1986) Materialism and individual determinism in U.S. and Japanese television advertising. In: LutzRJ (ed.) Advances in Consumer Research. Provo, UT: Association for Consumer Research, 568–572.
13.
BelkRWPollayRW (1985a) Advertising themes and cultural values: A comparison of U.S. and Japanese advertising. In: MunKCChanTC (eds) Proceedings of the Inaugural Meeting of the Southeast Region. Hong Kong: Academy of International Business, 11–20.
14.
BelkRWPollayRW (1985b) Materialism and status appeals in Japanese and U.S. print advertising: A historical and cross-cultural content analysis. International Marketing Review2(12): 38–47.
15.
BellS (1990) Semiotics and advertising research: A case study. Marketing Signs8: 1–6.
16.
BoothWC (1961) The Rhetoric of Fiction. Chicago: Chicago University Press.
17.
ChanKChengH (2002) One country, two systems: Cultural values reflected in Chinese and Hong Kong television commercials. Gazette: The International Journal for Communication Studies64(4): 385–400.
18.
ChatmanS (1978) Story and Discourse. Ithaca, NY: Cornell University Press.
19.
ChenY (2010) Exploring dialogic engagement with readers in multimodal EFL textbooks in China. Visual Communication9(4): 485–506.
20.
ChengHPatwardhanP (2010) One region, two worlds? Cultural values in Chinese and Indian TV commercials. Asian Journal of Communication20(1): 69–89.
21.
ChengHSchweitzerJC (1996) Cultural values reflected in Chinese and US television commercials. Journal of Advertising Research36(3): 27–45.
22.
CookG (1992[2001]) The Discourse of Advertising. London: Routledge.
23.
DashAKPatnaikPSuarD (2016) A multimodal discourse analysis of glocalization and cultural identity in three Indian TV commercials. Discourse & Communication10(3): 209–234.
24.
De SaussureF (1986) Course in General Linguistics, ed. BallyC, et al., trans. HarrisR. La Salle, IL: Open Court.
25.
DumasAA (1988) Cross-cultural analysis of people’s interpretation of advertising visual clichés. MA thesis, Annenberg School for Communication, University of Pennsylvania.
26.
FaircloughN (1992) Discourse and Social Change. Cambridge: Polity Press.
27.
FengDWignellP (2011) Intertextual voices and engagement in TV advertisements. Visual Communication10(4): 565–588. DOI: 10.1177/1470357211415788.
HallidayMAK (1978) Language as Social Semiotic: The Social Interpretation of Language and Meaning. Baltimore, MD: University Park Press.
31.
HallidayMAK (1989[1985]) Part A. In: HallidayMAKHasanR (eds) Language, Context, and Text: Aspects of Language in a Social-Semiotic Perspective. Oxford: Oxford University Press, 3–48.
32.
HallidayMAK (1994) An Introduction to Functional Grammar, 2nd edn.London: Edward Arnold.
33.
HallidayMAK (2002[1992]) How do you mean? In: WebsterJJ (ed.) On Grammar: Collected Works of MAK Halliday, Vol. 1. London: Continuum, 352‒368.
34.
HallidayMAKHasanR (1985) Language, Context and Text: Aspects of Language in Social-Semiotic Perspective. Geelong: Deakin University Press.
35.
HallidayMAKMatthiessenCMIM (2004) An Introduction to Functional Grammar, 3rd edn.London: Edward Arnold.
36.
HarrisRJ (ed.) (1983) Information Processing Research in Advertising. Hillsdale, NJ: Erlbaum.
37.
HunstonS (2011) Corpus Approaches to Evaluation: Phraseology and Evaluative Language. New York: Routledge.
IedemaR (2003) Multimodality, resemiotisation: Extending the analysis of discourse as multi-semiotic practice. Visual Communication2(1): 29–57. DOI: 10.1177/1470357203002001751.
40.
JewittC (2014) Multimodal approaches. In: NorrisSMaierCD (eds) Interactions, Images and Texts: A Reader in Multimodality. Boston, MA: De Gruyter, 127–136.
41.
JewittCKressG (eds) (2003) Multimodal Literacy. New York: Peter Lang.
KressG (2003) Literacy in the New Media Age. London: Routledge.
44.
KressGVan LeeuwenT (1996[2006]) Reading Images: The Grammar of Visual Design. London: Routledge.
45.
LimFV (2011) A systemic functional multimodal discourse analysis approach to pedagogic discourse. Doctoral thesis, National University of Singapore.
46.
LimFVO’HalloranKL (2012) The ideal teacher: An analysis of a teacher-recruitment advertisement. Semiotica189: 229–253. DOI: 10.1515/sem-2012-0032.
47.
LinCA (1993) Cultural differences in message strategies: A comparison between American and Japanese TV commercials. Journal of Advertising Research33(3): 40–48.
48.
LinCA (2001) Cultural values reflected in Chinese and American television advertising. Journal of Advertising30(4): 83–94.
49.
LinCASalwenMB (1995) Product information strategies of American and Japanese television advertisements. International Journal of Advertising14(1): 55–64.
50.
MartinJRRoseD (2007[2003]) Working with Discourse: Meaning beyond the Clause. London: Continuum.
51.
MartinJRWhitePRR (2005) The Language of Evaluation: Appraisal in English. New York: Palgrave Macmillan.
52.
MessarisP (1997) Visual Persuasion: The Role of Images in Advertising. London: Sage.
53.
MuellerB (1992) Standardization vs. specification: An examination of Westernization in Japanese advertising. Journal of Advertising Research32(1): 15–24.
54.
NorrisSMaierCD (2014) Interactions, images and texts: A reader in multimodality. Boston, MA: De Gruyter.
O’HalloranKLLimFV (2014) Systemic functional multimodal discourse analysis. In: NorrisSMaierC (eds) Texts, Images and Interactions: A Reader in Multimodality. Berlin: De Gruyter, 137–154.
58.
O’HalloranKLSmithBA (eds) (2011) Multimodal Studies: Exploring Issues and Domains. New York: Routledge.
59.
O’SullivanT, et al. (1983) Key Concepts in Communication. London: Methuen.
60.
PatemanT (1983) How is understanding an advertisement possible? In: DavisHWaltonP (eds) Language Image Media. Oxford: Blackwell, 187–204.
61.
RamaprasadJHasegawaK (1992) Informational content of American and Japanese television commercials. Journalism Quarterly69(3): 612–622.
62.
SchmidtR, et al. (1994) Suggestions to buy: Television commercials from the US, Japan, China and Korea. In: GassSNeuJ (eds) Speech Acts across Cultures. Berlin: De Gruyter, 285–316.
63.
SinclairJ (1987) Images Incorporated: Advertising as Industry and Ideology. Beckenham: Croom Helm.
64.
TakahashiY (1982) テレビ・コマーシャルの構造分析-言語メッセージと映像メッセージについてー (Structural analysis of television commercials: linguistic and visual messages). 映像学 (Journal of Image Arts and Science) 23: 36–49.
65.
ThibaultP (2000) The multimodal transcription of a television advertisement: Theory and practice. In: BaldryA (ed.) Multimodality and Multimediality in the Distance Learning Age. Campobasso: Palladino Editore, 311–385.
66.
ThomsonEANagisaFWhitePRR (2008) Evaluating ‘reporter’ voice in two Japanese front page lead stories. In: ThomsonEAWhitePRR (eds) Communicating Conflict: Multilingual Case Studies of the News Media. London: Continuum, 65–96.
67.
TuanLT (2010) Metaphors in advertising discourse. Studies in Literature and Language1(6): 75–81.
68.
UnsworthL (2006) Towards a metalanguage for multiliteracies education: Describing the meaning-making resources of language-image interaction. English Teaching: Practice and Critique5(1): 55–76.
69.
Van LeeuwenT (2005) Introducing Social Semiotics. New York: Routledge.
70.
Van MulkenMVan Enschot-Van DijkRHoekenH (2005) Puns, relevance and appreciation in advertisements. Journal of Pragmatics37(5): 707–721.
