(Continuation of "Computers & Language Learning: An Overview")

Intelligent CALL

Those who hope for "Intelligent CALL," by and large, do not feel that a piece of software can be intelligent in the same way as a human being. Rather, the idea is to have software that uses the power of the computer to offer easy interaction with the material to be learned, including meaningful feedback and guidance; comprehensible information in multiple media designed to fit the learning style of individual students; and ways for students to carry communication beyond an individual computer screen.

In our information-rich time, having a way to navigate and manage all of the facts at our fingertips is essential. In the computer arena, "user interface"--the way software is written so that people will understand what to do with it--is a perennial concern. While much has been made of the graphical user interface of the Macintosh and Windows, replacing text with graphical objects (icons) is not enough to make software intelligible, much less intelligent. The best new business software offers users help at every step; good CALL software should do no less.

Learners need help with more than the mechanics of operating a software program. They also need to know how to make the best use of it for their own purposes. Research has indicated that learners don't always know how to fit new information into an appropriate framework (Dole, et al., 1991; Gay, 1987; Van Dijk & Kintsch, 1983), so intelligent software has to give them context as well as data. CALL programs that respond to user input with nothing more than "Right" and "Wrong, try again" are clearly less helpful, thus less "intelligent" in these terms than they should be. Far better is software that tracks learner answers and looks for patterns, responding not only with whether the answer was correct but also why it was right or wrong and offering suggestions for further study--going on to a more advanced level or doing some extra work at the current or a previous level.

Learners also often fall short in their ability to apply appropriate learning strategies to material (Oxford, 1990; Healey, 1993; Rubin, 1987), so intelligent software should be able to take naive learners in hand and help them along in figuring out how to use the software effectively, as a teacher would. This does not mean that learners give up all control over their path and rate through material. Quite a bit of research has explored the idea of learner vs. computer control in computer-assisted instruction (Gay, 1987; Robinson, 1989; Johanesen, K.J. & Tennyson, R.D., 1983; Schaeffer, R.H., 1981; inter alia). The general view is that learners, especially adults, feel better when they have a sense of control over the program. The most dictatorial programs are those that do not let the learner quit when he or she is ready to do so. The most flexible give learners the choice of what to do, when to do it, and for how long. Guided freedom would be a feature of intelligent CALL, where the program would make suggestions, but the learner would make the choices.

Another direction in current software is the integration of media. As computer storage and memory prices have dropped, software developers have been able to add in graphics, sound, animation, and video clips. Foreign language teachers are particularly helped by access to a variety of media to help make the language come alive to students for whom it is largely a distant abstraction. This trend can only accelerate, with faster and more powerful computers making longer video and sound clips practical. Intelligent CALL will fit the medium to the learner, ensuring that the media work in concert to enhance understanding. Developers need to restrain the urge to add anything and everything just to make a fancy-looking product, and instead focus in on selecting media to fit pedagogy, not vice-versa (Kozma, 1991).

The expansion of digital media has meant more data for learners to create their own language hypotheses with. A vast amount of information is available electronically in text form via the Web (see http://www.sil.org/linguistics/etext.html for a place to start in electronic collections of texts), and more high quality collections of text for linguistic analysis than ever are available for sale from Cobuild, Oxford, Longman, and other vendors. While current concordancers work only on text, intelligent CALL will be able to use video concordancing to help clarify vocabulary and grammar usage. Teachers or learners can query the video concordancer with a word or phrase, and it will cue up video clips containing that word or phrase for playback. Prototype video concordancing exists now, fed by products that capture the output from closed caption decoders (Price & Imbier, 1993; Spanos & Smith, 1990).

Many current businesses, especially high-tech companies, use a team approach that encourages collaboration on projects. It could be said that business is just catching up to language teaching in this regard. The benefit to language teachers is that software developed to make business collaboration easier, such as Lotus Notes for Workgroups, can also be used to help students within a class share their ideas and writing more easily. With networked computers increasingly common, software publishers are encouraged to market products that take advantage of the interaction a network offers. For example, there is no reason software on CD-ROM or on disk should not also link to the Web in order to add current content to a writing or grammar lesson, or to let students e-mail their writing for others outside the class to read. Intelligent CALL will not be limited to its self-contained information or interaction with a single user, but will take advantage of local network and online possibilities for information retrieval.

John Underwood's "On the edge: Intelligent CALL in the 1990s" (1989) hoped for advances in artificial intelligence, hypermedia, and simulations to create new ways of approaching language teaching with computers. Natural language processing, or the computer's ability to extract something approaching meaning from text or speech, is one of the elements Underwood feels is essential to the intelligent tutoring systems, the hypermedia rich in helpful navigational aids, and the realistic interactive microworlds he describes. A computer able to parse a typed or spoken sentence and respond to it can allow learners much more flexibility in the types of activities they can do and get help with. In fact, a student using an intelligent tutoring system should be able to ask the computer for help in something approaching natural language rather than by choosing elements from a programmer-created menu. A system that could evaluate an answer and respond with guidance would be more more teacher-like than anything currently available.

The key to CALL software that responds intelligently to what the learner speaks or types is high-quality natural language processing. This has been one of the key areas within artificial intelligence research for years, and much progress has been made. However, substantial challenges must be overcome before the computer can make sense of learner input. Sells et al. (1991) point out that four related areas of study are involved in natural language processing:

(1) investigating the psychological processes involved in human language understanding;

(2) building computational systems for analyzing natural language input (and/or producing natural language output);

(3) developing theories of natural language structure; and

(4) determining the mathematical properties of grammar formalisms. (p. 1)

Bates, et al. (1993) are optimistic that natural language processing, at least where the topics are somewhat constrained and users are careful about how they interact with the computer, will be advanced enough within the next ten years to make a "revolutionary" impact on society. They feel that software systems will improve in three key areas: (1) "Knowledge acquisition from natural language (NL) texts of various kinds, from interaction with human beings, and from other sources" to create vary larger knowledge bases than those that currently exist (p. 1, italics in original); (2) "Interaction with multiple underlying systems" to make NL systems more flexible and user-friendly (p. 1; italics in original); and (3) Partial understanding gleaned from multi-sentence language, or from fragments of language" because human input is typically imperfect (p. 2; italics in original).

Microsoft has been working on a system called MindNet that they hope to ship in the next couple of years. This system would work with Microsoft Office and allow users to translate documents into different languages, create executive summaries of documents, and do more efficient searches for information in stored documents. Whether it will do what it claims or not, Microsoft's interest indicates that businesses see the goal of natural language processing as a realistic one.

Speech recognition has also made great advances in the last few years. Dragon System's Naturally Speaking and IBM's ViaVoice convert clear but continuous speech to text with an 80-90% accuracy rate. The higher accuracy rate comes after the programs have been "trained" by listening to the user speak about 250 key words. Previous programs required users to pause after each word, making the speech highly unnatural. Girard and Dillon (1997) estimate that 30% of business users will be taking advantage of text to speech products by the year 2001 as a result of current developments in the technology. Several programs for language teaching now incorporate speech recognition, including The Learning Company's Learn to Speak series; Triple Play Plus from Syracuse Language Systems; Courseware Publishing International's See It, Hear It, Say It; English Vocabulary; and Traci Talk; and Dynamic English from DynEd. These programs are not capable of dealing with freely generated speech, but rather recognize a correct multiple choice answer. By limiting the domain, the speech recognition program can work with a relatively broad range of accent and speech styles. By all indications, the use of speech recognition technology will improve and increase as time goes on and computers become faster and more able to do the complex calculations required of natural language processing.

Electronic conversations with the computer, popularized by Joseph Weizenbaum's Eliza program, will become more sophisticated with spoken as well as typed input. Current adventure games have made great strides in their ability to process natural language in typed form, with games like Myst leading the way in setting up more natural interactions between the user and the computer. To be more useful in a language teaching context, an intelligent CALL form of these games could let the learner choose to have the program evaluate and comment on his or her grammar and vocabulary, as well as respond to the content of what was said or typed.

While we're coming closer, advancing in all the areas mentioned above--user interface, learner feedback, integrated media, communication within and outside the classroom, and natural language processing--we've still got a very long way to go before CALL can be accurately called "intelligent." What teachers can do now, however, is to work with each other to improve teaching with technology. Linking via the Web, workshops, or conferences, teachers can encourage the intelligent use of CALL. That will be a very large step forward.

Conclusion

The role of computers in language teaching has changed significantly in the last 30 years. Previously, computers were used principally for drills and exercises. Technological and pedagogical developments now allow us to better integrate computer technology into the language learning process. Multimedia programs incorporating speech-recognition software can immerse students into rich environments for language practice. Concordancing software and large language corpora provide students' the means to investigate language use in authentic context. And the Internet allows for a myriad of opportunities to communicate in the target language, access textual and multimedia information, and publish for a global audience.

Future developments in networked communication, multimedia, and artificial intelligence will likely converge, creating a potentially more central role for the computer as a tool for authentic language exploration and use in the second language classroom. As our focus of attention gradually shifts from the computer itself to the natural integration of computers into the language learning process, we will know that computer technology has taken its rightful place as a important element of language learning and teaching.


Selected CALL Resources

Recent Books

Athelstan. (1997). Technology and language learning yearbook, vol. 8. Houston, TX: Athelstan.

Boswood, T. (1997). New ways of using computers in language teaching. Alexandria, VA: TESOL Publications.

Bush, M. (1996). Technology enhanced language learning. Lincolnwood, IL: National Textbook Company.

Debski, R., Gassin, J., & Smith, M. (Eds.). (1997). Language learning through social computing. Melbourne: Applied Linguistics Association of Australia.

Healey, D. (1995). Something to do on Tuesday. Houston: Athelstan.

Healey, D., & Johnson, N. (Eds.). (1997). 1997 TESOL CALL Interest Section software list. Alexandria, VA: TESOL Publications.

Levy, M. (1997). Computer-assisted language learning: context and conceptualization. Oxford: Oxford University Press.

Pennington, M. (Ed.) (1996). The power of CALL. Houston: Athelstan.

Sperling, D. (1997). The Internet guide for English language teachers. Upper Saddle River, NJ: Prentice Hall Regents.

Thompson, J, & Parsons, J. (1995). ReCALL software guide #4, 1995. Hull, UK: CIT Centre for Modern Languages, University of Hull.

Warschauer, M. (1995). E-Mail for English teaching. Alexandria, VA: TESOL Publications.

Warschauer, M. (Ed.) (1995). Telecollaboration in Foreign Language Learning. Honolulu, HI: University of Hawaii Second Language Teaching and Curriculum Center (University of Hawaii Press).

Warschauer, M. (Ed.) (1996). Virtual Connections: Online Activities and Projects for Networking Language Learners. Honolulu, HI: University of Hawaii Second Language Teaching and Curriculum Center (University of Hawaii Press).
 
 

Journals

CALICO Journal
The Computer Assisted Language Instruction Consortium
Southwest Texas State University
317 Liberal Arts
San Marcos, TX 78666
http://calico.org/

CÆLL (Computer-Assisted English Language Learning) Journal
1787 Agate St.,
Eugene OR 97403 U.S.A.
iste@oregon.uoregon.edu

http://www.iste.org/publish/caell.html

Computer Assisted Language Learning
P.O. Box 825
2160 SZ Lisse
The Netherlands
K.C.CAMERON@EXETER.AC.UK
http://www.swets.nl/sps/journals/call.html

Internet TESL Journal
http://www.aitech.ac.jp/~iteslj

Language Learning & Technology
http://polyglot.cal.msu.edu/llt

On-CALL
Language Centre
Bond University
Gold Coast
Queensland 4229
Australia
http://www.cltr.uq.oz.au:8000/oncall/ochome.htm

ReCALL Newsletter
http://www.cti.hull.ac.uk/pubs.htm#ReCALL Newsletter

SYSTEM
Elsevier Science Ltd, The Boulevard
Langford Lane
Kidlington, Oxford OX5 1 GB, UK

TESL-EJ
http://www-writing.berkeley.edu/TESL-EJ/

 

Organizations

ATELL (Australian Technology Enhanced Language Learning Consortium)
http://adhocalypse.arts.unimelb.edu.au/~atell/

CALICO (Computer Assisted Language Instruction Consortium)
Southwest Texas State University
317 Liberal Arts
San Marcos, TX 78666
http://calico.org/

EUROCALL
CTI Centre for Modern Languages
University of Hull
HULL HU6 7RX, UK
cti.lang@hull.ac.uk
http://www.cti.hull.ac.uk/eurocall.htm

JALT CALL N-SIG (Japan Association for Language Teaching CALL National Special Interest Group)

JALT Central Office

Urban Edge Building 5th Floor

1-37-9 Taito

Taito-ku, Tokyo 110 Japan
http://langue.hyper.chubu.ac.jp/jalt/

MUESLI (Micro Users in ESL Institutions)
c/o IATEFL
3 Kingsdown Park
Tankerton
Whitstable, Kent
England CT5 2DJ
http://www.man.ac.uk/IATEFL/

TESOL CALL Interest Section
c/o TESOL
1600 Cameron St., Suite 300
Alexandria VA 22314 U.S.A.
tesol@tesol.edu
http://www.tesol.edu

 

Internet Resources

CALL & TESOL Links
http://tiger.coe.missouri.edu/~cjw/call/links.htm

Dave's ESL Cafe on the Web
http://eslcafe.com/

ExCHANGE
http://deil.lang.uiuc.edu/exchange/

LLTI (Language Learning and Technology International)
http://thecity.sfsu.edu/~funweb/neteach.htm

NETEACH-L (Using the Internet for teaching ESL)
http://www.latrobe.edu.au/www/education/sl/sl.html

OPPortunities in English
http://darkwing.uoregon.edu/~leslieob

TESL-L (Teachers of English as a Second Language)
TESLCA-L (Computer-Assisted sub-branch of TESL-L)
listserv@cunyvm.cuny.edu
(send message subscribe tesl-l yourfirstname yourlastname)

International Student E-Mail Discussion Lists
Nine lists for ESL/EFL college and university students
http://www.latrobe.edu.au/www/education/sl/sl.html
 



References Abraham, R. & Liou, H-C. (1991). Interaction generated by three computer programs: analysis of functions of spoken language. In P. Dunkel (Ed.), Computer-assisted language learning and testing , 85-109. Rowley, MA: Newbury House.

Abraham, R. (1985). Field independence-dependence and the teaching of grammar. TESOL Quarterly, 20, 689-702.

Ahmad, K., Corbett, G., Rogers, M., & Sussex, R. (1985). Computers, language learning and language teaching. Cambridge: Cambridge University Press.

Al-Juhani, S.O. (1992). The effectiveness of computer-assisted instruction in teaching English as a foreign language in Saudi secondary school. Dissertation Abstracts International, A: The Humanities and Social Sciences, 52, 2383-A.

Athelstan. (1997). CALL bibliography. [Internet document] http://www.nol.net/~athel/athelbib.html. Accessed 10/20/97.

Bates, M., Borrow, R.J., & Weischedel, R.M. (1993). Critical challenges for natural language processing. In M. Bates and R.M. Weischedel (Eds.), Challenges in natural language processing (pp. 3-34). New York: Cambridge University Press.

Botiono, B.D. (1992). The effect of three feedback forms on learning through a computer-based tutorial. CALICO Journal, 10, 45-52.

Bowers, R. (1995). Web publishing for students of EST. In M. Warschauer (Ed.), Virtual connections: Online activities and projects for networking language learners , 363-364. Honolulu, Hawaii: University of Hawaii Second Language Teaching and Curriculum Center.

Brown, H.D. (1991). TESOL at twenty-five: what are the issues? TESOL Quarterly, 25, 245-260.

Bush, V. (1945). As we may think. Atlantic Monthly, July.

Castells, M. (1993). The informational economy and the new international division of labor. In M. Carnoy, M. Castells, S. S. Cohen, & F. H. Cardoso, The new global economy in the information age: Reflections on our changing world , 15-43. University Park, Pennsylvania: The Pennsylvania State University Press.

Castells, M. (1996). The rise of the network society. Malden, MA: Blackwell.

Chapelle, C. & Jamieson, J. (1986). Computer assisted language learning as a predictor of success in acquiring English as a second language. TESOL Quarterly, 20, 27-46.

Chapelle, C. & Jamieson, J. (1989). Research trends in computer-assisted language learning. In M. Pennington (Ed.), Teaching languages with computers , 45-59. La Jolla, CA: Athelstan.

Chapelle, C. & Jamieson, J. (1991). Internal and external validity issues in research on CALL effectiveness. In P. Dunkel (Ed.), Computer-assisted language learning and testing , 37-57). Rowley, MA: Newbury House.

Chapelle, C. & Mizuno, S. (1980, December). Student strategies with learner-controlled CALL. CALICO Journal, 25-47.

Chapelle, C. (1990). The discourse of computer-assisted language learning: toward a context for descriptive research. TESOL Quarterly, 24, 199-225.

Chapelle, C. (1995). A framework for the investigation of CALL as a context for SLA. CÆLL Journal, 6 (3), 2-8.

Chen, J.F. (1997). Computer generated error feedback and writing process: A link. TESL-EJ, 2 (3). [electronic document] Available at http://violet.berkeley.edu/~cwp/TESL-EJ/ej07/a1.html. Accessed 10/19/97.

Chun, D. (1994). Using computer networking to facilitate the acquisition of interactive competence. System, 22(1), 17-31.

Crookall, D. Coleman, D.W., & Versluis, E.B. (1990). Computerized language learning simulations: form and content. In D. Crookall & R.L. Oxford (Eds.), Simulation, gaming, and language learning , 165-182. New York: Newbury House.

Daiute, C. (1985). Writing and computers. Reading, MA: Addison-Wesley.

Dalgish, G.M. (1991). Computer-assisted error analysis and courseware design: Applications for ESL in a Swedish context. CALICO Journal, 9, 39-56.

De Felix, J.W., Johnson, R.T., & Schick, J.E. (1990). Socio- and psycholinguistic considerations in interactive video instruction for limited English proficient students. Computers in the Schools, 7 (12), 173-190.

Didio, L. (1997). Microsoft teaches PCs new languages. Computerworld, 31 (32), 55-56.

Dole, J.A., Duffy, G.G., Roehler, L.R., & Pearson, P.D. (1991). Moving from the old to the new: research on reading comprehension instruction. Review of Educational Research, 61, 239-264.

Dudley, A. (1995). Communicative CALL: Student interaction using non-EFL software. CÆLL Journal, 6 (3), 25-33.

Dunkel, P. (1991). Simulations and games in L2 learning. CÆLL Journal, 2 (2), 8-16.

Dziombak, C.E. (1991). Searching for collaboration in the ESL computer lab and the ESL classroom. Dissertation Abstracts International, A: The Humanities and Social Sciences, 51, 2296-A.

Englesberg, R. (1997). An evaluation study of a multimedia package for learning English. CÆLL Journal, 8 (1), 15-20.

Evans, M. (1993). Nicolas: Using HyperCard with intermediate-level French learners. System, 10, 213-229.

Feldman, M. (1995). Import/export e-mail business simulation. In M. Warschauer (Ed.), Virtual connections: online activities and projects for networking language learners , 216-217. Honolulu, Hawai'i: University of Hawai'i Second Language Teaching and Curriculum Center.

Gaer, S. (1995). Folktales around the world. In M. Warschauer (Ed.), Virtual connections: online activities and projects for networking language learners , 146-148. Honolulu, HI: University of Hawai'i Second Language Teaching and Curriculum Center.

Gay, G. (1987). Interaction of learner control and prior understanding in computer-assisted video instruction. Journal of Educational Psychology, 78, 225-227.

Girard, K. & Dillon, N. (1997). Market grows for voice applications. Computerworld, 31(32), 55-56.

Grimes, T. (1990). Audio-video correspondence and its role in attention and memory. Educational Technology Research & Development, 38 (3), 15-25.

Healey, D. (1993). Learner choices in self-directed second language learning. Ann Arbor, MI: UMI Dissertation Services.

Higgins, J. (1997). CALL: A bibliography. [Internet document]. http://www.stir.ac.uk/Departments/HumanSciences/EPD/celt/staff/higdox/callbib.htm. Accessed 10/20/97.

Hsu, J.J., Chapelle, C., & Thompson, A.D. (1993). Exploratory learning environments: what are they and do students explore? Journal of Educational Computing Research, 9, 1-15.

Johanesen, K.J. & Tennyson, R.D. (1983). Effect of adaptive advisement on perception in learner-controlled, computer-based instruction using a rule-learning task. Educational Communication and Technology, 31, 226-236.

Johanesen, K.J. & Tennyson, R.D. (1983). Effect of adaptive advisement on perception in learer-controlled, computer-based instruction using a rule-learning task. Educational Communication and Technology, 31, 226-236.

Johns, T. & King, P. (Eds.) (1991). Classroom concordancing. ELT Journal 4, 27-45.

Jones, C. (1986). Itís not so much the program, more what you do with it: the importance of methodology in CALL. System, 14, 171-178.

Jones, C., & Fortescue, S. (1987). Using computers in the language classroom. London: Longman.

Kelm, O. (1992). The use of synchronous computer networks in second language instruction: A Preliminary Report. Foreign Language Annals, 25(5), 441-454g

Kelm, O. (1995). E-mail discussion groups in foreign language education: Grammar follow-up. In M. Warschauer (Ed.), Telecollaboration in foreign language learning: Proceedings of the Hawai'i symposium , Honolulu, HI: University of Hawai'i, Second Language Teaching and Curriculum Center.

Kendall, C. (1995). Cyber-surveys. In M. Warschauer (Ed.), Virtual connections: Online activities and projects for networking language learners , 97-100. Honolulu, HI: University of Hawai'i, Second language teaching and curriculum center.

Kenning, M.-M., & Kenning, M. J. (1990). Computers and language learning: current theory and practice. New York: Ellis Horwood.

Kern, R. (1995). Restructuring classroom interaction with networked computers: Effects on quantity and quality of language production. Modern Language Journal, 79(4), 457-476.

Kleinmann, H.H. (1987). The effect of computer-assisted instruction on ESL reading achievement. Modern Language Journal, 71, 267-276.

Kozma, R.B. (1991). Learning with media. Review of Educational Research, 61, 179-211.

Levy, M. & Hinckfuss, J. (1990). Program design and student talk. CÆLL Journal, 1 (4), 21-26.

Li, R.-C. (1995). English as a second language home page. In M. Warschauer (Ed.), Virtual connections: online activities and projects for networking language learners , 349-350. Honolulu, Hawai'i: University of Hawai'i, Second Language Teaching and Curriculum Center.

Liu, M. (1992). The effect of hypermedia-assisted instruction on second language learning: a semantic-network-based approach. Dissertation Abstracts International, A: The Humanities and Social Sciences, 53, 1134-A.

Lixl-Purcell, A. (1995). German area studies on the net. In M. Warschauer (Ed.), Virtual connections: online activities and projects for networking language learners , 292-294. Honolulu, Hawai'i: University of Hawai'i, Second Language Teaching and Curriculum Center.

Meskill, C. (1993). ESL multimedia: a study of the dynamics of paired student discourse. System, 21, 323-341.

Murillo, D. (1991). Maximizing CALL effectiveness in the classroom. CÆLL Journal, 2 (2), 20-25.

Neu, J. & Scarcella, R. (1991). Word processing in the ESL classroom: a survey of student attitudes. In P. Dunkel (Ed.), Computer-assisted language learning and testing , 169-187. Rowley, MA: Newbury House.

Oxford, R.L. (1990). Language learning strategies: what every teacher should know. Boston: Heinle & Heinle.

Parks, C. (1994). Closed captioned TV: a resource for ESL literacy education. ERIC Digest. Washington, DC: Adjunct ERIC Clearinghouse for ESL Literacy Education. (ED372662)

Phillips, M. (1987). Communicative language learning and the microcomputer. London: British Council.

Phinney, M. (1991). Computer-assisted writing and writing apprehension in ESL students. In P. Dunkel (Ed.), Computer-assisted language learning and testing , 189-204. Rowley, MA: Newbury House.

Pinto, D. (1996). What does "schMOOze" mean?: non-native speaker interactions on the Internet. In M. Warschauer (Ed.), Telecollaboration in Foreign Language Learning: Proceedings of the Hawai'i symposium , 165-184. Honolulu, HI: University of Hawai'i, Second Language Teaching & Curriculum Center.

Price, K. & Imbier, E. (1993). A videodisc project for ESL: "Who should do the housework?" In J. Boettcher (Ed.), 101 success stories of information technology in higher education: The Joe Wyatt challenge. New York: McGraw-Hill, Inc. (also online at http://educom.edu/stories.101/Videodisc-Project-for-ESL.txt)

Pujol, M. (1995/96). ESL interactions around the computer. CÆLL Journal, 6(4), 2-11.

Robinson, G.L. (1989). The CLCCS CALL study: Methods, error feedback, attitudes, and achievement. In W.F. Smith (Ed.), Modern technology in foreign language education: Applications and projects. Lincolnwood, IL: National Textbook Company.

Robinson, G.L. (1989). The CLCCS CALL study: methods, error feedback, attitudes, and achievement. In W.F. Smith (Ed.), Modern technology in foreign language education: Applications and projects. Lincolnwood, IL: National Textbook Company.

Rosen, L. (1995). City net: travel the world from your desktop. In M. Warschauer (Ed.), Virtual connections: Online activities and projects for networking language learners , 308-309. Honolulu, HI: University of Hawai'i, Second Language Teaching and Curriculum Center.

Rubin, J. (1987). Learner strategies: theoretical assumption, research, history, and typology. In A. Wenden and J. Rubin (Eds.), Learner strategies in language learning (pp. 15-30). Englewood Cliffs, NJ: Prentice-Hall.

Schaeffer, R.H. (1981). Meaningful practice on the computer: Is it possible? Foreign Language Annals, 14 (2), 133-137.

Schcolnik, M., Kol, S., Abarbanel, J., Friedler, J., Heymans, Y., & Tsafrir, Y. (1995/96). Multimedia reference materials in advanced EFL courses: A project report. CÆLL Journal, 6(4), 34-38.

Sedgwick, R. (1997). Annotated bibliography of the effectiveness of CALL. [Internet document]. http://www.cltr.uq.oz.au:8000/interest/biblio.html. Accessed 10/20/97.

Sells, P., Shieber, S.M., & Wasow, T. (Eds.) (1991). Foundational issues in natural language processing. Cambridge, MA: MIT Press.

Sharp, S.K. & Liu, P. (1997a). Computer-assisted language learning bibliography [Internet document]. http://www.inform.umd.edu/EdRes/Colleges/ARHU/Depts/langctr/flit/biblio/bibliography.html. Accessed 10/20/97.

Soh, B.-L., & Soon, Y. P. (1991). English by e-mail: creating a global classroom via the medium of computer technology. ELT Journal, 45(4), 287-292.

Spanos, G., & Smith, J. (1990). Closed captioned television for adult LEP literacy learners. ERIC Digest. Washington, DC: National Clearinghouse for ESL Literacy Education. (ED 321 623)

Stenson, N., Downing, B., Smith, J. & Smith, K. (1992). The effectiveness of computer-assisted pronunciation training. CALICO Journal, 9 (4), 5-19.

Sullivan, N., & Pratt, E. (1996). A comparative study of two ESL writing environments: A computer-assisted classroom and a traditional oral classroom. System, 24(4), 491-501.

Tella, S. (1991). Introducing international communications networks and electronic mail into foreign language classrooms (Research report No. 95). Department of Teacher Education, University of Helsinki.

Tella, S. (1992a). Boys, girls and e-mail:aA case study in Finnish senior secondary schools. (Research report No. 110). Department of Teacher Education, University of Helsinki.

Tella, S. (1992b). Talking shop via e-mail: a thematic and linguistic analysis of electronic mail communication. (Research report No. 99). Department of teacher education, University of Helsinki.

Thaipakdee, S. (1992). Relationships among writing quality, attitudes toward writing, and attitudes toward computers in a computer-mediated technical writing class for English as a foreign language students. Dissertation Abstracts International, A: The Humanities and Social Sciences, 53, 1135-A.

Tribble, C. & Jones, C. (1990). Concordancing in the classroom. Harlow, Essex: Longman.

Tribble, C. (1990). Small scale corpora in ELT: an investigation into vocabulary use. CÆLL Journal, 1 (4), 13-20.

Underwood, J. (1984). Linguistics, computers, and the language teacher: a communicative approach. Rowley, MA: Newbury House.

Underwood, J. (1989). On the edge: intelligent CALL in the 1990s. Computers and the Humanities, 23 (1), 71-84.

Van Der Linden, E. (1993). Does feedback enhance computer-assisted language learning? Computers and Education, 21, 61-65.

Van Dijk, T.A. & Kintsch, W. (1983). Strategies of discourse comprehension. Orlando, FL: Academic Press.

Verano, M. (1989). USAFA interactive study in Spanish. In W.F. Smith (Ed.), Modern technology in foreign language instruction. Lincolnwood, IL: National Textbook Company.

Walker, B. (1994). EFL teachers' attitudes about CALL. CÆLL Journal, 5(3), 12-15.

Wang, X. (1993). A CAI tutorial: teaching the English simple past tense to native speakers of Chinese. Dissertation Abstracts International, 51, 2354-A - 2355-A.

Wang, Y. M. (1993). E-mail dialogue journaling in an ESL reading and writing classroom. Unpublished Ph.D. dissertation, University of Oregon at Eugene.

Warschauer, M. (1996a). Comparing face-to-face and electronic communication in the second language classroom. CALICO Journal, 13(2), 7-26.

Warschauer, M. (1996b). Computer-assisted language learning: an introduction. In S. Fotos (Ed.), Multimedia Language Teaching , 3-20. Tokyo: Logos.

Warschauer, M. (1997) Electronic literacies:lLanguage, culture, and power in online education. Unpublished doctoral dissertation, University of Hawai'i.

Warschauer, M. (Ed.) (1995). Virtual connections: Online activities and projects for networking language learners. Honolulu, HI: University of Hawai'i, Second Language Teaching and Curriculum Center.