RESEARCH

SAMPLES

PAPERS

PEOPLE

HOME
 
 

Acknowledgements

This work was conducted under the auspices of DARPA agrant DAA-1593K0005. The results and opinions reported here are that of the authors and do not necessarily represent the views of DARPA or the US government.

Joe Mattis helped formulate and implement-ed the SAGE graphical complexity metric. Other members of SAGE project who participated in the design of this system at various points include Jake Kolojejchick, Mark Derthick, Stefan Kerpediej and Nancy Green. Help in preparing some of the figures for this paper came from Donald J. Mulder, Jr. The first author would like to acknowledge helpwith some questions about fuf/surge from Charles Callaway.

We are grateful to four anonymous reviewers who helped substantially improve the paper. It goes without saying all remaining errors are solely our fault.

References

André, Elisabeth and Thomas Rist. 1994. Referring to world objects with text and pictures. In Proceedings of COLING-94, pages 530--534.

Appelt, Douglas. 1985. Planning English Sentences . Studies in Natural Language Processing. Cambridge University Press.

Beattie, Vivien and Michael John Jones. 1994. Information design and manipulation: Financial graphs in corporate annual reports. Information Design Journal, 7 (3):211--226.

Casner, Steven. 1991. A task-analytic approach to the automated design of graphic

presentations. ACM Transactions on Graphics, 10(2):111--151, April.

Cleveland, William S. and Robert McGill. 1987. Graphical perception: The visual decoding of quantitative information on graphical displays of data. Journal of the Royal Statistical Society, 150 (Series A, Part 3):192--229.

Dale, Robert. 1992. Generating Referring Expressions . ACL-MIT Series in Natural Language Processing. The MIT Press.

Dale, Robert and Ehud Reiter. 1995. Computational Interpretations of the Gricean Maxims in the Generation of Referring Expressions. Cognitive Science, 19:233--263.

Dalianis, Hercules. 1996. Concise Natural Language Generation from Formal Specifications, Ph.D. thesis, Royal Institute of Technology/Stockholm University, June.

Derr, Marcia A. and Kathleen R. McKeown. 1984. Using focus to generate complex and simple sentences. In Proceedings of the Tenth International Conference on Computational Linguistics, COLING, pages 319--326.

Elhadad, Michael. 1992. Using Argumentation to Control Lexical Choice: A Functional Unification Implementation. Ph.D. thesis, Columbia University, New York, NY. (The SURGE grammar for FUF is available via anonymous FTP at: ftp://www.cs.columbia.edu/fuf).

Elhadad, Michael and Jacques Robin. 1992. Controlling content realization with functional unification grammars. In R. Dale, E. Hovy, D. Rosner, and O. Stock, editors, Proceedings of the Sixth International Workshop on Natural Language Generation . Springer Verlag.

Fasciano, Massimo. 1996. Génération intégrée de textes et de graphiques statistiques . Ph.D. thesis, University of Montreal, Montreal, Canada.

Fasciano, Massimo and Guy Lapalme. 1996. PostGraphe: a system for the generation of statistical graphics and text. In Donia Scott, editor, Proceedings of the Eighth International Workshop on Natural Language Generation, Brighton, U.K.

Feiner, Steven K. and Kathleen R. McKeown. 1991. Automating the generation of coordinated multi-media explanations. Computer, 24(10):33--42, October.

Gordon, Peter C., Barbara J. Grosz, and Laura A. Gilliom. 1993. Pronouns, Names, and the Centering of Discourse . Cognitive Science, 17(3):311--349.

Grosz, Barbara J. 1977. The representation and use of focus in dialogue understanding. Technical Report 151, SRI International, Menlo Park, CA.

Grosz, Barbara J., Aravind K. Joshi, and Scott Weinstein. 1995. Centering: A framework for modeling the local coherence of discourse. Computational Linguistics, 21(2):203--226.

Grosz, Barbara J. and Candace Sidner. 1993. Lost intuitions and forgotten intentions. In Workshop on Centering Theory in Naturally -Occurring Discourse .

Hegarty, Mary and Marcel A. Just. 1993. Constructing mental models of machines from text and diagrams. Journal of Memory & Language, 32(6):717--742, December.

Hovy, E. H. and K. F. McCoy. 1989. Focusing your RST : A step toward generating coherent multisentential text. In Proceedings of the Conference of the Cognitive Science Society, Ann Arbor, MI.

Hovy, Eduard and Marie Meteer, editors. 1990. Proceedings of the AAAI Workshop on Evaluating Natural Language Generators. AAAI, Boston, MA.

Huang, Xiaorong and Armin Fiedler. 1996. Paraphrasing and aggregating argumentative text using text structure. In Proceedings of the 8th International Workshop on Natural Language Generation.

Kerpedjiev, Stephan. 1992. Automatic generation of multimodal weather reports from datasets. In Proceedings of the 3rd International Conference on Applied Natural Language Processing, pages 48--54, Trento, Italy.

Kerpedjiev, Stephan, Giuseppe Carenini, Steven F. Roth, and Johanna D. Moore. 1997. Integrating Planning and Task-based Design for Multimedia Presentation. In Proceedings of the Second International Conference on Intelligent User Interfaces (IUI '97),pages 145--152, Orlando, FL, January.

Large, Andrew, Jamshid Beheshti, Alain Breuleux, and Andre Renaud. 1995. Multimedia and comprehension: The relationship among text, animation, and captions. Journal of the American Society for Information Science, 46(5): 340--347, June.

Mackinlay, Jock D. 1986. Automating the design of graphical presentations of relational

information. ACM Transactions on Graphics, 5(2):110--141, April.

Marks, Joe W. 1991. Automating the Design of Network Diagrams. Ph.D. thesis, Harvard University, Cambridge, MA.

Marks, Joe W. and Ehud Reiter. 1990. Avoiding unwanted conversational implicatures in text and graphics. In Proceedings of the Eighth National Conference on Artificial Intelligence (AAAI-90), pages 450--456, Boston, MA. AAAI, AAAI/MIT Press.

Maybury, Mark T. 1991. Topical, temporal, and spatial constraints on linguistic realization. Computational Intelligence, 7-4:266--275.

McKeown, Kathleen, Steve Feiner, Jacques Robin, Dorée Seligmann, and Michael Tanenblatt. 1992. Generating Cross-References for Multimedia Explanation. In Proceedings of Tenth National Conference on Artificial Intelligence, San Jose, California, July 12-17.

McKeown, Kathleen R. 1985. Text Generation: Using Discourse Strategies and Focus

Constraints to Generate Natural Language Text. Cambridge University Press, Cambridge.

Mittal, Vibhu O. and Cécile L. Paris. 1992. Generating Object Descriptions which integrate both Text and Examples . In Proceedings of the Ninth Canadian Artificial Intelligence Conference (AI/GI/VI 92),pages 1--8. Canadian Society for the Computational Studies of Intelligence (CSCSI), Morgan Kaufmann Publishers.

Mittal, Vibhu O. and Cécile L. Paris. 1993. Automatic Documentation Generation: The Interaction between Text and Examples . In Proceedings of the Thirteenth International Joint Conference on Artificial Intelligence, pages 1158--1163, Chambery, France. IJCAI.

Nugent, Gwen C. 1983. Deaf students' learning from captioned instruction: The relationship

between the visual and caption display. Journal of Special Education, 17(2):227--234.

Reiter, Ehud. 1990. The computational complexity of avoiding conversational implicatures. In Proceedings of the 28th Annual Meeting of the Association for Computational Linguistics, pages 97--104. ACL.

Roth, Steven F. and William E. Hefley. 1993. Intelligent Multimedia Presentation Systems: Research and Principles . In Intelligent Multimedia Interfaces. AAAI/MIT Press, Menlo Park, CA, pages 13--59.

Roth, Steven F., John Kolojejchick, Joe Mattis, and Jade Goldstein. 1994. Interactive graphic design using automatic presentation knowledge. In Proceedings of CHI'94: Human Factors in Computing Systems, Boston, MA. ACM/SIGCHI.

Roth, Steven F. and Joe Mattis. 1990. Data characterization for intelligent graphics presentation. In Proceedings of the 1990 Conference on Human Factors in Computing Systems, pages 193--200, New Orleans, LA. ACM/SIGCHI.

Schmid, Calvin F. 1983. Statistical Graphics: Design Principles and Practices. John Wiley and Sons. Shah 1995] Shah-PhD

Shah, Priti. 1995. Cognitive Processes in Graph Comprehension. Ph.D. thesis, Carnegie Mellon University, Pittsburgh, PA 15213.

Shaw, James. 1995. Conciseness through aggregation in text generation. In Proceedings of the Thirty-third Annual Meeting of the Association of Computational Linguistics, pages 329--331. ACL. (Student Session).

Sidner, Candace L. 1979. Towards a Computation Theory of Definite Anaphora Comprehension

in English Discourse. Ph.D. thesis, MIT, Cambridge, MA.

Tufte, Edward R. 1983. The Visual Display of Quantitative Information . Graphics Press, Cheshire, Conn.

Wahlster, Wolfgang, Elisabeth Andre, W. Finkler, H. J. Profitlich, and Thomas Rist. 1993. Plan-based integration of natural-language and graphics generation. Artificial Intelligence, 63(12):387--427, October.

Walker, Marilyn, Masayo Iida, and Sharin Cote. 1994. Japanese discourse and the process of centering. Computational Linguistics, 20(2):193--232.

Walker, Marilyn A. 1993. Initial contexts and shifting centers. In Proceedings of the Workshop on Centering Theory in Naturally-Occurring Discourse, Columbus, OH. ACL.

Young, R. Michael. 1997. The LongBow Discourse Planner. Available at URL http://pogo.isp.pitt.edu/ young/longbow/longbow.html.

Young, R. Michael and Johanna D. Moore. 1994. DPOCL: A Principled Approach to Discourse Planning . In Proceedings of the Seventh International Workshop on Natural Language Generation, pages 13--20, Kennebunkport, ME, July.

Young, R. Michael, Martha E. Pollack, and Johanna D. Moore. 1994. Decomposition and Causality in Partial-Order Planning . In Proceedings of the Second International Conference on AI and Planning Systems, pages 188--193, Chicago, July.

 
 
   

Paper Sections:

     To Title page
     To Part 1: Introduction
     To Part 2: SAGE: A System for Automatic Graphical Explanations
     To Part 3: Discourse Strategies for Generating Captions
     To Part 4: Graphical Complexity: The Need for Clarification
     To Part 5: Generating Explanatory Captions
     To Part 6: System Implementation and Evaluation
     To Part 7: Related Work
     To Part 8: Conclusions and Future Work
     To Appendix A
 
    [RESEARCH]     [SAMPLES]     [PAPERS]     [PEOPLE]     [HOME]