Graduate Reading Course on Software Testing
Contact
For questions, please contact
Anders Hessel,
Paul Pettersson,
or
Bengt Jonsson.
E-mail:
{
hessel,
paupet,
bengt
}@docs.uu.se
Schedule
(Subject to change).
Meetings
Articles should have been read before the meeting,
the articles are listed in decreasing importance.
Meetings will be held weekly, at 10.15 -12.00, preferable in room 1406.
More meetings will be annonced.
The articles to read before a meeting, will be decided at the preceding meeting.
Introduction
Date : 2002-02-07
Time : 10.15 -12.00
Room : 1406
Definition of the course,
discussion of how to proceed.
General concepts
Date : 2002-02-14
Time : 10.15 -12.00
Room : 1406
Articles:
- Stephen R. Schach,
Testing: principles and practice
ACM Computing Surveys;
Volume 28, Issue 1 (1996), here.
- Adrion; Branstadt; Cherniavsky,
Validation, Verification and Testing of Computer Software,
ACM Computing Surveys
14(2): 159-192, June 1982, here,
notes.
- N.G. Leveson,
Software Safety: What, Why, and How,
ACM Computing Surveys
18(2): 125-163, June 1986, here.
Test case generation
Date : 2002-02-20
Time : 13.15 -15.00
Room : 1406
-
T.J.
Ostrand; M.J. Balcer,
The Category-Partition Method for Specifying
and Generating Functional Tests,
Communications of the ACM;
31(6):676-686, June 1988, here.
-
Adele Howe, Anneliese von Mayrhauser and Richard Mraz,
Test Case Generation
as an AI Planning Problem,
Automated Software Engineering, Vol.4,
No.1, pp. 77-106, January, 1997, here.
- Neelam Gupta, Aditya P. Mathur, and Mary Lou Soffa,
Automated Test Data
Generation Using an Iterative Relaxation Method,
ACM SIGSOFT
Sixth International Symposium on Foundations of Software Engineering
(FSE-6), Orlando, Florida, USA, November 1998,here.
Data Flow Analysis
Date : 2002-02-28
Time : 10.15 -12.00
Room : 1406
-
Parrish, A.S.; Zweben, S.H.,
On the relationships
among the all-uses, all-DU-paths, and all-edges testing criteria,here
Software
Engineering, IEEE Transactions on,
Volume: 21 Issue: 12, Dec. 1995, Page(s):
1006 –1009.
-
Frankl, P.G.; Weyuker, E.J.,
An analytical
comparison of the fault-detecting ability of data flow testing techniques,
here
Software Engineering 1993. Proceedings, 15th International Conference on,
1993, Page(s): 415 –424.
-
M. Harrold and M. Soffa;
Interprocedual data flow
testing; here or here
Proceedings of the ACM SIGSOFT '89 third symposium on
Software testing, analysis, and verification,
1989, Pages 158 – 167.
Optional reading:
-
Frankl, P.G.; Weyuker, E.J.,
An applicable family
of data flow testing criteria, here
Software Engineering, IEEE Transactions
on,
Volume: 14 Issue: 10, Oct. 1988, Page(s): 1483 –1498.
-
Weyuker, E.J.,
The cost of data flow testing: an
empirical study,
here
Software Engineering, IEEE Transactions on,
Volume: 16 Issue: 2, Feb. 1990, Page(s): 121 –128.
-
Weyuker, E.J.,
More experience with data flow
testing, here
Software Engineering, IEEE Transactions on,
Volume: 19
Issue: 9, Sept. 1993, Page(s): 912 –919.
Object-Oriented Testing
Date : 2002-03-07
Time : 10.15 -12.00
Room : 1406
- Weyuker,
E.J.,
Testing component-based software: a cautionary tale,
IEEE
Software,
Volume: 15 Issue: 5, Sept.-Oct. 1998, Page(s): 54–59,
here.
- Y.
Labiche, P. Thévenod-Fosse, H. Waeselynck and M.H. Durand,
Testing levels
for object-oriented software,
Proc. 22nd IEEE International
Conference on Software Engineering (ICSE'2000),
Limerick (Ireland), pp. 136-145, June, 2000, here.
-
Paul
C. Jorgensen and Carl Erickson,
Object-oriented integration testing,
Comm.
ACM 37, 9 (Sep. 1994),
Pages 30 – 38
, (Magazine in the coffee room)
Optional reading:
- Huo
Yan Chen, T. H. Tse, F. T. Chan and T. Y. Chen;
In black and white: an integrated
approach to class-level testing of object-oriented programs;
ACM
Trans. Softw. Eng. Methodol.
7, 3 (Jul. 1998), Pages 250 - 295.
- Roong-Ko
Doong and Phyllis G. Frankl;
The ASTOOT approach to testing
object-oriented programs;
ACM Trans. Softw. Eng. Methodol.
3, 2 (Apr. 1994), Pages 101 – 130.
Joint Venture with VnV at Scientific Compuing
Date : 2002-03-11
Time : 15.15 -17.00
Room : 1406
More important:
- Les Hatton and Andy Roberts,
How Accurate Is Scientific Software?,
IEEE Transactions on Software Engineering,
Vol. 20, No 10, October 1994,
here
- Eleine J. Weyuker,
On Testing Non-testable Programs,
The Computer Journal ,
Vol. 25, No. 4, 1982.
Less important:
- Martin Davis and Eleine Weyuker,
Metric Space-based Test-data Adequacy Criteria ,
The Computer Journal ,
Vol. 31, No. 1, 1988.
- Adrion; Branstadt; Cherniavsky,
Validation, Verification and Testing of Computer Software,
ACM Computing Surveys
14(2): 159-192, June 1982, here.
Test Oracles
Date : 2002-03-14
Time : 10.15 -12.00
Room : 1406
-
D.J.
Richardson,
TAOS: Testing with Analysis and Oracle Support, in
Proceedings
of the 1994 International Symposium on Software Testing and Analysis,
pp. 138-153, Seattle, WA, August 1994, here.
-
Debra
J. Richardson, Stephanie Leif Aha and T. Owen O'Malley,
Specification-based
test oracles for reactive systems,
Proceedings of the 14th
International conference on Software engineering, 1992,
Pages 105 - 118, here.
-
John Håkansson, Bengt Jonsson, Ola Lundqvist,
Generating On-Line Test
Oracles from Temporal Logic Specifications, here.
Optional reading
-
Atif
M. Memon, Martha E. Pollack and Mary Lou Soffa,
Automated test oracles
for GUIs,
Proceedings of the eighth international symposium on
Foundations of software engineering,
2000, Pages 30 – 39 , here.
Seminar by Yves Ledru
This is an external event, recommended for all participants.
Date : 2002-02-25
Time : 10.15 -11.00
Room : 1245
Announcement by Lars-Henrik Eriksson 2002-03-07:
Yves Ledru from LSR/IMAG (Institut d'Informatique et Mathématiques
Appliquées de Grenoble) will visit the department on March 25 and hold a
seminar.
Room 1245 at 10:15-11:00.
Test purposes: adapting the notion of specification to testing
(based on a paper published at ASE2001)
Yves Ledru (LSR/IMAG, Grenoble, France)
Nowadays, test cases may correspond to elaborate programs. It is therefore
sensible to try to specify test cases in order to get a more abstract view of
these. This paper explores the notion of test purpose as a way to specify a set
of test cases. It shows how test purposes are exploited today by several tools
that automate the generation of test cases. It presents the major relations
that link test purposes, test cases and reference specification. It also
explores the similarities and differences between the specification of test
cases, and the specification of programs. This opens perspectives for the
synthesis and the verification of test cases, and for other activities like
test case retrieval.
Everyone welcome,
Lars-Henrik
|
- Ledru, Y. du Bousquet, L. Bontron, P. Maury, O. Oriat, C. Potet, M.-L.
Test purposes: adapting the notion of specification to testing
IEEE, Automated Software Engineering, 2001. (ASE 2001). Proceedings. 16th Annual International
Conference on , 2001
Page(s): 127 -134 PDF
PowerPoint presentation from the seminar, here.
Regression Testing
Date : 2002-03-28
Time : 10.15 -12.00
Room : 1406
- D.S.
Rosenblum and E.J. Weyuker.
Using Coverage Information to Predict the
Cost-Effectiveness of Regression Testing Strategies,
IEEE
Transactions on Software Engineering;
23(3): 146-156, March 1997, PDF, ps.
-
Todd
L. Graves, Mary Jean Harrold, Jung-Min Kim, Adam Porter and Gregg
Rothermel,
An empirical study of regression test selection techniques,
ACM Trans. Softw. Eng. Methodol.
10, 2 (Apr. 2001), Pages 184 –
208, (drafts) PDF, ps.
- Gregg
Rothermel and Mary Jean Harrold;
A framework for evaluating
regression test selection techniques;
Proceedings Of The 16th
International Conference On Software Engineering,
1994, Pages 201 –
210, ps.
- Gregg
Rothermel and Mary Jean Harrold;
A safe, efficient regression test
selection technique;
ACM Trans. Softw. Eng. Methodol.
6, 2
(Apr. 1997), Pages 173 – 210,
ps.
Regression testing dir
FME'02 papers
Date : 2002-04-11
Time : 10.15 -12.00
Room : 1406
- Heuristic-driven Test Case Selection from Formal Specifications. A Case Study
- UniTesK Test Suite Architecture
Non FME'02 papers
- Formal Test Automation: A Simple Experiment
FME02 dir
Timing
Date : 2002-04-18
Time : 10.15 -12.00
Room : 1406
Suggested papers:
- Rachel Cardell-Oliver and Tim Glover
A Practical and Complete Algorithm for Testing Real-Time Systems
Lecture Notes on Computer Science,
1486:251-, 1998, [COG98].
-
Duncan Clarke and Insup Lee
Automatic Deneration of Tests for Timing Constraints for Requirements
Proceedings of the Third International Workshop on Object-Oriented Real-Time Dependable Systems ,
Newport Beach, Carlifonia, February 1997,
[CL97]
- Frank Mueller and Joachim Wegener
A Comparision of Static Analysis and Evolutionary Testing for the
Verification of Timing Constraints
Real-Time Technology and Applications Symposium,
Jun 1998, pages 179-188, [MW98]
- Cheer-Sun D. Yang and Lori L. Pollock
The Challanges in Automated Testing of Multithreaded Programs
14th International Conference on Testing Computer Software,
June 1997,[YP97]
Optional
Timing dir
Testing timed automata
Date : 2002-05-02
Time : 10.15 -12.00
Room : 1406
- Jan Springintveld, Frits Vaandrager, and Pedro R. D'Argenio
Testing Timed Automata
Technical Report CTIT-97-17, Univ. of Twente, the Netherlands, 1997. (Invited
talk at TAPSOFT'97, Lille, France, Apr 1997)
[SVA97]
- Brian Nielsen and Arne Skou
Automated Test Generation from Timed Automata
In Tiziana Margaria and Wang Yi, editors, TACAS 2001 - Tools and Algorithms for the Construction and Analysis of Systems, pages 343-357, Genova, Italy, April 2001.
[NS01]
Timing II dir
Distributed systems / Race Conditions
Date : 2002-05-08
Time : 13.15 -15.00
Room : 1406
- Guang-Ien Cheng, Mingdong Feng, Charles E. Leiserson, Keith H. Randall, and Andrew F. Stark
Detecting Data Races in Cilk Programs that Uses Locks
In the 10th ACM Symposium on Parallel Algorithms and Architectures, June 28-July 2, 1998.
[CFL+98]
- Mingdong Feng and Charles E. Leiserson
Efficient Detecting of Determinacy Races in Cilk Programs
9th Annual ACM Symposium on Parallel Algorithms and Architectures SPAA'97 June 22-25, 1997, Newport, Rhode Island.
[FL97]
- Derek Bruening and John Chapin
Systematic Testing of Multithreaded Programs
MIT/LCS Technical Memo, LCS-TM-607, April 2000
[BC00]
Distributed dir
Model generation
Date : 2002-05-16
Time : 10.15 -12.00
Room : 1406
model generation dir
Testing of configurable systems, Mats Grindal (ENEA)
Date : 2002-05-24
Time : 08.15 -10.00
Room : 1406
Testing of configurable systems. Seminar by Mats Grindal ENEA.
Software testing in a small company environment, Carl Ericksson
Date : 2002-05-30
Time : 10.15 -12.00
Room : 1406
Speaker: Carl Ericksson, DoCS and Atomic Object LLC.
Software testing in a small company environment
In 1994 I collaborated with a former colleague on a project involving testing of object oriented software. We published the results of our work in the Communications of the ACM in a paper entitled "Object oriented integration testing" (CACM, September 1994). This paper proposed two constructs, the MM-path and the ASF, to formalize integration testing of object-oriented systems.
In spring 2000 I left full-time university life and started my own contract software development company. My company, Atomic Object, has several customers and has done projects in industrial automation and e-commerce using both Java and C++. We use testing as a distinguishing component of our own software development process, a process that is largely based on ideas from Extreme Programming.
How do our 1994 CACM ideas look from my new perspective? This talk will briefly describe those OO integration testing constructs, as well as my testing experience in a real-world, small-scale contract software development environment.
Links
Glossary on software testing:
Other links:
- Interesting course at University of Maryland
-
Course at University of Oregon, here
- Georgis Tech, Collage of computing, Readings, Program Analysis, here
- Local linkage page for testing can be found here.
- Reviews etc
- A testing bibliography, here
- An OO bibliography in testing, here
- Labiche's homepage, here
- Articles, here
- Bibliography: Testing Object-Oriented Software, here
-
A first attempt to make a dictionary of testing terms here
Anders Hessel
Last modified: Fri Sep 20 15:57:24 MET DST 2002
