Blog

Jun 12 2019

STAMP Testing Tools Among Mature OSS Featured at OW2con'19

More than 30 presentations and breakout sessions showing open source software industrial maturity
 are offered at OW2con’19, the free OW2 community conference, June 12-13, 2019.

Paris, June 12, 2019 - OW2, the international community dedicated to develop and to promote an open source code base for information systems announces the program of its 2019 annual conference. With this year theme  “Open Source: Toward industry Maturity”, OW2con’19 offers two days of project presentations and demonstrations, round tables, workshops and prestigious guest speakers. More…

Jun 03 2019

Production Traffic For Testing

ist

Publication: Information and Software Technology
Authors: Jeff Anderson, Maral Azizi, Saeed Salem, and Hyunsook Do
URL: https://www.sciencedirect.com/science/article/abs/pii/S0950584919301223?dgcid=rss_sd_all

Title: On the Use of Usage Patterns from Telemetry Data for Test Case Prioritization

In an original work about Production Traffic for Testing, Jeff Anderson, Maral Azizi, Saeed Salem, and Hyunsook Do present a new opportunity in the area of regression testing techniques. Here is the abstract:

Context: Modern applications contain pervasive telemetry to ensure reliability and enable monitoring and diagnosis. This presents a new opportunity in the area of regression testing techniques, as we now have the ability to consider usage profiles of the software when making decisions on test execution. Objective: The results of our prior work on test prioritization using telemetry data showed improvement rate on test suite reduction, and test execution time. The objective of this paper is to further investigate this approach and apply prioritization based on multiple prioritization algorithms in an enterprise level cloud application as well as open source projects. We aim to provide an effective prioritization scheme that practitioners can implement with minimum effort. The other objective is to compare the results and the benefits of this technique factors with code coverage-based prioritization approaches, which is the most commonly used test prioritization technique. 

Method: We introduce a method for identifying usage patterns based on telemetry, which we refer to as “telemetry fingerprinting.” Through the use of various
algorithms to compute fingerprints, we conduct empirical studies on multiple software products to show that telemetry fingerprinting can be used to more effectively prioritize regression tests. 

Results: Our experimental results show that the proposed techniques were able to reduce over 30 percent in regression test suite run times compared to the coverage-based prioritization technique in detecting discoverable faults. Further, the results indicate that fingerprints are effective in identifying usage patterns, and that the fingerprints can be applied to improve regression testing techniques.

Conclusion: In this research, we introduce the concept of fingerprinting software usage patterns through telemetry. We provide various algorithms to compute fingerprints and conduct empirical studies that show that fingerprints are effective in identifying distinct usage patterns. By applying these techniques, we believe that regression testing techniques can be improved beyond the current state-of-the-art, yielding additional cost and quality benefits.

May 29 2019

STAMP Software Testing Practices at ICSE 2019

ICSE19_STAMP_BD1.jpg

Place: Montréal, QC, Canada
Date: 29-30 May 2019
Speakers: Benoit Baudry (KTH), Martin Monperrus (KTH), Benjamin Danglot (Inria), Oscar Vera Perez (Inria)

May 24 2019

Jeff Offutt, Professor of Software Engineering at George Mason University (Virginia)

Mutation testing can improve software reliability, including security

Jeff_Offutt.jpg
Where are the business challenges solved by mutation testing?

Mutation can help develop excellent tests. Mutation creates subtle variations of the program-under-test (called mutants), and challenges the tester to design or find test inputs that distinguish the mutants from the original. The resulting test set will find faults that lurk in complicated expressions and hard-to-reach sections of the code. Mutation tests ensure statement and branch coverage, but go far beyond them in their ability to reveal faults in the code. More…

May 17 2019

STAMP Workshop for EC-DGIT

STP_DGIT_Worshop_May17_04.jpg

Title: STAMP software testing for DevOps pipeline
Speakers: Prof. Benoit Baudry (KTH), Caroline Landry and Oscar Luis Vera Pérez (INRIA)
Place: Brussels
Date: 17/5/2019 2:30PM-5:30PM

After Introduction talks from European Commission DGIT Director, Head of Unit DIGIT B4 and Head of sector Software development, STAMP project coordinator Benoit Baudry presents STAMP EC-funded project. Then Oscar Luis Vera Pérez details Extreme Mutation examples using Descartes, an outcome of the STAMP Project, based on PITest to offer faster mutation analysis results. The EC-DG INFORMATICS Software Engineering team seizes this opportunity to ask technical questions about DevOps mutation testing to improve their own Java test environment.

  • Registered participants: 100 (70+ attendees) More…

May 15 2019

STAMP Banners 

Please use the feedback form URL as image destination link: https://www.stamp-project.eu/view/main/betatestingsurvey/
Alternatively, you can use the github tool URL you want to reinforce in your message. 

STP_Feedback_Banner.jpg
STP_Feedback_DSpot_Banner.jpg
STP_Feedback_Descartes_Banner.jpg
STP_Feedback_CAMP_Banner.jpg
STP_Feedback_Botsing_Banner.jpg

May 06 2019

DSpot meetup in Stockholm

STP_DSpot_Meetup_Stockholm.jpg

Title: DSpot: Improved software testing using AI
Speaker: Professor Benoit Baudry (KTH)
Place: Birger Jarlsgatan 7, Stockholm
Date: 6/5/2019 17:30-19:00

DSpot analyzes existing test cases and automatically generates variants of these test cases. The variants cover more execution paths and observe more states than the original tests. These tests are meant to be used in the context of regression testing. DSpot can be integrated in the continuous integration to spot issues related to one commit as early as possible.

Apr 24 2019

Cyrille Artho, KTH Associate Professor

Mutation testing can serve as indicators on test quality and relevance

STAMP_Cyrille_Artho_KTH.jpg
How do you see mutation testing tools being adopted in business projects, as an effective method with significant benefits on distributed software updates?

I think mutation testing has its uses in specialized settings, where the software is small (or well-modularized). However, many companies struggle with the fact that they can't keep up with testing, so we also see the opposite (test selection), where tests are not analyzed as much in depth, but instead, the goal is to be as light-weight as possible. From this point of view, mutation techniques should in general also be efficient and light-weight. More…

Apr 17 2019

STAMP talks at Devoxx Paris

Devoxx2019_VMassol_Theater.jpg

STAMP is presented at DeVoxx Paris, through two conferences.  

Date: 17-19 April 2019
Place: Paris

Click below for more DeVoxx Paris information, video, presentation and photos. More…

Apr 12 2019

Mutation Testing Workshop at Ericsson HQ in Stockholm

Oscar_Mutation_Testing_Kista.jpg

Date: Friday 12 April, 2019
Place: Ericsson Offices, building 18, Torshamngatan 23 Kista Stockholm
Room: LM Junior Conference room
Hours: 09:00AM - 04:00PM
Speaker: Oscar Luis Vera Pérez (Inria Rennes) More…

Site maintained by OW2