5.3.6 Flakiness in real life

Course subject(s) Module 5: Test Code Smells

Many companies have been facing Flaky Tests in real life. You can read more about their cases:

  • How Google is tackling flaky tests. https://testing.googleblog.com/2016/05/flaky-tests-at-google-and-how-we.html
  • How Facebook is automatically removing flaky tests from their suites. https://www.youtube.com/watch?v=Stjc80e15-c#t=1h11m25s
  • Research by Bell et al. on how to automatically detect flaky tests: Bell, J., Legunsen, O., Hilton, M., Eloussi, L., Yung, T., & Marinov, D. (2018). DeFlaker: Automatically detecting flaky tests. In Proceedings of the 2018 International Conference on Software Engineering. http://www.jonbell.net/icse18-deflaker.pdf.
Creative Commons License
Automated Software Testing: Practical Skills for Java Developers by TU Delft OpenCourseWare is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.
Based on a work at https://online-learning.tudelft.nl/courses/automated-software-testing-practical-skills-for-java-developers/.
Back to top