The program for IEEE AiTest is announced below.
Keynote by Professor Mark Harman
Monday August 15th, 8:50-9:50 am Pacific Time of USA, online (link will be posted here)
Title: Simulation-based Testing
This talk will cover Simulation-based testing, drawing on experience on the development and deployment of client- and server-side testing platforms at Meta (formerly Facebook).The talk will review client-side testing using Sapienz, an automated test generation tool for Android and iOS, and server-side testing using the cyber-cyber digital twin WW.These technologies are in daily use at Meta platforms to test the back end systems, infrastructure and apps that enable meta to provide software such as Facebook, Instagram and WhatsApp; some of the mostly widely used systems in the history of Software Engineering. This is joint work with Nadia Alshahwan, John Ahlgren, Johannes Bader, Maria Eugenia Berezin, Kinga Bojarczuk, Satish Chandra, Andrea Cinacone, Rafael Lopez Diez, Sophia Drossopoulou, Inna Dvortsova, Xinbo Gao, Johann George, Natalija Gucevska, Yue Jia, Michal Krolikowski, Will Lewis, Maria Lomeli, Simon Lucas, Ke Mao, Alexandru Marginean, Alexander Mols, Killian Murphy, Steve Omohundro, Erik Meijer, Rubmary Rojas, Silvia Sapora, Dave Soria Para, Andrew Scott, Federica Sarro, Teijin Tei, and Jie Zhang.
Biography:
Mark Harman is a full-time Software Engineer at Meta Platforms, working in the Simulation-Based Testing team. The team has developed and deployed both the Sapienz and WW platforms for client- and server- side testing. Simulation-based testing is helping to tackle challenging technical problems in software reliability, performance, safety and privacy. These simulation-based testing technologies have been deployed to test systems of over 100 million lines of lines of code, daily relied upon by over 2.9 billion people for communications, business, social media and community building. Sapienz grew out of Majicke (a start up Mark co-founded) that was acquired by Facebook (now Meta Platforms) in 2017. Prior to working at Facebook, Mark was Head of Software Engineering at UCL and Director of its CREST centre, where he remains a part time professor. In his more purely scientific work, he co-founded the field Search Based Software Engineering (SBSE) in 2001, now the subject of active research in over 40 countries worldwide. He received the IEEE Harlan Mills Award and the ACM Outstanding Research Award in 2019 for his work, and was awarded a fellowship of the Royal Academy of Engineering in 2020.
Regular sessions
Session1: AI test applications and mesaurement
Aug-15, 10:30-12:00 (San Jose, PDT)
Herbert Mühlburger and Franz Wotawa
A Passive Testing Approach using a Semi-Supervised Intrusion Detection Model for SCADA Network Traffic
Hong Zhu, Ian Bayley and Mark Green
Metrics for Measuring Error Extents of Machine Learning Classifiers
Akash Jagannathan, Bharathi Chandrasekaran, Shubham Dutta, Uma Rameshgouda Patil and Magdalini Eirinak
Original Music Generation using Recurrent Neural Networks with Self-Attention
Session 2: AI Test Generation
Aug-15, 14:30-16:00 (San Jose, PDT)
Muyeed Ahmed and Iulian Neamtiu
Anomalous Anomaly Detection
Alessio Gambi, Vuong Nguyen, Jasim Ahmed and Gordon Fraser
Generating Critical Driving Scenarios from Accident Sketches
Sunny Shree, Jaganmohan Chandrasekaran, Yu Lei, Raghu N. Kacker and D. Richard Kuhn
DeltaExplainer: A Software Debugging Approach to Generating Counterfactual Explanations
Online session: AI Test Quality
Aug-15, 18:00-19:30 (San Jose, PDT)
Zukang Liao, Pengfei Zhang and Min Chen
ML4ML: Automated Invariance Testing for Machine Learning Model
Abdullah Murat Buldu, Alper Sen, Karthik Swaminathan and Brian KahneMBET: Resilience Improvement Method for DNNs
Xiaomin Li, Chuanqi Tao, Jerry Gao and Hongjing Guo
A Review of Quality Assurance Research of Dialogue Systems
Session 3: New Approahes for AI Test
Aug-15, 16:30-18:00 (San Jose, PDT)
Qingying Liu, Tao Zhang, Shaoying Liu, Jerry Gao and Jing Cheng
Construction of Semantic Model for GUI of Mobile Applications Using Deep Learning
Faqeer Ur Rehman and Clemente Izurieta
An Approach For Verifying And Validating Clustering Based Anomaly Detection Systems Using Metamorphic Testing
Jerry Gao, Tao Chuanqi, He Yejun, Anumalasetty Amrutha Pavani, Joseph Erica Wilson, Sripathi Akshata Hatwar Kumbashi and Nayani Himabindu
An Approach to GUI Test Scenario Generation Using Machine Learnin
Session 4: Test Selecction and Prioritization for AI Test
Aug-17, 10:30-12:00 (San Jose, PDT)
Nyasha Masamba, Kerstin Eder and Tim Blackmore
Supervised Learning for Coverage-Directed Test Selection in Simulation-Based Verificatio
Nyasha Masamba, Kerstin Eder and Tim Blackmore
Hybrid Intelligent Testing in Simulation-Based Verificatio
Hamzah Al-Qadasi, Changshun Wu and Ylies Falcone
DeepAbstraction: 2-Level Prioritization for Unlabeled Test Inputs in Deep Neural Networks