Topic T5E: Empirical Evaluation

Summary

• Requested in 20/26 calls
• Requested in 17/19 pure calls (2010–2026 with the longest streak of 17 years)
• Primary tagged in 5/26 paper bundles
• Primary tagged in 5/19 pure proceedings (2008–2024 with the longest streak of 1 years)
• Secondary tagged in 19/26 paper bundles
• Secondary tagged in 15/19 pure proceedings (2008–2025 with the longest streak of 9 years)
• Top 3 co-occurring topics:
  • T4A: Workbenches (23 times)
  • T3C: DSLs (12 times)
  • T5B: Language Description Analysis (11 times)
• Top 3 contributors:
  • Görel Hedin (5 times)
  • Emma Söderberg (5 times)
  • Jordi Cabot (5 times)

List of papers (57)

• (ATEM 2006 SI) Ontological Approach for the Semantic Recovery of Traceability Links between Software Artefacts (Yonggang Zhang, René Witte, Juergen Rilling, Volker Haarslev) T5G T3E T2B T5E
• (ATEM 2006 SI) Learning Context-Free Grammar Rules from a Set of Program (Alpana Dubey, Pankaj Jalote, Shubhani Aggarwal) T5B T2A T5E T3A
• (SLE 2008) Evaluating the Visual Syntax of UML: An Analysis of the Cognitive Effectiveness of the UML Family of Diagrams (Daniel Laurence Moody, Jos van Hillegersberg) T5H T4F T5E
• (SLE 2008) A Practical Evaluation of Using TXL for Model Transformation (Hongzhi Liang, Jürgen Dingel) T5E T4B T3B
• (SLE 2008) The Java Programmer’s Phrase Book (Einar W. Høst, Bjarte M. Østvold) T5E T5B T2B
• (SLE 2010) Automated Selective Caching for Reference Attribute Grammars (Emma Söderberg, Görel Hedin) T5F T3A T5E
• (SLE 2010) Metamodel Usage Analysis for Identifying Metamodel Improvements (Markus Herrmannsdörfer, Daniel Ratiu, Maximilian Koegel) T5B T2B T5E
• (SLE 2010) Canonical Method Names for Java: Using Implementation Semantics to Identify Synonymous Verbs (Einar W. Høst, Bjarte M. Østvold) T5B T6G T5E
• (SLE 2010) Empirical Language Analysis in Software Linguistics (Jean-Marie Favre, Dragan Gašević, Ralf Lämmel, Ekaterina Pek) T5E T5B
• (SLE 2010) Evaluating a Textual Feature Modelling Language: Four Industrial Case Studies (Arnaud Hubaux, Quentin Boucher, Herman Hartmann, Raphaël Michel, Patrick Heymans) T5E T2C T6B
• (SLE 2011) Cloning in DSLs: Experiments with OCL (Robert Tairas, Jordi Cabot) T2B T3C T5E
• (SLE 2011) Comparison of Context-Free Grammars Based on Parsing Generated Test Data (Bernd Fischer, Ralf Lämmel, Vadim Zaytsev) T5C T5B T5E
• (SLE 2013) Detecting Ambiguity in Programming Language Grammars (Naveneetha Vasudevan, Laurence Tratt) T5B T5E T3A
• (SLE 2013) The State of the Art in Language Workbenches: Conclusions from the Language Workbench Challenge (Sebastian Erdweg, Tijs van der Storm, Markus Völter, Meinte Boersma, Remi Bosman, William R. Cook, Albert Gerritsen, Angelo Hulshout, Steven Kelly, Alex Loh, Gabriël Konat, Pedro J. Molina, Martin Palatnik, Risto Pohjonen, Eugen Schindler, Klemens Schindler, Riccardo Solmi, Vlad Vergu, Eelco Visser, Kevin van der Vlist, Guido Wachsmuth, Jimi van der Woning) T4A T5E T6D
• (SLE 2014) Evaluating the Usability of a Visual Feature Modeling Notation (Aleksandar Jakšic, Robert B. France, Philippe Collet, Sudipto Ghosh) T5H T4F T2C T5E
• (SLE 2014 SI) Declarative rewriting through circular nonterminal attributes (Emma Söderberg, Görel Hedin) T3A T3B T1C T5E
• (SLE 2014 SI) Evaluating and comparing language workbenches: Existing results and benchmarks for the future (Sebastian Erdweg, Tijs van der Storm, Markus Völter, Laurence Tratt, Remi Bosman, William R. Cook, Albert Gerritsen, Angelo Hulshout, Steven Kelly, Alex Loh, Gabriël Konat, Pedro J. Molina, Martin Palatnik, Risto Pohjonen, Eugen Schindler, Klemens Schindler, Riccardo Solmi, Vlad Vergu, Eelco Visser, Kevin van der Vlist, Guido Wachsmuth, Jimi van der Woning) T4A T5E T3C T6D
• (SLE 2015) An Empirical Study on Simplification of Business Process Modeling Languages (Eric Umuhoza, Marco Brambilla, Davide Ripamonti, Jordi Cabot) T5E T1A T2B T3C
• (SLE 2015) Using Decision Rules for Solving Conflicts in Extended Feature Models (Lina Ochoa, Oscar González-Rojas, Thomas Thüm) T2C T4B T5B T5E
• (SLE 2017) Better Call the Crowd: Using Crowdsourcing to Shape the Notation of Domain-Specific Languages (Marco Brambilla, Jordi Cabot, Javier Luis Cánovas Izquierdo, Andrea Mauri) T5H T1A T5E T3C
• (SLE 2017) Comparison of the Expressiveness and Performance of Template-Based Code Generation Tools (Lechanceux Luhunu, Eugene Syriani) T4C T5F T5E T4A
• (SLE 2017) Energy Efficiency across Programming Languages (Rui Pereira, Marco Couto, Francisco Ribeiro, Rui Rua, Jácome Cunha, João Paulo Fernandes, João Saraiva) T5E T3D T5F T6D
• (SLE 2017) Deep Priority Conflicts in the Wild: A Pilot Study (Luís Eduardo de Souza Amorim, Michael J. Steindorfer, Eelco Visser) T5E T5B T2B T3A
• (SLE 2018) Shape-diverse DSLs: Languages without Borders (Fabien Coulon, Thomas Degueule, Tijs van der Storm, Benoît Combemale) T6D T4A T5E T5H
• (SLE 2018) The Next 700 Unit of Measurement Checkers (Oscar Bennich-Björkman, Steve McKeever) T1B T4A T5E
• (SLE 2018) Continuous Model Validation using Reference Attribute Grammars (Johannes Mey, René Schöne, Görel Hedin, Emma Söderberg, Thomas Kühn, Niklas Fors, Jesper Öqvist, Uwe Aßmann) T3A T4A T5E T4B
• (SLE 2018) Morbig: A Static Parser for POSIX Shell (Yann Régis-Gianas, Nicolas Jeannerod, Ralf Treinen) T1A T4A T5D T5E
• (SLE 2018) Migrating Business Logic to an Incremental Computing DSL: A Case Study (Daco C. Harkes, Elmer van Chastelet, Eelco Visser) T3B T4A T5E T1D
• (SLE 2018 SI) Relational Reference Attribute Grammars: Improving continuous model validation (Johannes Mey, René Schöne, Görel Hedin, Emma Söderberg, Thomas Kühn, Niklas Fors, Jesper Öqvist, Uwe Aßmann) T3A T4A T2B T5E
• (SLE 2018 SI) MORBIG: A Static Parser for POSIX Shell (Yann Régis-Gianas, Nicolas Jeannerod, Ralf Treinen) T4C T3D T5E
• (SLE 2019) Multiple Lexicalisation (A Java Based Study) (Elizabeth Scott, Adrian Johnstone) T1A T4A T5E
• (SLE 2019) Default Disambiguation for Online Parsers (Lukas Diekmann, Laurence Tratt) T1A T5E T1D T5H
• (SLE 2019) Efficient Late Binding of Dynamic Function Compositions (Lars Schütze, Jerónimo Castrillón) T1C T4A T5E T1D
• (SLE 2019) Empirical Study on the Usage of Graph Query Languages in Open Source Java Projects (Philipp Seifer, Johannes Härtel, Martin Leinberger, Ralf Lämmel, Steffen Staab) T1A T5D T5E
• (SLE 2019) Analysis and Modeling of the Governance in General Programming Languages (Javier Luis Cánovas Izquierdo, Jordi Cabot) T4A T5E T5H
• (SLE 2020) A Family of Languages for Trustworthy Agent-Based Simulation (Steffen Zschaler, Fiona Polack) T3C T4A T5E
• (SLE 2020) Principles and Patterns of JastAdd-style Reference Attribute Grammars (Niklas Fors, Emma Söderberg, Görel Hedin) T3A T4A T5E T5H
• (SLE 2020) Towards the Optical Character Recognition of DSLs (Jorge Perianez-Pascual, Roberto Rodríguez-Echeverría, Lola Burgueño, Jordi Cabot) T3C T4A T5E
• (SLE 2020) Monadification of Attribute Grammars (Dawn Michaelson, Eric Van Wyk) T1B T4A T5D T5E
• (SLE 2020) Behavior Trees in Action: A Study of Robotics Applications (Razan Ghzouli, Thorsten Berger, Einar Broch Johnsen, Swaib Dragule, Andrzej Wąsowski) T4A T5E T1D T6B
• (SLE 2021) Automating the Synthesis of Recommender Systems for Modelling Languages (Lissette Almonte, Sara Pérez-Soler, Esther Guerra, Iván Cantador, Juan de Lara) T3C T4A T5D T5E
• (SLE 2021) Executing Certified Model Transformations on Apache Spark (Jolan Philippe, Massimo Tisi, Hélène Coullon, Gerson Sunyé) T3B T4A T5D T5E
• (SLE 2021) Fast Incremental PEG Parsing (Zachary Yedidia, Stephen Chong) T1A T4A T5E T1D
• (SLE 2021) FIDDLR: Streamlining Reuse with Concern-Specific Modelling Languages (Maximilian Schiedermeier, Jörg Kienzle, Bettina Kemme) T3C T4A T5E T1D
• (SLE 2022) jGuard: Programming Misuse-Resilient APIs (Simon Binder, Krishna Narasimhan, Svenja Kernig, Mira Mezini) T3F T4C T4D T5E
• (SLE 2022) Neural Language Models and Few Shot Learning for Systematic Requirements Processing in MDSE (Vincent Bertram, Miriam Boß, Evgeny Kusmenko, Imke Helene Nachmann, Bernhard Rumpe, Danilo Trotta, Louis Wachtmeister) T4G T5A T3C T5E
• (SLE 2023) A Reference GLL Implementation (Adrian Johnstone) T4A T5F T5E
• (SLE 2024) Towards an In-Context LLM-Based Approach for Automating the Definition of Model Views (James Pontes Miranda, Hugo Brunelière, Massimo Tisi, Gerson Sunyé) T4G T4B T3C T5E
• (SLE 2024) DSLs in Racket: You Want It How, Now? (Yong-Seuk Lee, Kiran Gopinathan, Ziyi Yang, Matthew Flatt, Ilya Sergey) T3C T6A T3A T5E
• (SLE 2024) Trading Runtime for Energy Efficiency: Leveraging Power Caps to Save Energy across Programming Languages (Simão Cunha, Luís Silva, João Saraiva, João Paulo Fernandes) T5F T5E T3D
• (SLE 2024) Cloud Programming Languages and Infrastructure from Code: An Empirical Study (Georg Simhandl, Uwe Zdun) T5E T5H T2D T3F
• (SLE 2024) Statically and Dynamically Delayed Sampling for Typed Probabilistic Programming Languages (Gizem Çaylak, Daniel Lundén, Viktor Senderov, David Broman) T1B T4C T4D T5E
• (SLE 2024) Bugfox: A Trace-Based Analyzer for Localizing the Cause of Software Regression in JavaScript (Yuefeng Hu, Hiromu Ishibe, Feng Dai, Tetsuro Yamazaki, Shigeru Chiba) T5C T2B T4B T5E
• (SLE 2024 SI) A language-parametric test coverage framework for executable domain-specific languages (Faezeh Khorram, Erwan Bousse, Antonio Garmendía, Jean-Marie Mottu, Gerson Sunyé, Manuel Wimmer) T5C T3C T4A T5E
• (SLE 2024 SI) Spectrum-based rule- and item-level localization of faults in context-free grammars (Moeketsi Raselimo, Bernd Fischer) T5B T5C T5E
• (SLE 2024 SI) Grammar-based test suite construction using coverage-directed algorithms over LR-graphs (Christoff Rossouw, Bernd Fischer) T5C T5B T5E
• (SLE 2025) Detecting Resource Leaks on Android with Alpakka (Gustavo Soares Santos, João Bispo, Alexandra Mendes) T4B T2B T5E

---

The page is maintained by Dr. Vadim Zaytsev a.k.a. @grammarware. Last updated: June 2026.