Kathryn Thomasset Stolee

Works (22)

Updated: August 2nd, 2025 05:02

2025 article

Analyzing the dependability of Large Language Models for code clone generation

Eagal, A., Stolee, K. T., & Ore, J.-P. (2025, July 4). Journal of Systems and Software.

By: A. Eagal n, K. Stolee n & J. Ore n

author keywords: Machine learning for software engineering; Software quality assurance; Software measurement and analytics
topics (OpenAlex): Software Engineering Research; Software Reliability and Analysis Research; Scientific Computing and Data Management
Source: Web Of Science
Added: July 28, 2025

2024 article

Co-Designing Web Interfaces for Code Comparison

Middleton, J., Patil, N., & Stolee, K. T. (2024, September 2).

By: J. Middleton n, N. Patil n & K. Stolee n

topics (OpenAlex): Web Applications and Data Management; Model-Driven Software Engineering Techniques
Source: Web Of Science
Added: March 10, 2025

2024 article

Evaluating the Effectiveness of a Testing Checklist Intervention in CS2: An Quasi-experimental Replication Study

Bai, G. R., Jiang, Z., Price, T. W., & Stolee, K. T. (2024, August 6). 20TH ANNUAL ACM CONFERENCE ON INTERNATIONAL COMPUTING EDUCATION RESEARCH, ICER 2024, VOL 1, pp. 55–64.

By: G. Bai *, Z. Jiang*, T. Price n  & K. Stolee n

author keywords: unit testing; testing education; checklist
topics (OpenAlex): Innovative Teaching and Learning Methods; Teaching and Learning Programming; Online Learning and Analytics
Sources: Web Of Science, ORCID, NC State University Libraries
Added: August 8, 2024

2023 article

An Experience Report on Introducing Explicit Strategies into Testing Checklists for Advanced Beginners

Bai, G. R., Sthapit, S., Heckman, S., Price, T. W., & Stolee, K. T. (2023, June 29). PROCEEDINGS OF THE 2023 CONFERENCE ON INNOVATION AND TECHNOLOGY IN COMPUTER SCIENCE EDUCATION, ITICSE 2023, VOL 1, pp. 194–200.

By: G. Bai*, S. Sthapit n, S. Heckman n , T. Price n  & K. Stolee n

author keywords: unit testing; testing education; checklist
topics (OpenAlex): Teaching and Learning Programming; Software Testing and Debugging Techniques; Software Engineering Research
TL;DR: Improved the checklist by integrating explicit testing strategies to it (ETS Checklist), which provide step-by-step guidance on how to transfer semantic information from instructions to the possible testing scenarios, and observed students' unawareness of their need for help in writing high-quality tests. (via Semantic Scholar)
UN Sustainable Development Goals Color Wheel
UN Sustainable Development Goal Categories
4. Quality Education (Web of Science; OpenAlex)
Sources: Web Of Science, ORCID, NC State University Libraries
Added: July 1, 2023

2023 article

Fair Enough: Searching for Sufficient Measures of Fairness

Majumder, S., Chakraborty, J., Bai, G. R., Stolee, K. T., & Menzies, T. (2023, March 16). ACM Transactions on Software Engineering and Methodology, Vol. 32.

By: S. Majumder n, J. Chakraborty n, G. Bai n, K. Stolee n & T. Menzies n 

author keywords: Software fairness; fairness metrics; clustering; theoretical analysis; empirical analysis
topics (OpenAlex): Ethics and Social Impacts of AI; Adversarial Robustness in Machine Learning; Explainable Artificial Intelligence (XAI)
TL;DR: This article shows that many of those fairness metrics effectively measure the same thing, and it is no longer necessary (or even possible) to satisfy all fairness metrics. (via Semantic Scholar)
Sources: Web Of Science, ORCID, NC State University Libraries
Added: October 31, 2023

2023 article

Improving Grading Outcomes in Software Engineering Projects Through Automated Contributions Summaries

Presler-Marshall, K., Heckman, S., & Stolee, K. T. (2023, May 1). 2023 IEEE/ACM 45TH INTERNATIONAL CONFERENCE ON SOFTWARE ENGINEERING-SOFTWARE ENGINEERING EDUCATION AND TRAINING, ICSE-SEET, pp. 259–270.

By: K. Presler-Marshall*, S. Heckman n  & K. Stolee n

author keywords: grading consistency; program analysis; software engineering teams
topics (OpenAlex): Software Engineering Research; Online Learning and Analytics; Software Engineering Techniques and Practices
TL;DR: Improvements to grading practises in the context of a CS1.5 introductory software engineering course, where assessing individual students’ contributions to weekly lab assignments is done manually by teaching assistants (TAs), is studied. (via Semantic Scholar)
UN Sustainable Development Goals Color Wheel
UN Sustainable Development Goal Categories
4. Quality Education (Web of Science)
Sources: Web Of Science, NC State University Libraries
Added: August 21, 2023

2022 article

Check It Off

Bai, G. R., Presler-Marshall, K., Price, T. W., & Stolee, K. T. (2022, July 7). PROCEEDINGS OF THE 27TH ACM CONFERENCE ON INNOVATION AND TECHNOLOGY IN COMPUTER SCIENCE EDUCATION, ITICSE 2022, VOL 1, pp. 276–282.

By: G. Bai n, K. Presler-Marshall n, T. Price n  & K. Stolee n

author keywords: unit testing; testing education; checklist
topics (OpenAlex): Software Testing and Debugging Techniques; Software Engineering Research; Teaching and Learning Programming
TL;DR: A lightweight testing checklist that contains both tutorial information and testing strategies to guide students in what and how to test is presented, suggesting that the testing tool support does not need to be sophisticated to be effective. (via Semantic Scholar)
UN Sustainable Development Goals Color Wheel
UN Sustainable Development Goal Categories
4. Quality Education (OpenAlex)
Sources: Web Of Science, NC State University Libraries
Added: August 28, 2023

2022 article

Identifying Struggling Teams in Software Engineering Courses Through Weekly Surveys

Presler-Marshall, K., Heckman, S., & Stolee, K. T. (2022, February 22). Proceedings of the 53rd ACM Technical Symposium on Computer Science Education, pp. 126–132.

By: K. Presler-Marshall n, S. Heckman n  & K. Stolee n

author keywords: software engineering education; team projects; peer evaluations; surveys; course interventions
topics (OpenAlex): Software Engineering Techniques and Practices; Innovative Teaching and Learning Methods; Teaching and Learning Programming
TL;DR: A weekly reflection survey is proposed to help the course teaching staff proactively identify teams that may not be on track to learn the course outcomes and may provide instructors with an actionable early-warning about struggling teams. (via Semantic Scholar)
UN Sustainable Development Goals Color Wheel
UN Sustainable Development Goal Categories
4. Quality Education (Web of Science; OpenAlex)
Sources: Web Of Science, NC State University Libraries
Added: December 12, 2022

2021 article

Cross-language code search using static and dynamic analyses

Mathew, G., & Stolee, K. T. (2021, August 18).

By: G. Mathew n & K. Stolee n

author keywords: code-to-code search; cross-language code search; non-dominated sorting; static analysis; dynamic analysis
topics (OpenAlex): Software Engineering Research; Advanced Malware Detection Techniques; Software Reliability and Analysis Research
TL;DR: It is found that code search based on non-dominated ranking of static and dynamic similarity measures is more effective compared to single or weighted measures and COSAL has better precision and recall compared to state-of-the-art within-language and cross-language code-tocode search tools. (via Semantic Scholar)
Source: Web Of Science
Added: March 7, 2022

2021 article

Demystifying regular expression bugs

Wang, P., Brown, C., Jennings, J. A., & Stolee, K. T. (2021, November 5). Empirical Software Engineering, Vol. 27.

By: P. Wang, C. Brown *, J. Jennings n  & K. Stolee n

author keywords: Regular expression bug characteristics; Pull requests; Bug fixes; Test code
topics (OpenAlex): Software Engineering Research; Web Application Security Vulnerabilities; Software Testing and Debugging Techniques
TL;DR: An empirical study of 356 regex-related bugs from merged pull requests in Apache, Mozilla, Facebook, and Google GitHub repositories identifies and classify the nature of the regular expression problems, the fixes, and the related changes in the test code. (via Semantic Scholar)
UN Sustainable Development Goals Color Wheel
UN Sustainable Development Goal Categories
16. Peace, Justice and Strong Institutions (OpenAlex)
Sources: Web Of Science, NC State University Libraries
Added: November 15, 2021

2021 article

SQLRepair: Identifying and Repairing Mistakes in Student-Authored SQL Queries

Presler-Marshall, K., Heckman, S., & Stolee, K. (2021, May 1). 2021 IEEE/ACM 43RD INTERNATIONAL CONFERENCE ON SOFTWARE ENGINEERING: JOINT TRACK ON SOFTWARE ENGINEERING EDUCATION AND TRAINING (ICSE-JSEET 2021), pp. 199–210.

By: K. Presler-Marshall n, S. Heckman n  & K. Stolee n

topics (OpenAlex): Software Engineering Research; Software Testing and Debugging Techniques; Scientific Computing and Data Management
TL;DR: The results show that students find repairs produced by the tool comparable in understandability to queries written by themselves or by other students, suggesting that SQL repair tools may be useful in an educational context. (via Semantic Scholar)
UN Sustainable Development Goals Color Wheel
UN Sustainable Development Goal Categories
4. Quality Education (Web of Science; OpenAlex)
Sources: Web Of Science, NC State University Libraries
Added: November 8, 2021

2020 article

SLACC

Mathew, G., Parnin, C., & Stolee, K. T. (2020, June 27).

By: G. Mathew n, C. Parnin n & K. Stolee n

author keywords: semantic code clone detection; cross-language analysis
topics (OpenAlex): Software Engineering Research; Software Reliability and Analysis Research; Advanced Malware Detection Techniques
TL;DR: Like prior clone detection techniques, this work uses input/output behavior to match clones, though it overcome limitations of prior work by amplifying the number of inputs and covering more data types; and as a result, achieve better clusters than prior attempts. (via Semantic Scholar)
Source: Web Of Science
Added: June 21, 2021

2019 article

SOSRepair: Expressive Semantic Search for Real-World Program Repair

Afzal, A., Motwani, M., Stolee, K. T., Brun, Y., & Goues, C. L. (2019, October 1). IEEE Transactions on Software Engineering.

By: A. Afzal *, M. Motwani *, K. Stolee n, Y. Brun * & C. Goues *

author keywords: Maintenance engineering; Semantic search; Encoding; Benchmark testing; Computer bugs; Software; Automated program repair; semantic code search; patch quality; program repair quality; SOSRepair
topics (OpenAlex): Software Testing and Debugging Techniques; Software Engineering Research; Software Reliability and Analysis Research
TL;DR: SOSRepair is an automated program repair technique that uses semantic code search to replace candidate buggy code regions with behaviorally-similar (but not identical) code written by humans, and is the first such technique to scale to real-world defects in real- world systems. (via Semantic Scholar)
Source: Web Of Science
Added: November 1, 2021

2018 article

10+ years of teaching software engineering with itrust

Heckman, S., Stolee, K. T., & Parnin, C. (2018, May 27). 2018 IEEE/ACM 40TH INTERNATIONAL CONFERENCE ON SOFTWARE ENGINEERING: SOFTWARE ENGINEERING EDUCATION AND TRAINING (ICSE-SEET), pp. 1–4.

By: S. Heckman n , K. Stolee n & C. Parnin n

author keywords: software engineering education; iTrust
topics (OpenAlex): Experimental Learning in Engineering; Problem and Project Based Learning; Software Engineering Techniques and Practices
TL;DR: From the lessons learned, the course structure and the course project, iTrust, that has been developed by students over 25 semesters are provided and course improvements are presented as they prepare for the next ten years of software engineering courses. (via Semantic Scholar)
Sources: Web Of Science, NC State University Libraries
Added: November 5, 2018

2018 article

Automated program repair with canonical constraints

Hill, A., Păsăreanu, C. S., & Stolee, K. T. (2018, May 27).

By: A. Hill  n, C. Păsăreanu * & K. Stolee n

author keywords: Symbolic Execution; SPF; Program Repair; Semantic Repair
topics (OpenAlex): Software Testing and Debugging Techniques; Software Reliability and Analysis Research; Software Engineering Research
TL;DR: Canonical Search And Repair (CSAR), a program repair technique based on semantic search which uses a canonical form of the path conditions to characterize buggy and patch code and allows for easy storage and retrieval of software patches, without the need for expensive constraint solving is proposed. (via Semantic Scholar)
Source: Web Of Science
Added: December 3, 2018

2018 article

Evaluating how developers use general-purpose web-search for code retrieval

Rahman, M. M., Barson, J., Paul, S., Kayani, J., Lois, F. A., Quezada, S. F., … Ray, B. (2018, May 28).

By: M. Rahman*, J. Barson*, S. Paul*, J. Kayani n, F. Lois, S. Quezada, C. Parnin n, K. Stolee n, B. Ray *

topics (OpenAlex): Software Engineering Research; Web Data Mining and Analysis; Open Source Software Innovations
TL;DR: Whether a general purpose search engine like Google is an optimal choice for code-related searches is explored, and whether the performance of searching with Google varies for code vs. non-code related searches is investigated. (via Semantic Scholar)
Source: Web Of Science
Added: March 4, 2019

2018 article

How well are regular expressions tested in the wild?

Wang, P., & Stolee, K. T. (2018, October 26).

By: P. Wang n & K. Stolee n

author keywords: Regular expressions; Test coverage metrics; Deterministic Finite Automaton
topics (OpenAlex): Software Testing and Debugging Techniques; Software Engineering Research; Advanced Malware Detection Techniques
Source: Web Of Science
Added: March 25, 2019

2017 conference paper

At the end of synthesis: Narrowing program candidates

2017 IEEE/ACM 39th International Conference on Software Engineering: New Ideas and Emerging Technologies Results Track (ICSE-NIER), 19–22.

By: D. Shriver, S. Elbaum & K. Stolee

Source: NC State University Libraries
Added: August 6, 2018

2016 conference paper

Exploring crowd consistency in a mechanical turk survey

2016 IEEE/ACM 3rd International Workshop on Crowdsourcing in Software Engineering (CSI-SE), 8–14.

By: P. Sun & K. Stolee

Source: NC State University Libraries
Added: August 6, 2018

2016 conference paper

Smells in block-based programming languages

2016 ieee symposium on visual languages and human-centric computing (vl/hcc), 68–72.

By: F. Hermans, K. Stolee & D. Hoepelman

Source: NC State University Libraries
Added: August 6, 2018

2015 journal article

Code search with input/output queries: Generalizing, ranking, and assessment

Journal of Systems and Software, 116, 35–48.

By: K. Stolee*, S. Elbaum * & M. Dwyer *

author keywords: Semantic code search; Symbolic execution; SMT solvers
topics (OpenAlex): Software Engineering Research; Software Testing and Debugging Techniques; Software Reliability and Analysis Research
TL;DR: A tool was implemented, Satsy, that uses symbolic execution to encode multi-path programs as constraints and a novel ranking algorithm based on the strength of the match between an input/output query and the program paths traversed by symbolic execution. (via Semantic Scholar)
Source: Crossref
Added: February 24, 2020

2012 journal article

Discovering how end-user programmers and their communities use public repositories: A study on Yahoo! Pipes

Information and Software Technology, 55(7), 1289–1303.

By: K. Stolee*, S. Elbaum * & A. Sarma *

author keywords: End-user programmers; Community analysis; Artifact repositories; Web mashups; Diversity analysis
topics (OpenAlex): Open Source Software Innovations; Spreadsheets and End-User Computing; Software Engineering Research
TL;DR: It is discovered that end-user programmers do not effectively reuse existing programs, submit pipes that are highly similar to others already in the repository, and in most cases do not have an awareness of the community or the richness of artifacts that exist in repositories. (via Semantic Scholar)
Source: Crossref
Added: August 28, 2020

Citation Index includes data from a number of different sources. If you have questions about the sources of data in the Citation Index or need a set of data which is free to re-distribute, please contact us.

Certain data included herein are derived from the Web of Science© and InCites© (2026) of Clarivate Analytics. All rights reserved. You may not copy or re-distribute this material in whole or in part without the prior written consent of Clarivate Analytics.