program-repair/program-repair.github.io

Automated program repair bibliography, tools and benchmarks.

program-repair.org

This website is a community-driven effort to provide up-to-date automated program repair bibliography, and links to publicly available tools and benchmarks.

Content Policy

The bibliography section lists publications on automated program repair that are

• peer-reviewed;
• designed/evaluated for program repair.

The bibliographic records on this website are automatically extracted from dblp.org.

The tools/benchmarks sections list only tools/benchmarks that

• have corresponding publications in the bibliography section;
• are publicly available;
• are designed/evaluated for program repair.

The website hosts community pages — static webpages that present some useful information about program repair, e.g. visualise experiments. If you would like to maintain a community page under program-repair.org, please create an issue.

Contributions

The easiest way to contribute is to submit a new publication/tool/benchmark via GitHub issues. When submitting an issue, please provide the puiblication's DBLP key. To obtain the DBLP key, find the publication on dblp.org, and hover your mouse over "export record". To submit a new tool or benchmark, please provide the DBLP key of its corresponding publication. Note that publications appear on DBLP with a delay.

Alternatively, you can create a pull request. For that, you need to add your data into program-repair.org's database stored in the data directory, and then regenerate the website. Note that when making simple changes, you can skip regenerating the website, because it will be done automatically by GitHub actions, but generally we recommend regenerating website to test your changes before creating a PR. If you want to verify your modifications locally, please:

1. install Python 3 and dependencies (e.g. pip3 install -r requirements.txt);
2. run build script (e.g. python3 build.py);
3. open index.html in your browser to verify your modifications.

Maintenance

Mainteners routinary check for new program repair papers that appear in the venues below:

SE journals:

• Transactions on Software Engineering (TSE)
• Transactions on Software Engineering and Methodology (TOSEM)
• Empirical Software Engineering (EMSE)

SE conferences:

• International Conference on Software Engineering (ICSE)
• Conference on the Foundations of Software Engineering (FSE)
• International Conference on Automated Software Engineering (ASE)
• International Symposium on Software Testing and Analysis (ISSTA)
• International Conference on Software Analysis, Evolution, and Reengineering (SANER)
• International Conference on Software Testing, Verification, and Validation (ICST)
• Working Conference on Mining Software Repositories (MSR)

PL conferences:

• Symposium on Programming Language Design and Implementation (PLDI)
• Symposium on Principles of Programming Languages (POPL)
• International Conference on Object-Oriented Programming Systems, Languages, and Applications (OOPSLA)
• European Conference on Object-Oriented Programming (ECOOP)

FM conferences:

• International Conference on Computer Aided Verification (CAV)
• International Conference on Tools and Algorithms for Construction and Analysis of Systems (TACAS)

ML conferences:

• International Conference on Machine Learning (ICML)
• International Conference on Learning Representations (ICLR)

Workshops:

• Workshop on Automated Program Repair (APR)
• International Genetic Improvement Workshop (GI)

program-repair.github.io's Issues

tool

I would like to add the following tool:

• Name:
• One line description:
• Target: [e.g. C/C++, Java, Binaries]
• DBPL key: [e.g. journals/tse/GouesNFW12]
• Website:
• Repository (optional):

Add new publication: Experience Report: How Effective is Automated Program Repair for Industrial Software?

I would like to add the following publication:

• DBLP key: [conf/wcre/NodaNHTK20]

C-Pack-IPAs

I would like to add the following benchmark:

• Name: C-Pack-IPAs
• One line description: A C90 Program Benchmark of Introductory Programming Assignments
• Target: C (C90)
• DBPL key: journals/corr/abs-2206-08768
• Website: https://github.com/pmorvalho/C-Pack-IPAs
• Repository (optional): https://github.com/pmorvalho/C-Pack-IPAs

Add ICML 2021 paper: conf/icml/BerabiHRV21

I would like to add the following publication:

• DBLP key: conf/icml/BerabiHRV21
• Title: TFix: Learning to Fix Coding Errors with a Text-to-Text Transformer
• Conference: ICML 2021
• Authors: Berkay Berabi, Jingxuan He, Veselin Raychev, Martin T. Vechev

Thanks!

Adding tool "NEM"

I would like to add the following tool:

• Name: NEM
• One line description: Automated Repair of Heap-Manipulating Programs using Deductive Synthesis
• Target: C
• DBPL key: conf/vmcai/NguyenTSC21
• Website: https://nem-repair-tool.github.io
• Repository (optional): https://github.com/nem-repair-tool/heap-repair

ssFix (ASE17)

I would like to add the following tool:

• Name: ssFix
• One line description: Syntax-directed Code Search-Based Automated Repair Tool
• Target: Java
• DBPL key: conf/kbse/XinR17
• Website: https://github.com/qixin5/ssFix
• Repository (optional): https://github.com/qixin5/ssFix

Adding New Publication (Impact of Combining Syntactic and Semantic Similarities on Patch Prioritization)

I would like to add the following publication:

DBLP key: conf/enase/AsadGS20

Thanks in advance.

I CANT

I would like to add the following tool:

• Name:
• One line description:
• Target: [e.g. C/C++, Java, Binaries]
• DBPL key: [e.g. journals/tse/GouesNFW12]
• Website:
• Repository (optional):

kGenProg: A High-performance, High-extensibility and High-portability APR System

I would like to add the following tool:

• Name: kGenProg
• One line description: automated program repair tool written in Java for Java
• Target: [e.g. C/C++, Java, Binaries] Java
• DBPL key: [e.g. journals/tse/GouesNFW12] conf/apsec/HigoMATNMTK18
• Website: https://github.com/kusumotolab/kGenProg
• Repository (optional): https://github.com/kusumotolab/kGenProg

Submitting a new repair tool: SimFix

{
"name": "SimFix",
"description": "Fixing Java bugs by leveraging existing patches and similar code",
"url": "https://github.com/xgdsmileboy/SimFix",
"target": "Java",
"title": "Shaping Program Repair Space with Existing Patches and Similar Code",
"authors": "Jiajun Jiang, Yingfei Xiong, Hongyu Zhang, Qing Gao, Xiangqun Chen",
"venue": "ISSTA'18: The 27th International Symposium on Software Testing and Analysis",
"year": "2018"
}

creating README.md

Hi Sergey,

For better visibility and information, what do you think of merging Administration.md and Contribution.md in README.md?

--Martin

A Position Paper on Addressing the Overfitting Problem of Program Repair

I would like to add the following publication:

• DBLP key: journals/chinaf/RoychoudhuryX19

[New Publication] Applying CodeBERT for Automated Program Repair of Java Simple Bugs.

I would like to add the following publication:

• DBLP key: journals/corr/abs-2103-11626
• DBLP link: https://dblp.org/rec/journals/corr/abs-2103-11626.html

iFixR: bug report driven program repair

I would like to add the following publication:

• DBLP key: conf/sigsoft/KoyuncuLB0MKT19

Adding paper "HIPPODROME: Data Race Repair using Static Analysis Summaries"

I would like to add the following publication:

• DBLP key: journals/corr/abs-2108-02490

Add FixMorph

I would like to add the following tool:

• Name: FixMorph
• One line description: automated patch backporting tool for syntactically similar programs (i.e. across different versions)
• Target: C/C++
• DBPL key: conf/issta/ShariffdeenGDTL21
• Website: https://fixmorph.github.io/
• Repository (optional): https://github.com/rshariffdeen/FixMorph

Automatic Program Repair using Formal Verification and Expression Templates

I would like to add the following publication:

• DBLP key: [DBLP:conf/vmcai/NguyenTC19]

feature: generate rss.xml

Hi all,

In addition to generating we could generate a file rss.xml that we would then use in our favorite feed readers.

WDYT?

Automated Program Repair

I would like to add the following publication:

• DBLP key: journals/cacm/GouesPR19

Add a new publication

I would like to add the following publication:
Yihao Qin, Shangwen Wang, Kui Liu, Xiaoguang Mao, Tegawendé F. Bissyandé:
On the Impact of Flaky Tests in Automated Program Repair. SANER 2021: 295-306

• DBLP key: [SANER2021]
  https://dblp.org/rec/conf/wcre/QinW0MB21.html

Add Figra publication

I would like to add the following publication:

• DBLP key: DBLP:conf/icse-apr/FonsecaO22

Would you add my publication?

I would like to add the following publication:

Automatic Software Merging using Automated Program Repair
Xiaoqian Xing; Katsuhisa Maruyama
1st International Workshop on Intelligent Bug Fixing (IBF)
-https://ieeexplore.ieee.org/abstract/document/8665493

New publication for automatic program repair

I would like to add the following publication:

• DBLP key: [journals/chinaf/JiangXX19]

Thanks!

New program repair paper and tool on ASE'19

I would like to add the following publication

• DOI: 10.1109/ASE.2019.00033

and the corresponding tool:

• Name: GenPat
• One line description: Inferring program transformation from historical bug fixes via big code
• Target: [Java]
• DBPL key:
• Website:
• Repository (optional): https://github.com/xgdsmileboy/GenPat

New publication

I would like to add the following publication:

• DBLP key: [conf/esem/WangWCYM19]

Submitting a program repair tool: QACrashFix

{
"name": "QACrashFix",
"description": "Fixing Java crash bugs by querying StackOverflow",
"url": "http://sei.pku.edu.cn/~gaoqing11/qacrashfix/",
"target": "Java source code",
"title": "Fixing Recurring Crash Bugs via Analyzing Q&A Sites",
"authors": " Qing Gao, Hansheng Zhang, Jie Wang, Yingfei Xiong, Lu Zhang, Hong Mei",
"venue": "ASE'15: 30th IEEE/ACM International Conference on Automated Software Engineering",
"year": "2015"
}

DLFix: context-based code transformation learning for automated program repair. ICSE 2020

I would like to add the following publication:

Yi Li, Shaohua Wang, Tien N. Nguyen:
DLFix: context-based code transformation learning for automated program repair. ICSE 2020: 602-614

with a DBLP key: conf/icse/Li0N20

Add PatchBackporting Paper

I would like to add the following publication:

• DBLP key: conf/issta/ShariffdeenGDTL21

Request : add this APR research.

I would like to add the following publication:
Applying deep learning algorithm to automatic bug localization and repair

• DBLP key: (https://doi.org/10.1145/3341105.3374005)

PraPR

I would like to add the following tool:

• Name: PraPR
• One line description: fast JVM bytecode-level, template-/mutation-based APR
• Target: JVM Languages (e.g., Java, Kotlin, etc.)
• DBPL key:
  https://dblp.org/rec/conf/issta/GhanbariBZ19.html
  https://dblp.org/rec/conf/kbse/GhanbariZ19.html
• Website: https://github.com/prapr/prapr
• Repository (optional):

Add PatchWeave

I would like to add the following tool:

• Name: PatchWeave
• One line description: automated patch transplantation for semantically equivalent programs
• Target: C/C++
• DBPL key: journals/tosem/ShariffdeenTGR21
• Website: https://patchweave.github.io/
• Repository (optional): https://github.com/rshariffdeen/patchweave

Exterminator: automatically correcting memory errors with high probability

I would like to add the following publication:

• DBLP key: conf/pldi/NovarkBZ07, journals/cacm/NovarkBZ08 (the second is the same title, CACM Research Highlight)

Getafix: Learning to Fix Bugs Automatically

I would like to add the following publication:

• DBLP key: [e.g. journals/corr/abs-1902-06111]

Contract-Based Program Repair without The Contracts: An Extended Study

I would like to add the following publication:

• DOI: 10.1109/TSE.2020.2970009

adding APR publication

I would like to add the following publication:

• DBLP key: https://dblp.org/rec/journals/software/KirbasWMKPSNWCB21

Serkan Kirbas, et al
On The Introduction of Automatic Program Repair in Bloomberg. IEEE Softw. 38(4): 43-51 (2021)

add a new C/C++ benchmark (Defects4Cpp)

I would like to add the following benchmark:

• Name: Defects4Cpp
• One line description: A benchmark/infrastructure for C/C++ defects providing similar interfaces to Defects4J
• Target: C/C++
• DBPL key:
• Website: https://github.com/Suresoft-GLaDOS/defects4cpp
• Repository (optional): https://github.com/Suresoft-GLaDOS/defects4cpp

Add new publication: "Sirius: Static Program Repair with Dependence Graph-Based Systematic Edit Patterns"

I would like to add the following publication:

• DBLP key: conf/icsm/NodaYK21

Thank you.

Adding New Paper (Impact Analysis of Syntactic and Semantic Similarities on Patch Prioritization in Automated Program Repair)

I would like to add the following publication:

• DBLP key: conf/icsm/AsadGS19

Would you please add my publication? Thanks!

I would like to add the following publication:

Interactive Patch Filtering as Debugging Aid

• DBLP key: [conf/icsm/LiangJJZL0021]

New program repair related paper on ISSRE’19

I would like to add the following publication:

• DOI: 10.1109/ISSRE.2019.00016
• DBLP key: conf/issre/LiangHZ0X019

08987552.pdf

Must fault localization for program repair

Please add our publication:
"Must Fault Localization for Program Repair"
DBLP key: conf/cav/RothenbergG20

Thank you

Wrong important dates for APR@ICSE 2020

Hi!

The submission and notification dates seem to be wrong since the notification is before the submission deadline:

Submission deadline: February 28, 2020
Notification: January 22, 2020

[New publication] Compilation error repair: for the student programs, from the student programs

I would like to add the following publication:

• DBLP key: conf/icse/AhmedKKKG18
• DBLP link: https://dblp.org/rec/conf/icse/AhmedKKKG18

add FAngelix

I would like to add the following tool:

• Name: FAngelix
• One line description: Faster Angelix that performs a guided search based on MCMC sampling.
• Target: C/C++
• DBPL key: journals/infsof/YiI22
• Website: https://github.com/jyi/fangelix
• Repository (optional): https://github.com/jyi/fangelix

moving to program-repair.org

Dear All,

The previous owner of program-repair.org contributed this domain to our community. I think this is a good opportunity to simplify our name. I am going to maintain this domain for now. The website will be also available under the old name for at least one year.

Please update your local repository remote url:

git remote set-url origin https://github.com/program-repair/program-repair.github.io.git

Adding large dataset of (in)correct Python programs by students

I would like to add the following benchmark:

• Name: Refactory
• One line description: program repair evaluation dataset of 1783 buggy and 2442 correct student submissions for 5 Python programming assignments
• Target: Python
• DBPL key: [conf/kbse/HuAMLR19]
• Website: https://github.com/githubhuyang/refactory
• Repository (optional): https://github.com/githubhuyang/refactory

Add ITSP benchmark

I would like to add the following benchmark:

• Name: ITSP
• One line description: A parallel corpus of 661 buggy-repaired program pairs submitted by CS-1 students for 74 unique assignments spread across 10 course weeks
• Target: C
• DBPL key: conf/sigsoft/YiAKTR17
• Website: https://github.com/jyi/ITSP#dataset-student-programs
• Repository (optional): https://github.com/jyi/ITSP

add CPR

I would like to add the following tool:

• Name: CPR
• One line description: detecting and discarding over-fitting patches via systematic co-exploration of the patch space and input space
• Target: C/C++
• DBPL key: conf/pldi/ShariffdeenNGR21
• Website: cpr-tool.github.io
• Repository (optional): https://github.com/rshariffdeen/cpr

adding "Automated Repair of Heap-Manipulating Programs Using Deductive Synthesis"

I would like to add the following publication:

"Automated Repair of Heap-Manipulating Programs Using Deductive Synthesis"
Thanh-Toan Nguyen, Quang-Trung Ta, Ilya Sergey & Wei-Ngan Chin

• https://doi.org/10.1007/978-3-030-67067-2_17
• DBLP key: https://dblp.org/rec/conf/vmcai/NguyenTSC21

Add tool "HIPPODROME"

I would like to add the following tool:

• Name: HIPPODROME
• One line description: HIPPODROME statically detects and fixes data race conditions for small to large scale Java programs
• Target: Java
• DBPL key: journals/corr/abs-2108-02490
• Website: https://github.com/verse-lab/hippodrome
• Repository (optional): https://github.com/verse-lab/hippodrome