squareslab/darjeeling

Language-independent, search-based program repair -- just your cup of tea! ☕

darjeeling's Issues

Tidy up problem module

Add SourceManager class for querying and manipulating files, and caching their contents.

Implement greedy algorithm described in CT's thesis

Add MyPy to Travis config

Add terminate_early parameter to evaluate method

Exclude code outside function definitions from consideration

Separate donor code pool from Problem class

Exploit liveness analysis provided by Kaskara to prevent insertion of dead code

Add __repr__ and __str__ to Localization

Prevent self-replacement of statements

Add test cases for localization module

Candidate transformations should be represented as an immutable sequence (i.e., tuple) rather than an immutable set (i.e., frozenset)

Replace "AppendStatement" with "PrependStatement"

Avoids the need to compute live_after (which isn't exposed by Clang).

Add short identifiers to candidate patches to make debugging easier

Add ability to perform test ordering

It should be possible to order tests by their expected likelihood of failure, resource consumption, or a combination of both.

Add method for determining referenced labels in a code snippet to analysis module

Should accept a code snippet and return a set of labels.

def find_referenced_labels(snippet: str) -> Set[str]:
    ...

Or, better yet, it should return a use set and a def set of labels.

Add ability to use canonical forms of snippets (i.e., ignore duplicate string-equivalent snippets)

Add magic comment for file encoding to all source files

Don't append code immediately after a return statement.

Add history method to searcher for returning sequence of attempted patches

Add --ignore-decls option to prevent insertion or modification of declarations

Should prevent the insertion of DeclStmt and the deletion/replacement of DeclStmt, but should allow other statements that contain declarations to be modified.

Add PyPI automated uploads to Travis config

Should automatically publish all tagged releases on PyPI.

Add support for syntax scope checking

Do not insert typed returns into void functions (and vice versa)

Add ability to exclude certain files from fault localisation to configuration file

Unexpected error during teardown when using multiple threads

found 1 plausible patches
time taken: 0.08 minutes
# test evaluations: 10
# candidate evaluations: 6
unexpected exception when evaluating candidate: Candidate<#13d69559>
Traceback (most recent call last):
  File "/home/chris/.local/share/virtualenvs/darjeeling-KYygC-ZZ/lib/python3.6/site-packages/urllib3/connectionpool.py", line 601, in urlopen
    chunked=chunked)
  File "/home/chris/.local/share/virtualenvs/darjeeling-KYygC-ZZ/lib/python3.6/site-packages/urllib3/connectionpool.py", line 387, in _make_request
    six.raise_from(e, None)
  File "<string>", line 2, in raise_from
  File "/home/chris/.local/share/virtualenvs/darjeeling-KYygC-ZZ/lib/python3.6/site-packages/urllib3/connectionpool.py", line 383, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.6/http/client.py", line 1331, in getresponse
    response.begin()
  File "/usr/lib/python3.6/http/client.py", line 297, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.6/http/client.py", line 266, in _read_status
    raise RemoteDisconnected("Remote end closed connection without"
http.client.RemoteDisconnected: Remote end closed connection without response

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/chris/.local/share/virtualenvs/darjeeling-KYygC-ZZ/lib/python3.6/site-packages/requests/adapters.py", line 440, in send
    timeout=timeout
  File "/home/chris/.local/share/virtualenvs/darjeeling-KYygC-ZZ/lib/python3.6/site-packages/urllib3/connectionpool.py", line 639, in urlopen
    _stacktrace=sys.exc_info()[2])
  File "/home/chris/.local/share/virtualenvs/darjeeling-KYygC-ZZ/lib/python3.6/site-packages/urllib3/util/retry.py", line 357, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/home/chris/.local/share/virtualenvs/darjeeling-KYygC-ZZ/lib/python3.6/site-packages/urllib3/packages/six.py", line 685, in reraise
    raise value.with_traceback(tb)
  File "/home/chris/.local/share/virtualenvs/darjeeling-KYygC-ZZ/lib/python3.6/site-packages/urllib3/connectionpool.py", line 601, in urlopen
    chunked=chunked)
  File "/home/chris/.local/share/virtualenvs/darjeeling-KYygC-ZZ/lib/python3.6/site-packages/urllib3/connectionpool.py", line 387, in _make_request
    six.raise_from(e, None)
  File "<string>", line 2, in raise_from
  File "/home/chris/.local/share/virtualenvs/darjeeling-KYygC-ZZ/lib/python3.6/site-packages/urllib3/connectionpool.py", line 383, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.6/http/client.py", line 1331, in getresponse
    response.begin()
  File "/usr/lib/python3.6/http/client.py", line 297, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.6/http/client.py", line 266, in _read_status
    raise RemoteDisconnected("Remote end closed connection without"
urllib3.exceptions.ProtocolError: ('Connection aborted.', RemoteDisconnected('Remote end closed connection without response',))

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/chris/.local/share/virtualenvs/darjeeling-KYygC-ZZ/lib/python3.6/site-packages/darjeeling/evaluator.py", line 213, in _evaluate
    container = self.__problem.build_patch(patch)
  File "/home/chris/.local/share/virtualenvs/darjeeling-KYygC-ZZ/lib/python3.6/site-packages/darjeeling/problem.py", line 172, in build_patch
    container = mgr_ctr.provision(self.__bug)
  File "/home/chris/.local/share/virtualenvs/darjeeling-KYygC-ZZ/lib/python3.6/site-packages/bugzoo/client/container.py", line 124, in provision
    r = self.__api.post(endpoint, json=payload)
  File "/home/chris/.local/share/virtualenvs/darjeeling-KYygC-ZZ/lib/python3.6/site-packages/bugzoo/client/api.py", line 105, in post
    return requests.post(url, **kwargs)
  File "/home/chris/.local/share/virtualenvs/darjeeling-KYygC-ZZ/lib/python3.6/site-packages/requests/api.py", line 112, in post
    return request('post', url, data=data, json=json, **kwargs)
  File "/home/chris/.local/share/virtualenvs/darjeeling-KYygC-ZZ/lib/python3.6/site-packages/requests/api.py", line 58, in request
    return session.request(method=method, url=url, **kwargs)
  File "/home/chris/.local/share/virtualenvs/darjeeling-KYygC-ZZ/lib/python3.6/site-packages/requests/sessions.py", line 508, in request
    resp = self.send(prep, **send_kwargs)
  File "/home/chris/.local/share/virtualenvs/darjeeling-KYygC-ZZ/lib/python3.6/site-packages/requests/sessions.py", line 618, in send
    r = adapter.send(request, **kwargs)
  File "/home/chris/.local/share/virtualenvs/darjeeling-KYygC-ZZ/lib/python3.6/site-packages/requests/adapters.py", line 490, in send
    raise ConnectionError(err, request=request)
requests.exceptions.ConnectionError: ('Connection aborted.', RemoteDisconnected('Remote end closed connection without response',))
evaluated candidate: Candidate<#13d69559>
unexpected error occurred when evaluating candidate [13d69559]
Traceback (most recent call last):
  File "/home/chris/.local/share/virtualenvs/darjeeling-KYygC-ZZ/lib/python3.6/site-packages/urllib3/connectionpool.py", line 601, in urlopen
    chunked=chunked)
  File "/home/chris/.local/share/virtualenvs/darjeeling-KYygC-ZZ/lib/python3.6/site-packages/urllib3/connectionpool.py", line 387, in _make_request
    six.raise_from(e, None)
  File "<string>", line 2, in raise_from
  File "/home/chris/.local/share/virtualenvs/darjeeling-KYygC-ZZ/lib/python3.6/site-packages/urllib3/connectionpool.py", line 383, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.6/http/client.py", line 1331, in getresponse
    response.begin()
  File "/usr/lib/python3.6/http/client.py", line 297, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.6/http/client.py", line 266, in _read_status
    raise RemoteDisconnected("Remote end closed connection without"
http.client.RemoteDisconnected: Remote end closed connection without response

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/chris/.local/share/virtualenvs/darjeeling-KYygC-ZZ/lib/python3.6/site-packages/requests/adapters.py", line 440, in send
    timeout=timeout
  File "/home/chris/.local/share/virtualenvs/darjeeling-KYygC-ZZ/lib/python3.6/site-packages/urllib3/connectionpool.py", line 639, in urlopen
    _stacktrace=sys.exc_info()[2])
  File "/home/chris/.local/share/virtualenvs/darjeeling-KYygC-ZZ/lib/python3.6/site-packages/urllib3/util/retry.py", line 357, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/home/chris/.local/share/virtualenvs/darjeeling-KYygC-ZZ/lib/python3.6/site-packages/urllib3/packages/six.py", line 685, in reraise
    raise value.with_traceback(tb)
  File "/home/chris/.local/share/virtualenvs/darjeeling-KYygC-ZZ/lib/python3.6/site-packages/urllib3/connectionpool.py", line 601, in urlopen
    chunked=chunked)
  File "/home/chris/.local/share/virtualenvs/darjeeling-KYygC-ZZ/lib/python3.6/site-packages/urllib3/connectionpool.py", line 387, in _make_request
    six.raise_from(e, None)
  File "<string>", line 2, in raise_from
  File "/home/chris/.local/share/virtualenvs/darjeeling-KYygC-ZZ/lib/python3.6/site-packages/urllib3/connectionpool.py", line 383, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib/python3.6/http/client.py", line 1331, in getresponse
    response.begin()
  File "/usr/lib/python3.6/http/client.py", line 297, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.6/http/client.py", line 266, in _read_status
    raise RemoteDisconnected("Remote end closed connection without"
urllib3.exceptions.ProtocolError: ('Connection aborted.', RemoteDisconnected('Remote end closed connection without response',))

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/chris/.local/share/virtualenvs/darjeeling-KYygC-ZZ/lib/python3.6/site-packages/darjeeling/evaluator.py", line 266, in evaluate
    outcome = self._evaluate(candidate)
  File "/home/chris/.local/share/virtualenvs/darjeeling-KYygC-ZZ/lib/python3.6/site-packages/darjeeling/evaluator.py", line 213, in _evaluate
    container = self.__problem.build_patch(patch)
  File "/home/chris/.local/share/virtualenvs/darjeeling-KYygC-ZZ/lib/python3.6/site-packages/darjeeling/problem.py", line 172, in build_patch
    container = mgr_ctr.provision(self.__bug)
  File "/home/chris/.local/share/virtualenvs/darjeeling-KYygC-ZZ/lib/python3.6/site-packages/bugzoo/client/container.py", line 124, in provision
    r = self.__api.post(endpoint, json=payload)
  File "/home/chris/.local/share/virtualenvs/darjeeling-KYygC-ZZ/lib/python3.6/site-packages/bugzoo/client/api.py", line 105, in post
    return requests.post(url, **kwargs)
  File "/home/chris/.local/share/virtualenvs/darjeeling-KYygC-ZZ/lib/python3.6/site-packages/requests/api.py", line 112, in post
    return request('post', url, data=data, json=json, **kwargs)
  File "/home/chris/.local/share/virtualenvs/darjeeling-KYygC-ZZ/lib/python3.6/site-packages/requests/api.py", line 58, in request
    return session.request(method=method, url=url, **kwargs)
  File "/home/chris/.local/share/virtualenvs/darjeeling-KYygC-ZZ/lib/python3.6/site-packages/requests/sessions.py", line 508, in request
    resp = self.send(prep, **send_kwargs)
  File "/home/chris/.local/share/virtualenvs/darjeeling-KYygC-ZZ/lib/python3.6/site-packages/requests/sessions.py", line 618, in send
    r = adapter.send(request, **kwargs)
  File "/home/chris/.local/share/virtualenvs/darjeeling-KYygC-ZZ/lib/python3.6/site-packages/requests/adapters.py", line 490, in send
    raise ConnectionError(err, request=request)
requests.exceptions.ConnectionError: ('Connection aborted.', RemoteDisconnected('Remote end closed connection without response',))

Ability to update search space in response to patch evaluations

Let's say that we discover a patch at a given location, if that patch is a deletion, we should remove all other transformations at that location from the transformation space. Alternatively, we may want to update the fault localisation in response to patch results (i.e., online MBFL).

Needs to be defined as part of a search strategy.

What does mutation tell us about the shape and location of the patch? Can we combine mutation and semantics-based repair?

class Algorithm(object):
  def __next__(self) -> Candidate:
    ...

  def evaluated(outcome: CandidateOutcome) -> None:
    ...

Implement a magical setter for Localization that propagates its update to the transformation database.

Identify and remove comment lines from consideration when constructing the donor pool

Add ability to specify custom donor pool in configuration file

Allow filters to be passed to Problem to ignore certain implicated lines

It should be possible to pass a list of callables of the form Callable[[FileLine, Snippet] bool] to the problem constructor. Each item in the list implements a filter that should return False if a particular snippet shouldn't be considered as a transformation target.

Implement weak program equivalence partitioning function

def partition(block, effects) -> List[List[InsertionPoint]]:

Add ability to construct directly candidate patches from raw diffs

Decouple fault localization and Problem

• decouple fault localisation
• separate restrict_to_files into its own method
• separate restrict_to_lines into its own method
• add restrict_with_filter method
• add validate method for ensuring a problem is valid
• decouple snippet database
• use attrs to implement snippets

Add support for simple line-based transformations

Use decorator to register suspiciousness metrics

Use character ranges as transformation targets

All other transformation targets (e.g., statements and lines) can be described as character ranges, and so we should use FileCharRange to describe transformation targets.

Transition Roadmap

• add function for quickly converting line numbers to character ranges
• obtain coverage information for arbitrary character ranges
• replace concrete line transformation generators with character range equivalents

Add repair minimisation

Also, if a statement deletion repairs a bug, should we bother looking at replacing that statement?

Implement restrict-to-files and restrict-to-lines for fault localisation

Add parameter to Problem to specify whether or not to use cached coverage information

Add support for both Rooibos and Shuriken as back-end transformation engines

Add ability to toggle individual optimisations

Add snippet normalisation feature

Should return the normal form for a given snippet, allowing us to remove duplicates of snippets that are determined to be semantically equivalent.

Implement a memory-efficient TransformationDatabase for persisting transformations

class TransformationDatabase(object):
  @staticmethod
  def from_file(fn: str) -> 'TransformationDatabase':
    ...

  def to_file(self, fn: str) -> None:
    ...

Maintain an internal snippet database.

List dependencies in the README.

Basic stuff like Python version, as well as other SL properties (BugZoo, etc). Esp for latter, include links to associated projects.

Remove outdated future-generator module

Add a new data structure for specifying legal and illegal transformation targets

Use coverage to determine all covering tests for a given patch

Use logging module throughout code base

Add support for time limit argument in CLI

Improve signal handling in searcher module