burrowsa/fixtures.jl

Fixtures and patching to improve your test life with Julia

fixtures.jl's Issues

Allow test code to access values produced by registered fixtures

[PkgEval] Fixtures may have a testing issue on Julia 0.4 (2014-10-08)

PackageEvaluator.jl is a script that runs nightly. It attempts to load all Julia packages and run their tests (if available) on both the stable version of Julia (0.3) and the nightly build of the unstable version (0.4). The results of this script are used to generate a package listing enhanced with testing results.

On Julia 0.4

• On 2014-10-05 the testing status was Tests fail, but package loads.
• On 2014-10-08 the testing status changed to Package doesn't load.

Tests fail, but package loads. means that PackageEvaluator found the tests for your package, executed them, and they didn't pass. However, trying to load your package with using worked.

Package doesn't load. means that PackageEvaluator did not find tests for your package. Additionally, trying to load your package with using failed.

Special message from @IainNZ: This change may be due to breaking changes to Dict in JuliaLang/julia#8521, or the removal of deprecated syntax in JuliaLang/julia#8607.

This issue was filed because your testing status became worse. No additional issues will be filed if your package remains in this state, and no issue will be filed if it improves. If you'd like to opt-out of these status-change messages, reply to this message saying you'd like to and @IainNZ will add an exception. If you'd like to discuss PackageEvaluator.jl please file an issue at the repository. For example, your package may be untestable on the test machine due to a dependency - an exception can be added.

Test log:

>>> 'Pkg.add("Fixtures")' log
INFO: Installing FactCheck v0.1.2
INFO: Installing Fixtures v0.0.2
INFO: Installing MetaTools v0.0.1
INFO: Installing ProgressMeter v0.1.1
INFO: Installing RunTests v0.0.3
INFO: Package database updated
INFO: METADATA is out-of-date a you may not have the latest version of Fixtures
INFO: Use `Pkg.update()` to get the latest versions of your packages

>>> 'using Fixtures' log

WARNING: deprecated syntax "{a=>b, ...}" at /home/idunning/pkgtest/.julia/v0.4/MetaTools/src/parsed_function.jl:79.
Use "Dict{Any,Any}(a=>b, ...)" instead.

WARNING: deprecated syntax "{a=>b, ...}" at /home/idunning/pkgtest/.julia/v0.4/MetaTools/src/parsed_function.jl:90.
Use "Dict{Any,Any}(a=>b, ...)" instead.

WARNING: deprecated syntax "{a=>b, ...}" at /home/idunning/pkgtest/.julia/v0.4/MetaTools/src/parsed_function.jl:94.
Use "Dict{Any,Any}(a=>b, ...)" instead.
ERROR: syntax: missing last argument in "2:" range expression 
 in include at ./boot.jl:245
 in include_from_node1 at ./loading.jl:128
 in include at ./boot.jl:245
 in include_from_node1 at ./loading.jl:128
 in reload_path at ./loading.jl:152
 in _require at ./loading.jl:67
 in require at ./loading.jl:54
 in require_3B_3964 at /home/idunning/julia04/usr/bin/../lib/julia/sys.so
 in include at ./boot.jl:245
 in include_from_node1 at ./loading.jl:128
 in include at ./boot.jl:245
 in include_from_node1 at ./loading.jl:128
 in reload_path at ./loading.jl:152
 in _require at ./loading.jl:67
 in require at ./loading.jl:52
 in require_3B_3964 at /home/idunning/julia04/usr/bin/../lib/julia/sys.so
 in include at ./boot.jl:245
 in include_from_node1 at loading.jl:128
 in process_options at ./client.jl:293
 in _start at ./client.jl:362
 in _start_3B_3789 at /home/idunning/julia04/usr/bin/../lib/julia/sys.so
while loading /home/idunning/pkgtest/.julia/v0.4/MetaTools/src/parsed_function.jl, in expression starting on line 100
while loading /home/idunning/pkgtest/.julia/v0.4/MetaTools/src/MetaTools.jl, in expression starting on line 3
while loading /home/idunning/pkgtest/.julia/v0.4/Fixtures/src/fixture.jl, in expression starting on line 5
while loading /home/idunning/pkgtest/.julia/v0.4/Fixtures/src/Fixtures.jl, in expression starting on line 2
while loading /home/idunning/pkgtest/.julia/v0.4/Fixtures/testusing.jl, in expression starting on line 2
Julia Version 0.4.0-dev+998
Commit e24fac0 (2014-10-07 22:02 UTC)
Platform Info:
  System: Linux (x86_64-unknown-linux-gnu)
  CPU: Intel(R) Xeon(R) CPU E5-2650 0 @ 2.00GHz
  WORD_SIZE: 64
  BLAS: libopenblas (USE64BITINT DYNAMIC_ARCH NO_AFFINITY Sandybridge)
  LAPACK: libopenblas
  LIBM: libopenlibm
  LLVM: libLLVM-3.3


>>> test log
no tests to run
>>> end of log

The fixture_values argument to apply_fixtures should be a keyword argument

Need to fix #3 first

Add some handy fixtures for files

• temporary folder
• temporary output file
• cleanup named folder
• cleanup named file

provide == as well as isequal for Julia 0.3

Currently, you are providing an isequal method for various types. In Julia 0.3, you will also need to provide ==. See JuliaLang/julia#6833.

(In Julia 0.2, == called isequal by default, so providing isequal was enough. In Julia 0.3, however, these two functions are swapped: isequal calls == by default. So overriding isequal is not enough to make things like != or == work. In order to remain backward-compatible with Julia 0.2, you will need to provide both methods.)

Add some handy fixtures for files

• temporary folder
• temporary output file
• cleanup named folder
• cleanup named file

The fixture scoping done by apply_fixtures is not thread-safe

It just monkeys with global state, it should use task_local_storage

Info about upcoming removal of packages in the General registry

As described in https://discourse.julialang.org/t/ann-plans-for-removing-packages-that-do-not-yet-support-1-0-from-the-general-registry/ we are planning on removing packages that do not support 1.0 from the General registry. This package has been detected to not support 1.0 and is thus slated to be removed. The removal of packages from the registry will happen approximately a month after this issue is open.

To transition to the new Pkg system using Project.toml, see https://github.com/JuliaRegistries/Registrator.jl#transitioning-from-require-to-projecttoml.
To then tag a new version of the package, see https://github.com/JuliaRegistries/Registrator.jl#via-the-github-app.

If you believe this package has erroneously been detected as not supporting 1.0 or have any other questions, don't hesitate to discuss it here or in the thread linked at the top of this post.

Matcher tests have been failing silently on Travis since build 14

Here is the build they first break on:

https://travis-ci.org/burrowsa/Fixtures.jl/builds/16986077

Need to make sure Travis fails if tests fail and also need to fix the failure (although it works for me)

Julia 0.6 build is broken

See #14

[PackageEvaluator.jl] Your package Fixtures may have a testing issue.

This issue is being filed by a script, but if you reply, I will see it.

PackageEvaluator.jl is a script that runs nightly. It attempts to load all Julia packages and run their test (if available) on both the stable version of Julia (0.2) and the nightly build of the unstable version (0.3).

The results of this script are used to generate a package listing enhanced with testing results.

The status of this package, Fixtures, on...

• Julia 0.2 is 'Tests pass.'
• Julia 0.3 is 'Tests fail, but package loads.'

'No tests, but package loads.' can be due to their being no tests (you should write some if you can!) but can also be due to PackageEvaluator not being able to find your tests. Consider adding a test/runtests.jl file.

'Package doesn't load.' is the worst-case scenario. Sometimes this arises because your package doesn't have BinDeps support, or needs something that can't be installed with BinDeps. If this is the case for your package, please file an issue and an exception can be made so your package will not be tested.

This automatically filed issue is a one-off message. Starting soon, issues will only be filed when the testing status of your package changes in a negative direction (gets worse). If you'd like to opt-out of these status-change messages, reply to this message.

@fixture doesn't support keyword arguments

Using keyword arguments, like so:

@fixture function foo(;x=12)
     println("hello")
     yield_fixture()
     println("good bye")
end

Produces this error:

ERROR: syntax: malformed function arguments (parameters (kw x 12))