Comments (4)
This would be pretty neat.
Exporting actual Rust code seems like it'd be difficult, so I think the more reasonable path here is exporting the arguments given to a QuickCheck property that caused it to fail. (It's already doing this to some extent, but it's not machine readable and there's no way to "run tests with these arguments.")
from quickcheck.
I think, a first step towards this would be to implement a function similar to quickcheck::quickcheck
, which in addition takes a list of test values that must always be checked, no matter what values get generated. Then one could add failing test cases as hard-coded arguments to this function.
from quickcheck.
This is some pseudocode to make a wrapper that dumps failing cases to a folder. With some help it could work like Hypothesis's caching of failed test.
extern crate quickcheck;
use quickcheck::{Arbitrary, Gen};
extern crate serde;
use serde::{Serialize, Deserialize};
extern crate serde_json;
use std::error::Error;
use std::io::prelude::*;
use std::fs::File;
use std::path::Path;
#[derive(Debug, Clone)]
pub struct SavedCheck<T: Clone + Send> {
iner: T,
}
impl<T: Arbitrary + Serialize + Deserialize> Arbitrary for SavedCheck<T> {
fn arbitrary<G: Gen>(g: &mut G) -> Self {
for file in Path::new("quickcheck_cache/") {
let file = File::open(&file);
if let Ok(t) = serde_json::from_str(&file.as_bytes()) {
// somehow only return each one once
return SavedCheck { iner: t };
}
}
SavedCheck { iner: Arbitrary::arbitrary(g) }
}
fn shrink(&self) -> Box<Iterator<Item = Self>> {
if let Ok(st) = serde_json::to_string(&self.iner) {
// somehow pick a unique name
let path = Path::new("quickcheck_cache/test.json");
let display = path.display();
let mut file = match File::create(&path) {
Err(why) => panic!("couldn't create {}: {}", display, why.description()),
Ok(file) => file,
};
match file.write_all(st.as_bytes()) {
Err(why) => panic!("couldn't write to {}: {}", display, why.description()),
Ok(_) => println!("successfully wrote to {}", display),
}
}
Box::new(self.iner.shrink().map(|t| SavedCheck { iner: t }))
}
}
from quickcheck.
It sounds like proptest can do this. I doubt I'll have the bandwidth to implement/review/maintain something like this.
from quickcheck.
Related Issues (20)
- Identity checking HOT 3
- Stack overflow in quickcheck case shrinking HOT 3
- example case sort TEST FAILED HOT 1
- QuickChecking Const Generic Code HOT 5
- Implement Arbitrary for AsMut<[T: Arbitrary]> HOT 2
- Infinite Repetition/Never Ending Test with `f32` and `f64`. HOT 17
- Q: Idiomatic way to specify the length of an arbitrary vector HOT 7
- <newbie> How to generate a number within a range HOT 2
- Negating an integer leads to stack overflow HOT 2
- upgrade notes would be nice. HOT 1
- debug_reprs taking up 41% of test runtime HOT 2
- warning: panic message is not a string literal HOT 1
- Rng Size for Vec Arbitrary cannot be 0
- Impl Clone for Gen
- Implement something like choose_weighted for `Gen`
- Is this still maintained? HOT 1
- Is quickcheck still maintained? HOT 1
- How to combine quickcheck 1+ with fake? HOT 3
- Durations's Arbitrary instance is dependant on Gen's size HOT 1
- `Logging` not working on `quickcheck` test. HOT 2
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from quickcheck.