Comments (5)
For now, we are running the crawler manually.
So the only thing we should do is making the crawler store the date in the file name (and fix all the places where the name is used to account for the change).
N.B.: This has to wait for #88 to be merged.
from autowebcompat.
Randomly, bugs can be scheduled using the Timer from threading.
from threading import Timer
t = Timer(SECONDS_IN_DAY * days_to_wait, lambda: run_test(...))
t.start()
This would also need a hash to be included with the date of screenshot. Maybe we can just use the day-month-year as the hash? That would avoid multiple screenshots in a single day. But when the crawler's waiting Timer thread executes after few days, it'll run the test for bug.
This assumes a continually running crawler though.
Or randomly bugs can be added into a list file and added to scheduled_bugs folder as bugs_day-month-year.json
Crawler will read the file for current day and use it on start and make a timer for 1 day. That timer will trigger the crawler to read the current day's file. This gives us goodness of both.
Which option is more preferred by you?
from autowebcompat.
@marco-c As you suggested we should store time in the file_name.
So new name will be something like
bugid_seqno_H_width_V_height_date_7_08_2018_03_02_browser.png
!
If you feel it is right I will make the change.
We can also keep time info in another file mapped to its name if you feel name becomes too long.
Also if you have the original screenshots taken by the crawler (without modifications or copied with new birth times) we can gather their birth info also. I will write a script for the same if you have the original ones.
from autowebcompat.
If you feel it is right I will make the change.
Yes, looks good to me.
We can also keep time info in another file mapped to its name if you feel name becomes too long.
For now let's put it in the name. Then maybe in the future we will have a small json file alongside each screenshot with its metadata.
Also if you have the original screenshots taken by the crawler (without modifications or copied with new birth times) we can gather their birth info also. I will write a script for the same if you have the original ones.
For the original screenshots, we could simply use the current time, it doesn't matter as they already have different names.
from autowebcompat.
For the original screenshots, we could simply use the current time, it doesn't matter as they already have different names.
I wanted to say that if we have their birth time info we can use it as it will be a meaningful information. So afterwards we can have features like morning
, evening
, night
which might be helpful afterwards.
I will add the current time as of now. We can change it if required.
from autowebcompat.
Related Issues (20)
- Sort labels when saving them
- test_labels should validate all labels files
- test_labels.py is not actually testing the screenshots actually exist HOT 3
- Limit size of full page screenshot HOT 4
- Script to rename images and labels according to new convention
- Implementing Object Segmentation networks for bounding box annotations HOT 1
- Throw a meaningful error in utils.read_labels when labels.csv is empty HOT 2
- Running pretrain.py gives FileNotFoundError. HOT 4
- Try training a neural network using the responses from a DOM-based tool as features
- Try using the responses from a DOM-based tool as additional features
- Create a web-based tool to show predicted differences HOT 2
- Move the labeling tool to be web-based
- Use multiple releases of each browser
- Try using mdn/browser-compat-data to automatically label screenshot pairs
- Investigate training a model to detect regressions in a browser
- When prefilling an issue on webcompat.com, prefill as much as possible
- Add possibility to navigate to websites on demand
- Use Docker to run browsers and collect screenshots
- Train a baseline classifier HOT 12
- Out of memory error while training vgg16 and vgg19 with imagenet weights on Colab
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from autowebcompat.