Comments (21)
@sdv4 you can take help from the #220 till it is merged. Those screenshots are marked by @marco.
For the last one you should mark them incompatible while drawing bounding box on Italian side.
from autowebcompat.
No maybe not, they should be incompatible (e.g. if clicking on a button causes a scroll in one browser, it should cause a scroll in the other browser too).
from autowebcompat.
And if this script works differently on two browsers then also it should be an incompatibility?
It shouldn't, but it's hard to tell whether it was this script that failed or something else.
Maybe we should just assume this always works.
from autowebcompat.
@marco-c A CNN learns more about the patterns in the image (Edges, Corners and their correlations) from example 2 it is evident that it will be difficult for a NN to learn the adversary and classify that both are compatible.
To detect differences, Y+D and N in a better way or even Y and D+N, I think we can focus more on, Finding ROIs (Attention based) and feed those patches to the NN. This can be our next go-to-go (alternative) if nothing works very well after training part which you suggested.
from autowebcompat.
At the beginning I would start with screenshots based on equal page sources (same content), so only Y vs D+N. Furthermore I would try to normalise the device settings to bring the rendered Firefox version closer to the rendered Chrome version. And maybe we could remove the system look and feel elements by injecting a small script before the screenshot will be taken.
from autowebcompat.
@marco-c i'd like to label parts of our dataset, how do you suggest i go about doing that ? because as far as i've seen there is no script which merges labels from the label_persons directory into the actual labels directory .
from autowebcompat.
@Shashi456 I think you are talking about generate_labels.py
.
from autowebcompat.
@sagarvijaygupta oh , i thought it wasn't updated for the new files :P , but regardless should we not spend some time labeling the dataset we may need it this summer
from autowebcompat.
@marco-c i'd like to label parts of our dataset, how do you suggest i go about doing that ? because as far as i've seen there is no script which merges labels from the label_persons directory into the actual labels directory .
The script hasn't been updated yet to deal with bounding boxes, but you can already start labeling and pushing your labels file to the repo. Then, once we have the script done, we will actually combine the labeling done by you and the labeling done by other persons.
from autowebcompat.
I am running label.py on my mac, and I am finding that it is slow or unresponsive on non-y images. For instance, it takes a long from when I try to drop a boundary box to when it shows up and for the 'T', resizing arrow, and movement arrow show up. Clicking on any causes everything to disappear until I release my mouse + a couple of seconds.
Is this a problem that anyone else has come up against?
from autowebcompat.
It could be a Mac issue, I think nobody has tested it on a Mac yet. Could you try in a Linux VM?
from autowebcompat.
@marco-c I am not having that problem on the Linux VM, so I can label a lot faster now. A couple of questions:
-
Applying labels: suppose two images seem to only be different in terms of the position on the page that has been scrolled to (ex. Image 1 looks like image 2, except that image 2 has been scrolled down and thus exposes more of the page content). Would these be considered compatible, not compatible, or compatible but different.
-
Getting my labels into the main repo: Should I open a PR for a new branch off of my forked master that is the same as the upstream master, except that it includes my new labels?
from autowebcompat.
Also, how would you label a pair of images when they show the same page except that one is in English and the other in Italian?
from autowebcompat.
Getting my labels into the main repo: Should I open a PR for a new branch off of my forked master that is the same as the upstream master, except that it includes my new labels?
Yes! You can open a PR that says "Add some labels from Shane Sims".
from autowebcompat.
Are the other two questions answered by #220?
from autowebcompat.
@marco-c For the scroll one we have marked them as incompatible in screenshots, and for italian one we mark bounding boxes in italian side with incompatibility in #220 .
from autowebcompat.
For the scroll one we have marked them as incompatible in screenshots
IIRC I've marked them as compatible, didn't I?
from autowebcompat.
Line 162 in b18eae0
And if this script works differently on two browsers then also it should be an incompatibility?
from autowebcompat.
Okay!
from autowebcompat.
@marco-c @sagarvijaygupta so while i was labeling the dataset one of the major themes that popped up was how chrome had a scrollbar. Almost all images which have a scrollbar are very similar but the scrollbars adds a shift which makes the overlay look incompatible .
Should we update the crawler options for chrome to remove the scroll bar or suggest the user something accordingly in the labeling guide?
from autowebcompat.
@Shashi456 it is already removed from the crawler.
from autowebcompat.
Related Issues (20)
- Sort labels when saving them
- test_labels should validate all labels files
- test_labels.py is not actually testing the screenshots actually exist HOT 3
- Limit size of full page screenshot HOT 4
- Script to rename images and labels according to new convention
- Implementing Object Segmentation networks for bounding box annotations HOT 1
- Throw a meaningful error in utils.read_labels when labels.csv is empty HOT 2
- Running pretrain.py gives FileNotFoundError. HOT 4
- Try training a neural network using the responses from a DOM-based tool as features
- Try using the responses from a DOM-based tool as additional features
- Create a web-based tool to show predicted differences HOT 2
- Move the labeling tool to be web-based
- Use multiple releases of each browser
- Try using mdn/browser-compat-data to automatically label screenshot pairs
- Investigate training a model to detect regressions in a browser
- When prefilling an issue on webcompat.com, prefill as much as possible
- Add possibility to navigate to websites on demand
- Use Docker to run browsers and collect screenshots
- Train a baseline classifier HOT 12
- Out of memory error while training vgg16 and vgg19 with imagenet weights on Colab
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from autowebcompat.