Comments (1)
Hi @clemsgrs
Great visualization. The main reasoning for blending was to develop smooth attention maps similar to that of the heatmap generation code in CLAM, which similarly performs block blending. As you have described and visualized, a small offset is added such that the image is shifted by 16 pixels, with the scores averaged in a way s.t. the padded portion of image do not contribute toward the heatmap. Ultimately, you get much smoother heatmap that may aid in not only qualitative analysis, but also potential post-hoc zero-shot segmentation and detection applications. Since both ViTs have patch sizes of 16 (instead of 8), this patch overlap strategy may help with the latter application.
from hipt.
Related Issues (20)
- VIT-4096-WSI HOT 1
- Some issue about create patch. HOT 14
- Gradient accumulation not properly implemented HOT 2
- knn_classifier
- .csv metadata file for colorectal dataset
- Got different results when runing the example "Using the HIPT_4K API" two times HOT 7
- Hurry!!!How to slove this problem? HOT 2
- a WSI image with a higher resolution
- The results of each inference are inconsistent HOT 2
- dino4k pretraining HOT 4
- Setting patient_strat=FALSE in subtyping HOT 3
- coordinates of 4k region embeddings
- Data preprocessing
- How to determine the survival score when a patient has multiple WSIs? HOT 1
- 4k attention visualization output kind of weird HOT 1
- Duration of Feature Extraction Using hipt4k Pretrained Model HOT 4
- Pretraining Dataset
- Visualization Disturbing Original H&E
- Poor performance on PRAD downstream
- what is the mean and std when using the pretrined dino vit-s to extract patch feature? HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from hipt.