abyildirim / inst-inpaint Goto Github PK
View Code? Open in Web Editor NEWA novel inpainting framework that can remove objects from images based on the instructions given as text prompts.
License: MIT License
A novel inpainting framework that can remove objects from images based on the instructions given as text prompts.
License: MIT License
Could you upload the dataset to huggingface as well ? The google drive always complains "there are too many users ..." and we could not download it.
I found that only the instructions of test are provided, can you further provide the larger data from training stage?
Hi,
I am currently researching the topic covered in your paper, specifically the "Selecting Objects from the Scene Graphs" section. I am interested in the complete vocabulary for the categories "Implicit parts of an object" and "Items worn by an object" as outlined in your "Parts vs. Objects" classification. Your assistance would greatly benefit my ongoing research!
Thank you for your time and consideration.
I cannot find the total training steps you used in the config or the code.
There seems to be no description about the training steps or epochs in the paper either.
Could you tell me how many training steps do you use in the GQA-Inpaint dataset?
And does training longer or shorter influence the results? What is the influence?
Thanks!
Great work,I noticed that the output looks really bad in comparison to the input when using it on replicate. It also resizes the image.
In the paper, it said "Because from source images we pick different objects and generate instructions, training includes 173715 unique source-target-prompt pairs. We test the models on 4811 unique source images, 9485 unique target images, and 18883 unique source-target-prompt pairs.". When I downloaded the data from github, I got 38w+ masks, which means I have 38w+ source-target-mask pairs. Did I process the data in a wrong way or something?
Hello, why can't I download the dataset? It says "no permission" halfway through the download.
It's a great work!
I wonder if this method can be transferred to mask based removing? As instruction sometimes cannot convey the user's accurate intention! I have tried SD-Inpaint, but its removing ability is not that good, it usually generate some unwanted objects.
Do you have some ideas about diffusion based masking removing strategy?
Hi all,
I read through the instructions for Inst-Inpaint. However, I am not sure where/how we can indicate which option should be removed from the picture?
I cannot find any parameter in the instructions that explains how to indicate the object.
Can someone please let me know how to specify exactly which object needs to be removed?
Thanks
Thanks for your great works! I cannot wait to try out your code and models. I'm looking forward to it!
It's been a long wait since the last update to this repo.
A declarative, efficient, and flexible JavaScript library for building user interfaces.
๐ Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. ๐๐๐
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google โค๏ธ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.