Giter Site home page Giter Site logo

rope's Introduction

Screenshot 2024-02-10 091752

Rope implements the insightface inswapper_128 model with a helpful GUI.

${{\color{Goldenrod}{\textsf{Last Updated 2024-02-27}}}}$

${{\color{Goldenrod}{\textsf{Welcome to Rope-Opal!}}}}$

${{\color{Red}{\textsf{Please grab the latest yoloface model from the link in the wiki!}}}}$

Screenshot 2024-02-10 104718

Features:

  • Lightning speed face swapping with all the features
  • Upscalers
  • Likeness modifiers
  • Orientation management
  • Masks: borders, differentials, auto occlusion, face parsers, text-based masking - all with strength adjustments and blending settings
  • Mask view to evaluate masks directly
  • Source face merging and saving
  • Swap images or videos
  • Auto save filename generation
  • Dock/Undock the video player
  • Real-time player
  • Segment recording
  • Fine tune your video ahead of time by creating image setting markers at specific frames.
  • Lightening fast!

Updates for Rope-Opal-03a:

To update from Opal-03, just need to replace the GUI.py file in /rope.

  • (fixed) Image swapping bug
  • (fixed) Error on clearing VRAM

Updates for Rope-Opal-03:

To update from Opal-02, just need to replace the .py files in /rope. You'll seem them 'Rope-Opal-03' in the comment column

  • (fixed) Input Videos/Images scrollbar bug
  • (fixed) Sometime the playbar would get out of sync when selecting a video while playing
  • (fixed) The battle of memory managers has been resolved. Rope will now use less VRAM.
  • (fixed) Mousewheel and manually dragging the timeline slider were not respecting the markers
  • (feature) Save frames from the video preview window
  • (fixed) Rotation is back to 90 deg increments
  • (fixed) Adjusted some defaults for better out of the box results

Updates for Rope-Opal-02:

To update from Opal-01, just need to replace the .py files in /rope. You'll seem them 'Rope-Opal-02' in the comment column

  • (feature) Auto-pads input faces to increase the chance of detection
  • (feature) Update console messages for more information
  • (feature) Reimplimented images
  • (fixed) Adressed error with Reference detection alignment in Restorer
  • (feature) Added a VRAM monitor
  • (feature) Reimplemented the VRAM clear

Updates for Rope-Opal-01:

To update from Opal, just need to replace the .py file in /rope. You'll seem them 'Rope-Opal-01' in the comment column

  • (Fixed) Reverted to previous model load parameters. Some people were having issues with the new settings.
  • (Fixed) Markers now clear propoerly when changing videos
  • (Fixed)Input Face loading errors are now handled gracefully
  • (Feature) Added option to select Mean or Median when multi-selecting input faces

Updates for Rope-Opal:

  • This next version focuses on the UI. It's completely overhauled and finally looks more like a modern app. Lots of useability improvements and room to add new features.
  • Can now set strength to zero. This effectively turns off the swapper in the render pipeline so you can apply the rest of the options to the original image (e.g., upscale the original face w/o swapping)
  • Recording library can be set to FFMPEG or OPENCV
  • Real-time audio is now available while previewing. Performace that renders slower than the frame rate will cause audio lag
  • The Differencing fuction has been reworked into the pipeline to produce better results. Consequently it currently does not show up in the mask preview.
  • Wrestled back some VRAM from the Ruby upgrades
  • Faster loading of some models. Upcoming releases will do furhter optimizations
  • Adjusted the use of filtering and antialiasing
  • Yolov8 added as a face detection model selection. FF is having good results with it, so looking forward to hearing your thoughts on its behavior in Rope
  • Scrollbars!
  • Save/load paramters, and reset to defaults. Rope will auto-load your saved paramters when launched.
  • Restorers (GFPGAN, etc) now have option to choose the detection alignment method. You can trade speed vs fidelity vs texture. This includes the original Rope method that, although flawed, maintain the face textures.
  • Detection score. Adjust how aggressive Rope is at finding faces.
  • Added detailed help text in the lower left when hovering over UI elements.
  • Added reverse, forward and beginning to timeline control.

Some Feature Still need to be re-implmented from Rope-Ruby. They'll be added back in the next updates.

  • Stop markers
  • Framerate stats while playing
  • Global hotkeys for moving the timeline
  • Ongoing interface maturation

Performance:

Machine: 3090Ti (24GB), i5-13600K

File: benchmark/target-1080p.mp4, 2048x1080, 269 frames, 25 fps, 10s Rendering time in seconds:

Option Crystal Sapphire Ruby Opal
Only Swap 7.3 7.5 4.4 4.3
Swap+GFPGAN 10.7 11.0 9.0 9.8
Swap+Codeformer 12.4 13.5 11.1 11.1
Swap+one word CLIP 10.4 11.2 9.1 9.3
Swap+Occluder 7.8 7.8 4.4 4.7
Swap+MouthParser 13.9 12.1 5.0 4.9

Disclaimer:

Rope is a personal project that I'm making available to the community as a thank you for all of the contributors ahead of me. I've copied the disclaimer from Swap-Mukham here since it is well-written and applies 100% to this repo.

I would like to emphasize that our swapping software is intended for responsible and ethical use only. I must stress that users are solely responsible for their actions when using our software.

Intended Usage: This software is designed to assist users in creating realistic and entertaining content, such as movies, visual effects, virtual reality experiences, and other creative applications. I encourage users to explore these possibilities within the boundaries of legality, ethical considerations, and respect for others' privacy.

Ethical Guidelines: Users are expected to adhere to a set of ethical guidelines when using our software. These guidelines include, but are not limited to:

Not creating or sharing content that could harm, defame, or harass individuals. Obtaining proper consent and permissions from individuals featured in the content before using their likeness. Avoiding the use of this technology for deceptive purposes, including misinformation or malicious intent. Respecting and abiding by applicable laws, regulations, and copyright restrictions.

Privacy and Consent: Users are responsible for ensuring that they have the necessary permissions and consents from individuals whose likeness they intend to use in their creations. We strongly discourage the creation of content without explicit consent, particularly if it involves non-consensual or private content. It is essential to respect the privacy and dignity of all individuals involved.

Legal Considerations: Users must understand and comply with all relevant local, regional, and international laws pertaining to this technology. This includes laws related to privacy, defamation, intellectual property rights, and other relevant legislation. Users should consult legal professionals if they have any doubts regarding the legal implications of their creations.

Liability and Responsibility: We, as the creators and providers of the deep fake software, cannot be held responsible for the actions or consequences resulting from the usage of our software. Users assume full liability and responsibility for any misuse, unintended effects, or abusive behavior associated with the content they create.

By using this software, users acknowledge that they have read, understood, and agreed to abide by the above guidelines and disclaimers. We strongly encourage users to approach this technology with caution, integrity, and respect for the well-being and rights of others.

Remember, technology should be used to empower and inspire, not to harm or deceive. Let's strive for ethical and responsible use of deep fake technology for the betterment of society.

rope's People

Contributors

hillobar avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.