Giter Site home page Giter Site logo

Comments (1)

diplomatist avatar diplomatist commented on May 29, 2024

The current idea is to save the parameters of the forward process after converting the denoise_fn module of the network, which is unet, to onnx.

In the process of exporting the onnx model, it appears
runtime error: couldn't export python mehod. but no specific part was given as to what went wrong.

I tested each module of the network and found that one of the modules used the checkpoint function, which I removed and successfully exported the model in onnx format.

However, the exported ONNX model actually increases the inference time during inference.
There may be several reasons:
① The checkpoint function in unet has been removed by me.
② The input of onnx only supports numpy format, which means that the input parameters of the model can only be in the CPU environment.
Perhaps there will be better improvements only after converting onnx to TensorRT. However, recent DDIM, PLMS, and dpm solver's inverse Markov chain sampling methods have greatly accelerated the sampling process of the diffusion model. The inference time gain brought by the new sampling method has far exceeded the gain brought by TensorRT deployment.

from palette-image-to-image-diffusion-models.

Related Issues (20)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.