Giter Site home page Giter Site logo

Comments (4)

Zhaoyibinn avatar Zhaoyibinn commented on May 30, 2024

I have solved this problem, and the core issue is:

The official PTH, TAR trained through official tutorials, and the structure of network inference. The names of the keys for the three are different and need to be converted when reading.

The official conversion method has been written in the Lightglue library, located at approximately line 470 of Lightglue. py.

for i in range(self.conf.n_layers):
pattern = f"self_attn.{i}", f"transformers.{i}.self_attn
state_dict = {k.replace(*pattern): v for k, v in state_dict.items()}
pattern = f"cross_attn.{i}", f"transformers.{i}.cross_attn"
state_dict = {k.replace(*pattern): v for k, v in state_dict.items()}

I referred to this writing method and manually checked the key names for each link.

from glue-factory.

ly0224 avatar ly0224 commented on May 30, 2024

I have solved this problem, and the core issue is:我已经解决了这个问题,核心问题是:

The official PTH, TAR trained through official tutorials, and the structure of network inference. The names of the keys for the three are different and need to be converted when reading.官方PTH,通过官方教程训练的TAR,以及网络推理的结构。三者的键名不同,读取时需要转换。

The official conversion method has been written in the Lightglue library, located at approximately line 470 of Lightglue. py.官方的转换方法已经写在 Lightglue 库中,位于 Lightglue 的大约 470 行。py。

for i in range(self.conf.n_layers): pattern = f"self_attn.{i}", f"transformers.{i}.self_attn state_dict = {k.replace(*pattern): v for k, v in state_dict.items()} pattern = f"cross_attn.{i}", f"transformers.{i}.cross_attn" state_dict = {k.replace(*pattern): v for k, v in state_dict.items()}

I referred to this writing method and manually checked the key names for each link.我参考了这种编写方法,并手动检查了每个链接的键名。

Hello, I want to fine-tune the training on my own dataset, how should I do it, what the format of the dataset should be

from glue-factory.

Zhaoyibinn avatar Zhaoyibinn commented on May 30, 2024

我已经解决了这个问题,核心问题是:我已经解决了这个问题,核心问题是:
官方PTH,通过官方教程训练的TAR,以及网络推理的结构。官方PTH,通过官方教程训练的TAR,以及网络推理的结构。三者的键名不同,读取时需要转换。
官方的转换方法已经写在 Lightglue 库中,位于 Lightglue 的大约 470 行。py.官方的转换方法已经写在 Lightglue 库中,位于 Lightglue 的大约 470 行。py。
for i in range(self.conf.n_layers): pattern = f"self_attn.{i}", f"transformers.{i}.self_attn state_dict = {k.replace(*pattern): v for k, v in state_dict.items()} pattern = f"cross_attn.{i}", f"transformers.{i}.cross_attn" state_dict = {k.replace(*pattern): v for k, v in state_dict.items()}
我参考了这种编写方法,并手动检查了每个链接的键名。

您好,我想在自己的数据集上微调训练,我应该怎么做,数据集的格式应该是什么

您可以下载官方所采用的Homography或者megadepth数据集进行参考(虽然经过我实际测试微调效果并不好)

from glue-factory.

ly0224 avatar ly0224 commented on May 30, 2024

我已经解决了这个问题,核心问题是:我已经解决了这个问题,核心问题是:
官方PTH,通过官方教程训练的TAR,以及网络推理的结构。官方PTH,通过官方教程训练的TAR,以及网络推理的结构。三者的键名不同,读取时需要转换。
官方的转换方法已经写在 Lightglue 库中,位于 Lightglue 的大约 470 行。py.官方的转换方法已经写在 Lightglue 库中,位于 Lightglue 的大约 470 行。py。
for i in range(self.conf.n_layers): pattern = f"self_attn.{i}", f"transformers.{i}.self_attn state_dict = {k.replace(*pattern): v for k, v in state_dict.items()} pattern = f"cross_attn.{i}", f"transformers.{i}.cross_attn" state_dict = {k.replace(*pattern): v for k, v in state_dict.items()}
我参考了这种编写方法,并手动检查了每个链接的键名。

您好,我想在自己的数据集上微调训练,我应该怎么做,数据集的格式应该是什么

您可以下载官方所采用的Homography或者megadepth数据集进行参考(虽然经过我实际测试微调效果并不好)

我有更多的问题想请教一下您,方便加个球球吗,963170859

from glue-factory.

Related Issues (20)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.