Giter Site home page Giter Site logo

Comments (3)

leewishyuanfang avatar leewishyuanfang commented on September 13, 2024 1

通过这种生成图像的方式,如果是按照实践中提供的代码进行训练的话,因为是在程序执行时才划分了训练集、验证集和测试集,很可能会导致部分图片及其通过图像增强得到的图片同时出现在训练集、验证集和测试集中,实际上对模型的精度测量会产生了干扰。

除此之外,在训练中如果是将所有图片加载到内存中再进行训练,对内存也是一个很大的考验,很可能导致内存被消耗尽,建议采用model.fit_generator方法进行模型的训练。该方法通过指定图像增强的生成器,在训练的时候,每次从训练集和测试集中随机选取指定数量的图像进行增强后,送入模型进行训练,减少了对内存的占用。
图像增强的生成器需要事先把指定文件夹中的图像再按照分类分为不同的文件夹存放,比如在训练文件夹中再创建dog和cat文件夹来分别存放猫、狗图片。这样的话,生成器可以根据文件夹的不同来区分出生成的图像是属于哪个类别的。

具体的实现步骤,可以参考我的这篇文章:第二期扩展实践:提升模型精度的几种尝试中的第四步。

当然,这种方式的训练时间也是非常慢,同时我的这个实践没有取得很好的效果,最终还是放弃了。再这里提出来,希望对你能够有所帮助,也希望你的实践能取得好的效果!

from modelarts-lab.

benmcq2019 avatar benmcq2019 commented on September 13, 2024

@leewishyuanfang 嘿嘿 谢谢李哥的指点,嗯。我这办法确实问题很大。我已经在研究你的第四步了。下次你早点发,我就少走弯路了!!!哈哈哈哈

from modelarts-lab.

qqbangbangbang avatar qqbangbangbang commented on September 13, 2024

牛逼

from modelarts-lab.

Related Issues (20)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.