Giter Site home page Giter Site logo

persistforever / cifar10-tensorflow Goto Github PK

View Code? Open in Web Editor NEW
555.0 555.0 211.0 3.54 MB

cifar10数据集上进行图片分类,基于tensorflow框架,旨在探究不同的改进策略对分类准确率的影响,如何一步步得提高准确率

Python 100.00%

cifar10-tensorflow's People

Contributors

persistforever avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

cifar10-tensorflow's Issues

很不错的repo

很不错的repo,展示了不同模型优化技术的作用。
最近也是在跑CIFAR10的任务,不过用的是pytorch。
然后我的疑问是resnet系列的准确率是不是偏低一点?理论上resnet系列的准确率应该比VGG16好好一点的。
我这边跑的VGG16 的准确率可以到达93.49%,超过了你展示的resnet结果。我在想是不是resnet全部潜能没有发挥出来?
我的实验设置如下:
结构是官方VGG16,有加BN,Batch大小500,fc加dropout
SGD,余弦学习率,lr初始值0.1,半衰周期1200,最小学习率0.001。
权重衰减5e-4
输入图像padding再随机裁剪4像素,没有做白化。加水平镜像翻转

loss的计算

screenshot from 2018-04-26 16-03-16

screenshot from 2018-04-26 15-58-05

既然喂给网络一个batch的数据,计算的不应该是一个batch的损失吗?为什么后面计算平均损失的时候需要再乘以batch_size?

Training time

Basic cnn spend one day on training on CPU, but it still doesn't finish.
VGG spend one night on training on GPU, but it still doesn't finish.
Is that normal?

请问文件是不是少了?

您好,我在运行您的代码时有些文件,路径找不到,请您帮忙解答一下疑惑,非常感谢!
src/config/networks/resnet.yaml
backups/cifar10-v2/
'backups/cifar10-v5/'

权重衰减问题

貌似总体损失没有加上权重衰减的损失,难道是tf.layers.Conv2D在训练时权重时自动衰减?但在建立计算网络,好像并没有将衰减系数传入进去!

关于配置文件的问题

你好,想请教下几个问题
1、没有resnet的.yaml文件,
image
2、其他的resnet.yaml文件没有dense层
image
3、如果是3分类,是不是需要把yaml文件中的dense层参数改成3
image

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.