Comments (5)
SGD很慢,实验室环境中,数据量上亿之后很难做到上百轮的训练,用adaptive算法能显著加快收敛。
从比赛角度讲,比较出名的FFM就是用的adagrad算法,这可能也是libFFM的优秀训练速度的一个原因。
从工业界角度讲,end-to-end的策略也会比预训练更有优势,个人认为合理的初始化策略是值得探讨的一个问题。
from attentional_factorization_machine.
from attentional_factorization_machine.
FM同样面临稀疏数据初始化的问题,据我所知另一种主流的FM初始化方法是采用方差为根号1/k的随机分布,k为embedding size,而且由于采用了adaptive optimizer,FM不能保证在不同的初始化条件下收敛到相同的解
from attentional_factorization_machine.
from attentional_factorization_machine.
感谢您耐心的回答
from attentional_factorization_machine.
Related Issues (20)
- can share the code? HOT 4
- Could you please share the code? HOT 1
- Could you share your code?
- 请问预训练FM factor256需要多大内存?
- 关于AFM不能复现论文实验结果 HOT 5
- No module named LoadData
- valid_dimension的含义?
- Why there is little improvement of attenion model in my experiment ? HOT 1
- reduce_sum和softmax有bug? HOT 2
- 为什么ml-tag和frappe数据的label值是1和-1?为什么不是一个0-1之间的评分呢?求解答
- 何老师您好,这个RMSE是评分预测的损失吗
- 关于attention_score 和 interaction_score 的问题??
- 请问batch_norm_layer这个函数似乎源码中并没有用上??
- 实数特征支持问题 HOT 1
- Difference between FM and AFM is not as pronounced as in the original paper HOT 3
- 数据处理代码 HOT 1
- 您好,frappe最优结果的最优参数是? HOT 8
- dropout in validation/evaluation HOT 5
- AFM训练中出现nan HOT 3
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from attentional_factorization_machine.