Comments (5)
feifeibear
commented on May 11, 2024
This a bug. I am going to fix it. The value is the max diff between torch and turbo.
from turbotransformers.
652994331
commented on May 11, 2024
谢谢您。请问这个diff 指的是CPU预测的速度吗，比如说我想测试一下TURBO GPU的预测一条样本的速度这个要怎么解决呢
from turbotransformers.
feifeibear
commented on May 11, 2024
这个脚本就是展示如何使用，并没测试速度，diff是结果数值上的差距。
速度可以在benchmark目录下测试。
from turbotransformers.
652994331
commented on May 11, 2024
就是说 在benchmark 目录下 自己去开发一个脚本来测速对吧
from turbotransformers.
feifeibear
commented on May 11, 2024
benchmark已有的脚本就可以测，或者你自己写benchmark的方法都可以
from turbotransformers.
Related Issues (20)
- core::Tensor 处理 HOT 1
- 支持自己搭建的Transformer吗？ HOT 1
- 请问怎么用tensorflow加载bert呢？ HOT 1
- 多卡上会有问题？
- 支持大模型的推理吗 HOT 4
- Transformers版本不一致 HOT 5
- unitest失败 HOT 4
- Getting the same output logits regardless of input tensors HOT 14
- 想问下turbo支持huggingface的bart模型么 HOT 4
- RuntimeError: code is not compiled with CUDA. HOT 3
- MultiHeadedAttention与onmt结果不对应 HOT 1
- Is it easier to implement other model? conformer
- 如何在c++里使用profiler？
- 支持bert的变种吗？ HOT 1
- Commercial Support? HOT 2
- Stable version HOT 4
- gpt2推理结果不正确 HOT 4
- C++的build问题 HOT 1
- arm cpu的支持情况。
- Support for ViT and Swin transformer ?
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from turbotransformers.