Comments (2)
This is correct. The current implementation doesn't account for multi-hop attention. In effect it doesn't implement equation (6) in the paper but stops at equation (5). Thanks for pointing it out. We will get back on the fix which requires introducing a new parameter r
which controls the number of attention hops.
from pytext.
@silky We had implemented single hop attention to get a simpler version working. Please feel free to send us a PR to add multi-hop attention.
from pytext.
Related Issues (20)
- documentation needs change for no longer supplied config sst2.json
- support for huggingface/transformers HOT 1
- [Feature request] Add Yogi optimizer
- Segmentation fault: 11 HOT 1
- PathManager issue when using version 0.3.2. on Google Colab
- Segmentation fault when using PyText 0.3.3 on Google Colab
- Mask is not using in the attention calculation
- export model-AttributeError: module 'torch.utils.data' has no attribute 'IterableDataset'
- call predict interface error: segmentation fault
- pytext export --output-path exported_model.c2 < demo/configs/docnn.json can't get "exported_model.c2"
- Error running pytext on Google Colab - libcudart.so.10.2: cannot open shared object file: No such file or directory
- Segmentation Fault (core dumped) on Azure VM
- Unable to Run Toy Example: `ModuleNotFoundError: No module named 'accelerators'` HOT 2
- OSError: image not found when installing from source HOT 1
- Code for ``Conversational Semantic Parsing``
- Library error (padded_sequences) after installation
- ModuleError when running xlm_r_tutorial.ipynb HOT 1
- No module named 'pytorch' HOT 6
- ImportError: cannot import name 'metanet_pb2' from partially initialized module 'caffe2.proto' HOT 1
- Question on AUC-PR Hinge Loss
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from pytext.