sebastian-hofstaetter / teaching Goto Github PK
View Code? Open in Web Editor NEWOpen-Source Information Retrieval Courses @ TU Wien
License: GNU General Public License v3.0
Open-Source Information Retrieval Courses @ TU Wien
License: GNU General Public License v3.0
Referring to the explanation of the attention mechanism in Neural Networks for NLP slide 41
The phrase "the attention mechanism is defined as" suggests that this is the one and only definition of attention, however there are many attention mechanisms. The effect from some is evaluated here.
I'd suggesting rephrasing it to "additive attention is defined as" as that's the commonly used name for the type of attention on that slide, or to describe the mechanism more general by declaring
and noting that one example is
This is the coordination issue for fixing the closed captions of Lecture 9: https://github.com/sebastian-hofstaetter/teaching/blob/master/advanced-information-retrieval/Lecture%209%20-%20Closed%20Captions.md
If you want to fix errors, please leave a short comment here before starting to block the issue. Thanks!
This is the coordination issue for fixing the closed captions of Lecture 4: https://github.com/sebastian-hofstaetter/teaching/blob/master/advanced-information-retrieval/Lecture%204%20-%20Closed%20Captions.md
If you want to fix errors, please leave a short comment here before starting to block the issue. Thanks!
This is the coordination issue for fixing the closed captions of Lecture 2: https://github.com/sebastian-hofstaetter/teaching/blob/master/advanced-information-retrieval/Lecture%202%20-%20Closed%20Captions.md
If you want to fix errors, please leave a short comment here before starting to block the issue. Thanks!
In lecture 5 video from 10:00 until 10:30 the sound is missing.
This is the coordination issue for fixing the closed captions of Lecture 7: https://github.com/sebastian-hofstaetter/teaching/blob/master/advanced-information-retrieval/Lecture%207%20-%20Closed%20Captions.md
If you want to fix errors, please leave a short comment here before starting to block the issue. Thanks!
This is the coordination issue for fixing the closed captions of Lecture 2: https://github.com/sebastian-hofstaetter/teaching/blob/master/advanced-information-retrieval/Lecture%203%20-%20Closed%20Captions.md
This time it also missed a couple of titles (i don't know why), please add them as well from the slides.
If you want to fix errors, please leave a short comment here before starting to block the issue. Thanks!
This is the coordination issue for fixing the closed captions of Lecture 8: https://github.com/sebastian-hofstaetter/teaching/blob/master/advanced-information-retrieval/Lecture%208%20-%20Closed%20Captions.md
If you want to fix errors, please leave a short comment here before starting to block the issue. Thanks!
In the formula for the score (last line, Part 2), shouldn't this be subscripted to the CLS output as for r in slide 9 ?
In shortened Latex-Notation:
s = W * BERT_{b..l}(...)_{CLS}
This is the coordination issue for fixing the closed captions of Lecture 6: https://github.com/sebastian-hofstaetter/teaching/blob/master/advanced-information-retrieval/Lecture%206%20-%20Closed%20Captions.md
If you want to fix errors, please leave a short comment here before starting to block the issue. Thanks!
This is the coordination issue for fixing the closed captions of Lecture 10: https://github.com/sebastian-hofstaetter/teaching/blob/master/advanced-information-retrieval/Lecture%2010%20-%20Closed%20Captions.md
If you want to fix errors, please leave a short comment here before starting to block the issue. Thanks!
Only the generated captions are available in the video.
On Slide 32 of Lecture 6 - Transformer and BERT Pre-training.pdf it says "[...], as man more moving parts are involved" instead of "[...], as many more moving parts are involved".
hi, It's really awesome and useful learning materials.
But can you support us the PowerPoint files for the lectures PDF files ?
thanks
This is the coordination issue for fixing the closed captions of Lecture 0: https://github.com/sebastian-hofstaetter/teaching/blob/master/advanced-information-retrieval/Lecture%200%20-%20Closed%20Captions.md
If you want to fix errors, please leave a short comment here before starting to block the issue. Thanks!
Is there a BibTeX entry that I can use to cite this lecture? Thanks in advance.
A declarative, efficient, and flexible JavaScript library for building user interfaces.
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google ❤️ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.