Comments (3)
Thanks a lot for your advice!
from flan.
Hi @Serena-LiuWx thank you for your kind words and interest! Unfortunately, it is not within my power to release all the experiment code, as much as I would have liked to. It was a huge push to get the (significant) approvals required just to re-create an external version of the data processing pipeline you now see here.
However, these experiments should not be hard to reproduce using public infrastructure like seqio and T5X. There are also a lot of repositories that have released instruction finetuning code on top of many models, including T5 (e.g. T0). You should be able to swap out the training data and make it work.
Hopefully this helps, and best of luck!
from flan.
is the training code out yet ?
from flan.
Related Issues (20)
- Datafile AESLC-master.zip meet non_matching_checksum_error
- Broken Dataset Links in FLAN Repository HOT 1
- Question about data source splits
- Trying to access `splits['train']` but `splits` is empty
- Reproducing the flan_v2 results of T5-xl HOT 3
- Code for mixing Enrico sets? HOT 2
- Thank you for your efforts. This is a great job!I have a problem. Why is there only 70 tasks in this FLAN2021_submix_original, and it seems that there are over 140 in the paper? HOT 1
- Could you share the training loss to improve reproducibility? HOT 4
- [Question] Training data formatting for other custom models
- Questions about the Flan Held-Out Tasks (pubmed_qa) and experiment details in the flan collection paper
- Doubt about the TARGET parameter in the dataset
- Issue generating flan2021 submix HOT 1
- Does anyone know which 282 tasks are used? HOT 1
- AESLC Checksum error HOT 4
- No train split in `adversarial_qa_dbert_answer_the_following_q_template_0to10_no_opt_x_shot`
- some Enrico COT entries seem odd HOT 1
- How many samples were used to train Flan-T5?
- Finetuning is definitely better than zero-shot, this is inevitable. So how should I understand the title of this paper?
- Where can I find the test mixture and its templates to reproduce the results in the paper?
- Links to Enrico Shippole FLAN dataset are missing HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from flan.