linjieli222 Goto Github PK

attrexp

attractiveness experiments on Amazon MTurk

bottom-up-attention

Bottom-up attention model for image captioning and VQA, based on Faster R-CNN and Visual Genome

cc

Creative Commons copyright license files

diffusers

🤗 Diffusers: State-of-the-art diffusion models for image and audio generation in PyTorch

hero

Research code for EMNLP 2020 paper "HERO: Hierarchical Encoder for Video+Language Omni-representation Pre-training"

hero_video_feature_extractor

Video Feature Extraction Code for EMNLP 2020 paper "HERO: Hierarchical Encoder for Video+Language Omni-representation Pre-training"

merlot-1

MERLOT: Multimodal Neural Script Knowledge Models

mil-nce_howto100m

PyTorch GPU distributed training code for MIL-NCE HowTo100M

pythia

A modular framework for vision & language multimodal research from Facebook AI Research (FAIR)

seada-vqa

A pytorch implemetation of data augmentation method for visual question answering

simi_pair

slowfast

PySlowFast: video understanding codebase from FAIR for reproducing state-of-the-art video models.

tvretrieval

PyTorch implementation of XML on TVR dataset - TVR: A Large-Scale Dataset for Video-Subtitle Moment Retrieval

value

Video And Language Understanding Evaluation

vqa2vln-tutorial.github.io

vqa_regat

Research Code for ICCV 2019 paper "Relation-aware Graph Attention Network for Visual Question Answering"

x-decoder

[CVPR 2023] Official Implementation of X-Decoder for generalized decoding for pixel, image and language