golsa-tahmasebzadeh/mmg-newsphoto

Multimodal Geolocation Estimation of News Photos

This is the official GitHub page for the paper (link here):

Golsa Tahmasebzadeh, Sherzod Hakimov, Ralph Ewerth, Eric Müller-Budack: "Multimodal Geolocation Estimation of News Photos". In: European Conference on Information Retrieval (ECIR), Dublin, Ireland, 2023, 204–220.

Contents

• Installation
• Download Data & Checkpoints
• Reproduce Results
• Training

Installation

git clone https://github.com/golsa-tahmasebzadeh/MMG-NewsPhoto1.git
python -m venv venv
source venv/bin/activate
pip install -r requirements.txt

Download Data & Checkpoints

Download the data and checkpoints for MMG-NewsPhoto from here and for BreakingNews from here.

Reproduce Results

To evaluate the models based on MMG-NewsPhoto dataset:

python mmg_news/eval.py --model_name <MODELNAME> --test_check_point <CHECKPOINT>

To evaluate the models based on Breakingnews dataset:

python breakingnews/eval.py --model_name <MODELNAME> --test_check_point <CHECKPOINT>

Training

To train the models based on MMG-NewsPhoto dataset:

python mmg_news/train.py \
--model_name <MODELNAME> \
--resume <CHECKPOINT>

To train the models based on BreakingNews dataset:

python breakingnews/bn_train.py \
--model_name <MODELNAME> \
--resume <CHECKPOINT> 

Citation

@inproceedings{DBLP:conf/ecir/TahmasebzadehHEM23,
  author       = {Golsa Tahmasebzadeh and
                  Sherzod Hakimov and
                  Ralph Ewerth and
                  Eric M{\"{u}}ller{-}Budack},
  title        = {Multimodal Geolocation Estimation of News Photos},
  booktitle    = {Advances in Information Retrieval - 45th European Conference on Information
                  Retrieval, {ECIR} 2023, Dublin, Ireland, April 2-6, 2023, Proceedings,
                  Part {II}},
  series       = {Lecture Notes in Computer Science},
  volume       = {13981},
  pages        = {204--220},
  publisher    = {Springer},
  year         = {2023},
  url          = {https://doi.org/10.1007/978-3-031-28238-6\_14},
  doi          = {10.1007/978-3-031-28238-6\_14}
}