p0dalirius/ctfd-parser

A python script to dump all the challenges locally of a CTFd-based Capture the Flag.

A python script to dump all the challenges locally of a CTFd-based Capture the Flag.

Features

• Connects and logins to a remote CTFd instance.
• Dumps all the challenges by category.
• Download attached files.
• Prints a ✔️ or a ❌ to indicate if the challenge is solved or not.
• Setup template file in challenge dir : writeup.md / solve.py (optionnal)

Usage

$ ./ctfd_parser.py -h
       _____ _______ ______  _   _____
      / ____|__   __|  ____|| | |  __ \
     | |       | |  | |__ __| | | |__) |_ _ _ __ ___  ___ _ __
     | |       | |  |  __/ _` | |  ___/ _` | '__/ __|/ _ \ '__|    v1.1
     | |____   | |  | | | (_| | | |  | (_| | |  \__ \  __/ |
      \_____|  |_|  |_|  \__,_| |_|   \__,_|_|  |___/\___|_|       @podalirius_

usage: ctfd_parser.py [-h] -t TARGET -u USER -p PASSWORD [-T THREADS] [-v]
or
usage: ctfd_parser.py [a config.json must be in project root dir, containing a least target, user & password]

CTFdParser

optional arguments:
  -h, --help            show this help message and exit
  -t TARGET, --target TARGET
                        CTFd target (domain or ip)
  -u USER, --user USER  Username to login to CTFd
  -p PASSWORD, --password PASSWORD
                        Password to login to CTFd
  -T THREADS, --threads THREADS
                        Number of threads (default: 8)
  -v, --verbose         Verbose mode. (default: False)
  -I, --initfile        Activate setup template files

Demonstration

Contributors

Pull requests are welcome. Feel free to open an issue if you want to add other features.

ctfd-parser's Issues

[bug] Script didn't download attached files

Tried your script on a recent CTFd instance.
I got all readmes from challenges but no attached files (mostly small PNG/JPG/MP3 files)
Sample Readme:

# Chall title
**Category** : abc
**Points** : abc
text OK
## Files :

Is there a way to debug my issue (verbose mode didn't add any information compared to the normal mode)

[bug] File Download Issue When Header Doesn't Include "Content-Length"

When parsing https://byu.ctfd.io,
In line 120:
size = int(r.headers["Content-Length"])

throws an error, because headers["Content-Length"] does not exist.

Commented that line and set size = 0

However, when investigating what size was being used for, I saw that it takes two paths in line 127. Was not obvious what the difference was between
lines 128-131 and 133-136

[bug] File download issue

When parsing https://osintgames.ctfd.io, I get all the questions in .md files, but no photos or videos were pulled.

Challenge Files Do Not Download

connection_info = chall_json["connection_info"]
if len(connection_info) != 0:
    f.write("%s\n\n" % connection_info)

The second line above causes an exception and challenge files do not download. This seems to happen when connection_info == None.

Changed it to
if connection_info != None and len(connection_info) != 0:

[enhancement] "429 Too Many Requests" isn't processed

(I can do it tonight)

Enhancement Request: Support Cloudflare

I believe challenges hosted behind Cloudflare don't work currently. Here is an example:
https://ctf.heroctf.fr/