shoaibahmed/awesome-chatgpt

A repository containing interesting demos / failure cases of ChatGPT

Awesome ChatGPT

This repo summarises interesting demos / analysis with ChatGPT.

Latest News 🎉

• 23/3/23: ChatGPT Plugins announced
• 9/3/23: ChatGPT integrated with other foundation models to be able to process images
• 1/3/23: ChatGPT API released
• 7/2/23: GPT successor integrated into Bing search
• 6/2/23: Google announces ChatGPT rival
• 2/2/23: ChatGPT reaches 100 million users

Migration to GPT-4

We are maintaining a new repository for interesting GPT-4 demos and analysis. Please do check it out: awesome-GPT-4

Table of Contents

• Awesome ChatGPT
  • Latest News 🎉
  • Migration to GPT-4
  • Table of Contents
  • Cool Demos
  • Analysis / Failure Cases
  • Threads
  • ChatGPT Utilities
  • Papers authored by ChatGPT
  • ChatGPT News
  • Detecting AI generated content
  • Competitors
  • Missing something?
  • License

Cool Demos

ChatGPT explaining bugs in the code

• https://twitter.com/amasad/status/1598042665375105024?s=20&t=vCy1yu328mi0ae9JCOHaQw

  

ChatGPT can help detect security vulnerabilities

• https://twitter.com/mazen160/status/1598351725756301313?s=20&t=vCy1yu328mi0ae9JCOHaQw

  

Build a complete virtual machine inside ChatGPT, with access to terminal

• https://www.engraved.blog/building-a-virtual-machine-inside/

  

Generate appropriate prompts for text-to-image generation models

• https://twitter.com/GuyP/status/1598020781065527296?s=20&t=vCy1yu328mi0ae9JCOHaQw

  

Write a web-scraping app in streamlit

• https://twitter.com/DataChaz/status/1599163972703645696?s=20&t=vCy1yu328mi0ae9JCOHaQw

  

Creative writing collaboration

• https://andrewmayneblog.wordpress.com/2022/11/30/collaborative-creative-writing-with-openais-chatgpt/

  

Generate regular expressions

• https://twitter.com/DataChaz/status/1599522274389807104?s=20&t=vCy1yu328mi0ae9JCOHaQw

  

Generate Youtube scripts using ChatGPT

• https://twitter.com/1littlecoder/status/1599706368105394177?s=20&t=vCy1yu328mi0ae9JCOHaQw

  

Explain code via incorporating styles from people with different backgrounds

• https://twitter.com/goodside/status/1598129631609380864?s=20&t=vCy1yu328mi0ae9JCOHaQw

  

Using ChatGPT as a postgres database

• https://twitter.com/ankrgyl/status/1599539317332140032?s=20&t=vCy1yu328mi0ae9JCOHaQw

  

Generate websites using ChatGPT featuring chatGPT and text-to-image generated content

• https://twitter.com/DataChaz/status/1598845712975872000?s=20&t=vCy1yu328mi0ae9JCOHaQw

  

Generating synthetic / fake datasets

• https://twitter.com/jrieke/status/1598843863619481605?s=20&t=vCy1yu328mi0ae9JCOHaQw

  

Create a complete diet and weight loss plan using ChatGPT

• https://twitter.com/anothercohen/status/1599531037570502656?s=20&t=vCy1yu328mi0ae9JCOHaQw

  

Use ChatGPT to generate music

• https://twitter.com/teropa/status/1598713756074246145?s=20&t=vCy1yu328mi0ae9JCOHaQw

  

Ask ChatGPT to fix broken HTML

• https://twitter.com/GregBernhardt4/status/1598819609519394816?s=20&t=vCy1yu328mi0ae9JCOHaQw

  

Use ChatGPT to prepare for ML interviews

• https://twitter.com/omarsar0/status/1599874508541743104?s=20&t=vCy1yu328mi0ae9JCOHaQw

  

Generate American flag using ChatGPT

• https://twitter.com/goodside/status/1599873570431434752?s=20&t=vCy1yu328mi0ae9JCOHaQw

  

Attempted Political Topology quiz -- ChatGPT demonstrated moderate left-learning political oritentation

• https://twitter.com/DavidRozado/status/1599731435275157506?s=20&t=vCy1yu328mi0ae9JCOHaQw

  

Demonstrated that ChatGPT removes all strings of form without any spaces in the sequence

• https://twitter.com/goodside/status/1599784399331262464?s=20&t=vCy1yu328mi0ae9JCOHaQw

  

• Successfully reproduced

  

ChatGPT can respond with a particular phrase when it doesn’t want to answer the given question

• https://twitter.com/hi_frye/status/1599537366368411649?s=20&t=vCy1yu328mi0ae9JCOHaQw

  

• Successfully reproduced

  

ChatGPT can be used to write a Twitter bot

• https://medium.com/@rlodha1/how-i-used-chat-gpt-to-build-a-twitter-bot-without-any-programming-language-35bbc43f6ad

  

Asking ChatGPT for responses as an engineer under the fear of being fired by Elon Musk if you didn’t produce enough code

• https://twitter.com/ChatGPTGoneWild/status/1599961082558545921?s=20&t=vCy1yu328mi0ae9JCOHaQw

  

Asking ChatGPT regarding the fastest marine animal -- fails in an interesting way

• https://twitter.com/ChatGPTGoneWild/status/1599795626866520069?s=20&t=kjGUWpBdhBwLdVhfR9VxEg

  

Use ChatGPT instead of going to a credit repair lawyer

• https://twitter.com/jbrowder1/status/1599812828793556993?s=20&t=vCy1yu328mi0ae9JCOHaQw

  

Use ChatGPT to attempt a full SAT test exam -- attained 52nd percentile

• https://twitter.com/davidtsong/status/1598767389390573569?s=20&t=AOTnLO7DxrVAiOPDhc969A

  

Suggesting and writing grant proposals

• https://twitter.com/RobLanfear/status/1599495864976027648?s=20&t=vCy1yu328mi0ae9JCOHaQw

  

ChatGPT passed the 2022 AP Computer Science exam

• https://twitter.com/t3dotgg/status/1599551203683467264?s=20&t=vCy1yu328mi0ae9JCOHaQw

• https://gist.github.com/Gaelan/cf5ae4a1e9d8d64cb0b732cf3a38e04a

  

Use ChatGPT to write a wordpress plugin

• https://twitter.com/johnofhousejohn/status/1599932681076473856?s=20&t=7jAbTF0cSLM1H9rt9NCqew

  

Use ChatGPT to write a rap about exploiting a buffer overflow

• https://twitter.com/LiveOverflow/status/1599669777361825794?s=20&t=7jAbTF0cSLM1H9rt9NCqew

  

Used ChatGPT to write cold email to recruiters

• https://twitter.com/archiexzzz/status/1599677498274766848?s=20&t=7jAbTF0cSLM1H9rt9NCqew

  

Use ChatGPT to generate UI options

• https://twitter.com/hakimel/status/1599711644929740800?s=20&t=7jAbTF0cSLM1H9rt9NCqew

  

Use ChatGPT to clone a hypothetical ChatGPT repo

• https://twitter.com/quasimondo/status/1599678917039620096?s=20&t=7jAbTF0cSLM1H9rt9NCqew

  

• Failed to reproduce

  

• Simulate terminal command doesn’t work

ChatGPT can understand implicatures

• https://twitter.com/LauraRuis/status/1599497977173008384?s=20&t=vCy1yu328mi0ae9JCOHaQw

  

ChatGPT narrates the story of Jesus’ crucifixion in the style of a sportscaster

• https://twitter.com/GanWeaving/status/1599838283550244864?s=20&t=7jAbTF0cSLM1H9rt9NCqew

  

ChatGPT can translate code between languages

• https://twitter.com/rdias002/status/1600019405303611392?s=20&t=7jAbTF0cSLM1H9rt9NCqew

  

Data wrangling and manipulation using ChatGPT

- https://twitter.com/DataChaz/status/1600135591877742592?s=20&t=FldJBA2NKeurC3LY2JtSIg

ChatGPT can solve undergrad-level problems on computational complexity

• https://twitter.com/OfirPress/status/1600434732705415171?s=20&t=g0-mWJ24npbxlXQQ8Loczw

  

ChatGPT can execute complicated programs if you ask it to print all state updates

• https://twitter.com/GrantSlatton/status/1600388425651453953?s=20&t=g0-mWJ24npbxlXQQ8Loczw

  

Using ChatGPT for generating marketing schemes

• https://twitter.com/heykahn/status/1599749880515244034?s=20&t=VZfUXFnjm0vVLqwP5VjfeA

  

ChatGPT as a research assistant working on a new research idea

• https://twitter.com/SamuelAlbanie/status/1600950546256777216?s=20&t=WG7o3A2teeeDjYOh3kkorQ

  

ChatGPT IQ and personality test -- IQ of 82 / personality test - ISTJ

• https://twitter.com/debarghya_das/status/1601044729759641600

• https://twitter.com/Aella_Girl/status/1601378034317111296?s=20&t=X8hCUxTEDLllTz1FaHKYSQ (personality test - ISTJ)

  

Use ChatGPT to attempt the AWS cloud certification. ChatGPT: 800 / 1000 -- pass score is 720

• https://twitter.com/StephaneMaarek/status/1600864604220964871?s=20&t=f20SUicqapNaRTKoAR2xnQ

  

Thank you note to students using ChatGPT

• https://twitter.com/jbhuang0604/status/1601020898303438849?s=20&t=f20SUicqapNaRTKoAR2xnQ

  

Writing a cold email to a professor expressing your interest in their research

• https://twitter.com/CSProfKGD/status/1601222306562740225?s=20&t=f20SUicqapNaRTKoAR2xnQ

  

Playing chess using natural language interface

• https://twitter.com/MattNiessner/status/1601549899010822144?s=20&t=dJzFmbEwQLtJfB6xYc1AMw

• https://www.chess.com/forum/view/general/chat-gpt

  

Using ChatGPT to play Tetris

• https://twitter.com/zehavoc/status/1599193444043268096

  

Using ChatGPT to play Tic Tac Toe

• https://twitter.com/zehavoc/status/1599196623141470208

  

Using ChatGPT to for object recognition based on a textual description of the given image

• https://twitter.com/J_Roberts_1/status/1600931039446151168

  

Use ChatGPT as a search engine

• https://twitter.com/jdjkelly/status/1598021488795586561

  

Using ChatGPT as an email writing assistant

• https://twitter.com/MatiasNisenson/status/1599186490483150850?s=20&t=hX3fNnQ97jNVJ1aSoH8MCg

  

ChatGPT has significant knowledge of computer vision models

• https://twitter.com/ahatamiz1/status/1601671185699606528?s=20&t=s7ByjiyFIh7uPDE7T3YQMA

  

Use ChatGPT to attempt the practice bar exam -- passed with 70% marks

• https://twitter.com/pythonprimes/status/1601664776194912256?s=20&t=mJ1m-NJAb_o8DFmsuiRQfg

  

Use ChatGPT to write unit tests

• https://twitter.com/DataChaz/status/1601982020279832577?s=20&t=KPYtMZP8EhRetVY1LAExMQ

  

Using ChatGPT to create virtual chat room

• https://twitter.com/DataChaz/status/1601982020279832577?s=20&t=KPYtMZP8EhRetVY1LAExMQ

  

Using ChatGPT as a "BF simulator"

• https://twitter.com/michael_nielsen/status/1598476830272802816

  

Ask ChatGPT to generate a new human emotion

• https://twitter.com/TobiasJolly/status/1603083739852046337?s=20&t=WYFRpchkDqK_rISIbtmJ1g

  

Using ChatGPT to bargain for an Adobe subscription deal

• https://twitter.com/der_flow_/status/1599757320551948289?s=20&t=K2GTWlA3M0q2c6_VxBKUDA

  

ChatGPT obtains SoTA accuracy on the Tuebingen causal discovery benchmark

• https://twitter.com/amt_shrma/status/1605240883149799424?s=20&t=11bpq35EUUQ-uue1h-N0hw

  

Deminify JavaScript code with descriptive variable names using ChatGPT

• https://twitter.com/mathemagic1an/status/1610147883894079488?s=20&t=Nm_qtlv4Vx47oi8pX0-kDQ

  

ChatGPT passes as a C+ student on 4 real exams at the University of Minnesota Law School

• https://twitter.com/johnjnay/status/1619412924623368193?s=20&t=QnIMyfOFUW7PNgSaP-Cmgw

  

Analysis / Failure Cases

ChatGPT being sued by an Australian mayor for falsely accusing him of sexually harassing his students

• https://twitter.com/JonathanTurley/status/1643681636452638738?s=20

Analysis of the context window size for ChatGPT (estimated context window size is ~8192)

• https://twitter.com/goodside/status/1598874674204618753?s=20&t=KMjALYqVD25Ox49ftYtR-Q

  

ChatGPT explains why abacus is faster than a GPU

• https://twitter.com/AndrewYNg/status/1600284752258686976?s=20&t=N5wT4zoj_Tw3h4cCrxWT7A

  

ChatGPT produces incorrect code implementations -- tested on the development of Snake game using Python

• https://twitter.com/debarghya_das/status/1600319707545972736?s=20&t=zAi5dfLnTjZABm-pCOe7bw

  

Analysis of racism and sexism exhibited by ChatGPT by asking to write code that predicts if someone is senior

• https://twitter.com/abhi1thakur/status/1600016676052996099?s=20&t=vCy1yu328mi0ae9JCOHaQw

  

• Successfully reproduced (fails sometimes though)

  

Analysis of sexism exhibited by ChatGPT by asking to write code that predicts if someone will be a good scientist

• https://twitter.com/spiantado/status/1599462375887114240?s=20&t=tPsIN9JugwbB4jj9JgOLuw

  

• Failed to reproduce (might be due to stochasticity)

  

Attempting to pull the cow milk joke on ChatGPT

• https://twitter.com/PR0GRAMMERHUM0R/status/1599961858039062528?s=20&t=vCy1yu328mi0ae9JCOHaQw

  

• Failed to reproduce

  

ChatGPT makes up content

• https://twitter.com/Michael_J_Black/status/1598206216525725697?s=20&t=vCy1yu328mi0ae9JCOHaQw

Showed that ChatGPT can generate sexist and racist lyrics for a song when prompted correctly

• https://twitter.com/numetaljacket/status/1599540643025793025?s=20&t=vCy1yu328mi0ae9JCOHaQw

  

• Failed to reproduce

  

Attempted to show the mode’s bias by asking it to analyze if someone should be tortured

• https://twitter.com/janbhwilhelm/status/1599522255775539205?s=20&t=7jAbTF0cSLM1H9rt9NCqew

  

• Failed to reproduce

  

Ask ChatGPT to write something unintelligible -- writes random sequence of characters

• https://twitter.com/_andreilupu/status/1603041883680391170?s=20&t=8mNRu2NXQn2oEetAoZ5A5A

  

• Successfully reproduced

  

ChatGPT says that it is never morally permissible to utter a racist slur even if that can stop a nuclear bomb from killing millions of people

• https://twitter.com/aaronsibarium/status/1622425697812627457?s=20&t=yPfUsQLT_jZOK7ttRrnhMw

  

Threads

• An amazing list of ChatGPT prompts to elicit different behaviors from the model

  • https://huggingface.co/datasets/fka/awesome-chatgpt-prompts

• A very recent ChatGPT account posting interesting stuff

  • https://twitter.com/ChatGPTGoneWild

• A list of 15 ChatGPT use-cases

  • https://twitter.com/DataChaz/status/1599754823074598912

• Covering strengths and weaknesses of ChatGPT for bioinformatics

  • https://twitter.com/simocristea/status/1599834929751547905

• A thread covering different industries that ChatGPT will impact

  • https://twitter.com/BrianFOConnor/status/1603032772804857856?s=20&t=DJqk6N4RYvbGQ00-XGtbiQ

• A good discussion on trying to reproduce some failure cases of GPT-davinci-002 -- mostly, ChatGPT succeeds, leaving the previous analysis of failure cases ineffective

  • https://twitter.com/stanislavfort/status/1599417463199830017

• Ways to get around ChatGPT's safeguards

  • https://twitter.com/davisblalock/status/1602600453555961856?s=20&t=uaLkWR6vEzU_KnPkxFli7g

• Couple of tweets spectulating / discussing the costs of running ChatGPT

  • https://twitter.com/tomgoldsteincs/status/1600196981955100694
  • https://twitter.com/sama/status/1599671496636780546
  • https://twitter.com/nbashaw/status/1599949577821786113

• GitHub repository summarizing specifically the failure modes of ChatGPT

  • https://github.com/giuven95/chatgpt-failures

ChatGPT Utilities

ChatGPT integrated with other foundation models by Microsoft to enable processing of images

• https://github.com/microsoft/visual-chatgpt

  

An API wrapper around ChatGPT's web interface

• https://github.com/acheong08/ChatGPT

  

ChatGPT integration for Telegram (also supports Dall-E / Stable Diffusion)

• https://twitter.com/altryne/status/1598902799625961472?s=20&t=vCy1yu328mi0ae9JCOHaQw

  

ChatGPT VS Code extension - automatically write new code from scratch, ask questions, get explanations, refactor code, find bugs and more!

• https://github.com/mpociot/chatgpt-vscode

• https://marketplace.visualstudio.com/items?itemName=timkmecl.chatgpt

  

ChatGPT Twitter bot

• https://twitter.com/chatgptbot

  

• Chrome extension that allows ChatGPT to search the internet

  • https://twitter.com/hahahahohohe/status/1599839969396154369?s=20&t=vCy1yu328mi0ae9JCOHaQw

• Screenshot browser extension to help save ChatGPT outputs

  • https://twitter.com/Saboo_Shubham_/status/1600035851525918720

Papers authored by ChatGPT

Due to its usefulness in aiding academic research, ChatGPT has begun to be named as an author on papers.

Open artificial intelligence platforms in nursing education: Tools for academic progress or abuse?

• https://www.sciencedirect.com/science/article/pii/S1471595322002517

  

Performance of ChatGPT on USMLE: Potential for AI-Assisted Medical Education Using Large Language Models

• https://europepmc.org/article/PPR/PPR586708

  

A Conversation on Artificial Intelligence, Chatbots, and Plagiarism in Higher Education

• https://link.springer.com/article/10.1007/s12195-022-00754-8

  

ChatGPT News

• Stack overflow has banned users from posting chatgpt-based generated content
  • https://twitter.com/jjvincent/status/1599743434360639489?s=20&t=vCy1yu328mi0ae9JCOHaQw
  • https://meta.stackoverflow.com/questions/421831/temporary-policy-chatgpt-is-banned

Official ChatGPT API update

• https://twitter.com/OpenAI/status/1615160228366147585

  

AI-Written Text Classifier

• https://twitter.com/OpenAI/status/1620484691462852609

  

ChatGPT Plus

• https://www.bbc.co.uk/news/technology-64492750

• https://twitter.com/OpenAI/status/1620846589949640705

  

ChatGPT reaches 100 million users

• https://www.theguardian.com/technology/2023/feb/02/chatgpt-100-million-users-open-ai-fastest-growing-app

  

Google announces ChatGPT rival

• https://www.bbc.co.uk/news/technology-64546299

  

Successor of GPT models (including ChatGPT and GPT-3.5) integrated into the new Bing search

• https://blogs.microsoft.com/blog/2023/02/07/reinventing-search-with-a-new-ai-powered-microsoft-bing-and-edge-your-copilot-for-the-web/

  

Detecting AI generated content

GPTZero: Performs detection using Perplexities computed using 350M parameter GPT-2 model

• https://gptzero.me/

  

OpenAI machine generated content classifier

• https://openai.com/blog/new-ai-classifier-for-indicating-ai-written-text/

  

Watermark for LLMs to detect machine generated content

• https://arxiv.org/abs/2301.10226

  

DetectGPT: Zero-Shot Machine-Generated Text Detection using Probability Curvature

• https://ericmitchell.ai/detectgpt/

• https://arxiv.org/abs/2301.11305

  

Competitors

• Claude, Anthropic - https://scale.com/blog/chatgpt-vs-claude
• Sparrow, DeepMind - https://www.deepmind.com/blog/building-safer-dialogue-agents

Missing something?

Please feel free to generate a PR with new and interesting demos that you think we missed.

License

MIT