cmusam / fortune500 Goto Github PK

View Code? Open in Web Editor NEW

84.0 4.0 101.0 3.39 MB

Fortune 500 company lists since 1955 in CSV format, mostly parsed using Beautiful Soup

Python 0.02% HTML 99.98%

business economics finance csv fortune

fortune500's Issues

Inconsistent company name: trailing dot

Company names have trailing dot in some files but not others. For example:

fortune500-2007.csv has company State Farm Insurance Cos, but
fortune500-2008.csv has company State Farm Insurance Cos.

2020 Data

Here is 2020 data pulled from: https://fortune.com/fortune500/2020/search/

Data: https://pastebin.com/SPqSYk9n

Pulled all 1k using the code below by clicking through each 100 results and running the code below. Collected today.

// If text is not set initialize and add heading row.
if (typeof(text) == 'undefined' || !text.length){

    var text = ""
    // Add Headings
    var rowText = ""; 
    $$('.searchResults__columnTitle--1Brf4').forEach((e)=>{ rowText += e.textContent.replace(',', ' ') + ","; });
    text += rowText.slice(0, -1) + "\n";
};


// Loop through table adding rows.
$$('.rt-tr-group').forEach((e)=>{ var rowText = ""; 
                                  e.querySelectorAll('span').forEach((i) => {
                                      rowText += i.textContent.replace(',', '') + ","; 
                                      }); 

                                      text += rowText.slice(0, -1) + "\n"; 
                                      }
                           );