Comments (2)
0x416c616e
commented on August 31, 2024
I figured it out. It's because it's finding the first occurrence of "https://" in the "next page" line, but there are actually two links in that row: the "previous" button and the "next" button. So the problem is that in the first page, there is no "previous" page link. But in the 2nd page, the first link will be the "previous" button. So for page 1, the first link is page 2. But for page 2, the first link is previous, which is page 1.
Needs to change so that, for pages 2+, it uses the second link rather than the first one.
from clone_all.
0x416c616e
commented on August 31, 2024
fixed loop issue but now encountered a unicode parsing issue
from clone_all.
Related Issues (19)
- get username from command line arg HOT 2
- 2. build URL for repo page HOT 2
- 3. use requests to download the first repo file in html/ subfolder HOT 4
- 4. parse html and look for no repo string HOT 3
- 5. if #4 string is not found, exit program HOT 1
- 6. parse HTML file and look for "next repo" string (which may or may not be present) HOT 2
- 7. if #6 string is within the HTML file, proceed with getting next page HOT 2
- make issues for rest of design doc HOT 1
- account for 404 HOT 2
- test asio.py functions HOT 1
- 9. if there are next pages, download them all and loop HOT 3
- 10 find repo links from html HOT 9
- 11 add reset functionality HOT 3
- 12 use the github repo links to clone all the repos to the repos/ directory HOT 2
- copy this repo's asio.py to the asio repo
- fix UnicodeDecodeError when parsing emojis etc in git repo pages HOT 3
- delete all repo_page_X.html from html after cloning all repos HOT 2
- Make a "download all" option
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from clone_all.