serp-spider/serps-cli

:spider: Scrape search engines from the terminal

serps-cli's Issues

specify a page/resultsPerPage in the CLI

Hello,

I tried searching the source, etc, for a way to specify how much results I would like to search for example first 20pages.

How would I specify offset or page number?

thank you

Proxy does not works well

Hi guys!

Recently I've been used proxy rotator with serp-cli, and, unfortunately only a few requests works.

At first I think that would can be the proxies, but, I tested on my browser for example and works well.

There is anything I have to do to works nice serps + rotator proxies?

PS: The proxy is added by my hands on shell command.

The structure of my proxy is this:

bin/serps google:search "word" --res-per-page="100" --user-agent="Mozilla/5.0 (Windows NT 10.0) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/40.0.2214.93 Safari/537.36" --proxy="http://0.0.0.0:8080"

Thank you!

GetOptionKit\Exception\OptionConflictException: Option conflict: -c is already defined.

Hi guys,
Congrats for your work. Unfortunately I can't get it to work.
When cloning from github, and updating every project with composer update, i get this error when launching serps/serps-cli/bin/serps help 👍

GetOptionKit\Exception\OptionConflictException: Option conflict: -c is already defined.

`Trace:

0) GetOptionKit\OptionCollection->addOption(* key:compress spec:-c, --compress[=]  desc:compress type: gz, bz2

value =>
)
1) GetOptionKit\OptionCollection->add('c|compress?', 'compress type: gz, bz2')
2) CLIFramework\Command\ArchiveCommand->options(GetOptionKit\OptionCollection)
3) CLIFramework\CommandBase->_init()
4) CLIFramework\CommandBase->createCommand('CLIFramework\Command\ArchiveCommand')
5) CLIFramework\CommandBase->addCommand('archive', 'CLIFramework\Command\ArchiveCommand')
6) CLIFramework\CommandBase->addCommandGroup('Development Commands', [zsh => 'CLIFramework\Command\ZshCompletionCommand'bash => 'CLIFramework\Command\BashCompletionCommand'meta => 'CLIFramework\Command\MetaCommand'compile => 'CLIFramework\Command\CompileCommand'archive => 'CLIFramework\Command\ArchiveCommand'github:build-topics => 'CLIFramework\Command\BuildGitHubWikiTopicsCommand'])
7) CLIFramework\CommandBase->commandGroup('Development Commands', [zsh => 'CLIFramework\Command\ZshCompletionCommand'bash => 'CLIFramework\Command\BashCompletionCommand'meta => 'CLIFramework\Command\MetaCommand'compile => 'CLIFramework\Command\CompileCommand'archive => 'CLIFramework\Command\ArchiveCommand'github:build-topics => 'CLIFramework\Command\BuildGitHubWikiTopicsCommand'])
8) CLIFramework\Application->init()
9) SerpsCli\Console->init()
10) CLIFramework\CommandBase->_init()
11) CLIFramework\Application->run(['./serps', 'help'])
12) CLIFramework\Application->runWithTry(['./serps', 'help'])`

I'm on an Amazon Linux AMI (EC2) which seems to be RHEL FEDORA alike.

Any clue ?

Cheers,

Option conflict: -c is already defined

Hi !
I'm trying to install the client on Ubuntu using these steps :

1. _cd ~_
2. composer global require serps/cli

As I can't figure where it got installed, I used :
find / -name serps to figure it was installed here : /home/ubuntu/.config/composer/vendor/bin/serps help

But when executing /home/ubuntu/.config/composer/vendor/bin/serps help it returns :

GetOptionKit\Exception\OptionConflictException: Option conflict: -c is already defined.
Trace:
0) GetOptionKit\OptionCollection->addOption( key:compress spec:-c, --compress[=] desc:compress type: gz, bz2
value =>
)
1) GetOptionKit\OptionCollection->add('c|compress?', 'compress type: gz, bz2')
2) CLIFramework\Command\ArchiveCommand->options(GetOptionKit\OptionCollection)
3) CLIFramework\CommandBase->_init()
4) CLIFramework\CommandBase->createCommand('CLIFramework\Command\ArchiveCommand')
5) CLIFramework\CommandBase->addCommand('archive', 'CLIFramework\Command\ArchiveCommand')
6) CLIFramework\CommandBase->addCommandGroup('Development Commands', [zsh => 'CLIFramework\Command\ZshCompletionCommand'bash => 'CLIFramework\Command\BashCompletionCommand'meta => 'CLIFramework\Command\MetaCommand'compile => 'CLIFramework\Command\CompileCommand'archive => 'CLIFramework\Command\ArchiveCommand'github:build-topics => 'CLIFramework\Command\BuildGitHubWikiTopicsCommand'])
7) CLIFramework\CommandBase->commandGroup('Development Commands', [zsh => 'CLIFramework\Command\ZshCompletionCommand'bash => 'CLIFramework\Command\BashCompletionCommand'meta => 'CLIFramework\Command\MetaCommand'compile => 'CLIFramework\Command\CompileCommand'archive => 'CLIFramework\Command\ArchiveCommand'github:build-topics => 'CLIFramework\Command\BuildGitHubWikiTopicsCommand'])
8) CLIFramework\Application->init()
9) SerpsCli\Console->init()
10) CLIFramework\CommandBase->_init()
11) CLIFramework\Application->run(['/home/ubuntu/.config/composer/vendor/bin/serps', 'help'])
12) CLIFramework\Application->runWithTry(['/home/ubuntu/.config/composer/vendor/bin/serps', 'help'])*

same thing with the one installed in here : /home/ubuntu/serpspider/vendor/serps/cli/bin/serps help

Any clue to fix this ?
Am I doing something wrong ?

serps cli installation fail

Hi. I have run composer require to install serps cli on kali linux but it does not install. It creates zipped files instead in composer cache directory. How do i install this?

No Results

Serps CLI does not work for me:

./serps google:search --tld="com" "sineld"

command returns empty response:

{
    "initial-url": "https:\/\/www.google.com\/search?q=sineld",
    "url": "https:\/\/www.google.com\/search?q=sineld",
    "http-client": "curl",
    "evaluated": true,
    "isMobileDom": false,
    "natural-results-count": 0,
    "total-count": null,
    "natural-results": [],
    "related-searches": []
}