gigi81/elastico

Powershell module for Elasticsearch

elastico's Issues

Implement scrollapi

I tested the new -From parameter but it doesn't seem to be working properly. For example:

Search-ElasticV5 -Node es01.test.int:9200 -Index logstash-windows-* -from 10000 -Size 100

Throws an error of:

Search-ElasticV5 : ServerError: 500Type: search_phase_execution_exception Reason: "all shards failed" CausedBy: "Type: query_phase_execution_exception Reason: "Result window is too large, from + size must be less than or equal to: [10000] but was [10100]. See the scroll api for a more efficient way to request large data sets. This limit can be set by changing the [index.max_result_window] index level setting.""

Same search but with size of 10,000:
Search-ElasticV5 -Node es01.test.int:9200 -Index logstash-windows-* -from 10000 -Size 10000

Search-ElasticV5 : ServerError: 500Type: search_phase_execution_exception Reason: "all shards failed" CausedBy: "Type: query_phase_execution_exception Reason: "Result window is too large, from + size must be less than or equal to: [10000] but was [20000]. See the scroll api for a more efficient way to request large data sets. This limit can be set by changing the [index.max_result_window] index level setting.""

Do you know what would be causing this?

Limited to 10,000 results

Currently if I have a query with results larger than 10,000 I get the following error message:

"Result window is too large, from + size must be less than or equal to: [10000] but
was [100000]. See the scroll api for a more efficient way to request large data sets. This limit can be set by changing the [index.max_result_window] index level setting."

Is there any way the scroll api can be added to allow retrieving more results?

Security support

Is there a way to specify credentials when using Search-ElasticV5?

If start from scratch

would it be better to write just pwsh module on powershell with json quotes isntead of C# boilerplate? or may be es has some kind of swagger/openapi generator?

Unclear how to use....

Hi Gigi,

Thanks for the great powershell module, but I'm breaking my head over how to use it...

Install-Module Elastico

Get-ElasticV5ClusterHealth -Node "http://localhost:9200"
$result = Search-ElasticV5 -Node $Node -Index abbacampingsindex -Fields "websiteFields.campsiteId","websiteFields.images.image" -Size 100
$documents = $result.Documents
$documents.GetEnumerator() | ForEach-Object {
    $json = $_.websiteFields | ConvertTo-Json
    $json
}

does not work.... I see data, but can't get it out. I can convert to JSON string with ConvertTo-Json, but would like to access the fields.

Do you have some sample PowerShell code to show how to query and use results?

Regards,
Serge

Search-ElasticV2 : ServerError: 400Type: search_phase_execution_exception Reason: "all shards failed"

Every time I try to run a basic query I get this error:
Search-ElasticV2 : ServerError: 400Type: search_phase_execution_exception Reason: "all shards failed"
I am using the query Kibana uses for a standard query with all the "fluff" stripped out, so I'm pretty sure the syntax is correct. I can run Get-ElasticV2Index on my cluster with no problems.

Can you provide me with a simple query (return 50 records or something) that I can try and troubleshoot my usage with?