When uploading a shapefile of an area of some square kilometers, with a simple rectangular shape and setting the season to include the current month until next month, I can see in journalctl, that the sentinelhub API returns too many requests
. This will happen on every subsequent (scheduled) retry. There is only this single site active, the account is not used with any other tool making any requests. No download is started.
Mar 22 02:45:52 localhost.localdomain start.sh[2387]: 2021-Mar-22 02:45:52.736 INFO [DefaultQuartzScheduler_Worker-9] o.e.s.scheduling.LookupJob - Starting job 'Lookup.Lookup-s2-hetzerath'
Mar 22 02:45:52 localhost.localdomain start.sh[2387]: 2021-Mar-22 02:45:52.746 INFO [DefaultQuartzScheduler_Worker-10] o.e.s.scheduling.RetryJob - Starting job 'Retry.Retry-s2-hetzerath'
Mar 22 02:45:52 localhost.localdomain start.sh[2387]: 2021-Mar-22 02:45:52.753 DEBUG [DefaultQuartzScheduler_Worker-9] o.e.s.scheduling.LookupJob - [site 'hetzerath',sensor 'Sentinel2'] Seasons defined: s1_2021 [2021-03-01,2021-04-01,2021-04-30]
Mar 22 02:45:52 localhost.localdomain start.sh[2387]: 2021-Mar-22 02:45:52.762 DEBUG [DefaultQuartzScheduler_Worker-10] o.e.s.scheduling.RetryJob - [site 'hetzerath',sensor 'Sentinel2'] Retry failed products
Mar 22 02:45:52 localhost.localdomain start.sh[2387]: 2021-Mar-22 02:45:52.764 INFO [DefaultQuartzScheduler_Worker-10] o.e.s.scheduling.RetryJob - [site 'hetzerath',sensor 'Sentinel2'] No products to retry
Mar 22 02:45:52 localhost.localdomain start.sh[2387]: 2021-Mar-22 02:45:52.764 DEBUG [DefaultQuartzScheduler_Worker-10] o.e.s.scheduling.RetryJob - [site 'hetzerath',sensor 'Sentinel2'] Retry last chance products
Mar 22 02:45:52 localhost.localdomain start.sh[2387]: 2021-Mar-22 02:45:52.765 DEBUG [DefaultQuartzScheduler_Worker-9] o.e.s.scheduling.LookupJob - [site 'hetzerath',sensor 'Sentinel2'] Using start date: 2021-01-01T00:00 and end date: 2021-03-22T02:45:52.765
Mar 22 02:45:52 localhost.localdomain start.sh[2387]: 2021-Mar-22 02:45:52.765 DEBUG [DefaultQuartzScheduler_Worker-9] o.e.s.scheduling.LookupJob - [site 'hetzerath',sensor 'Sentinel2'] Lookup for new products in range 2021-01-01 00:00:00 - 2021-03-22 02:45:52
Mar 22 02:45:52 localhost.localdomain start.sh[2387]: 2021-Mar-22 02:45:52.766 INFO [DefaultQuartzScheduler_Worker-10] o.e.s.scheduling.RetryJob - [site 'hetzerath',sensor 'Sentinel2'] No products to retry
Mar 22 02:45:52 localhost.localdomain start.sh[2387]: 2021-Mar-22 02:45:52.766 INFO [DefaultQuartzScheduler_Worker-10] o.e.s.scheduling.RetryJob - Job 'Retry.Retry-s2-hetzerath' completed
Mar 22 02:45:52 localhost.localdomain start.sh[2387]: 2021-Mar-22 02:45:52.766 DEBUG [DefaultQuartzScheduler_Worker-10] o.e.s.services.ScheduleManager - Trigger 'Retry.Retry-s2-hetzerath' completed with code 'NOOP'
Mar 22 02:45:52 localhost.localdomain start.sh[2387]: 2021-Mar-22 02:45:52.767 TRACE [DefaultQuartzScheduler_Worker-9] o.e.s.scheduling.LookupJob - Validating S2 tile filter for site hetzerath
Mar 22 02:45:52 localhost.localdomain start.sh[2387]: 2021-Mar-22 02:45:52.768 TRACE [DefaultQuartzScheduler_Worker-9] o.e.s.scheduling.LookupJob - No S2 tiles were discarded. Filter has 2 tiles.
Mar 22 02:45:52 localhost.localdomain start.sh[2387]: 2021-Mar-22 02:45:52.769 DEBUG [DefaultQuartzScheduler_Worker-9] o.e.s.scheduling.LookupJob - [site 'Hetzerath',sensor 'Sentinel2'] Performing query for interval 2021-01-01T00:00 - 2021-03-22T02:45:52.765
Mar 22 02:45:52 localhost.localdomain start.sh[2387]: 2021-Mar-22 02:45:52.769 TRACE [DefaultQuartzScheduler_Worker-9] o.esa.sen2agri.commons.Config - Requested worker for Scientific Data Hub,S2 (active workers: 0, queued tasks: 0)
Mar 22 02:45:52 localhost.localdomain start.sh[2387]: 2021-Mar-22 02:45:52.772 TRACE [DefaultQuartzScheduler_Worker-9] o.e.s.scheduling.LookupJob - Query timeout is set to 90000 s
Mar 22 02:45:52 localhost.localdomain start.sh[2387]: 2021-Mar-22 02:45:52.774 DEBUG [Scientific Data Hub-S2-1] o.e.s.s.i.DownloadServiceImpl - Querying page #1 (query 1 of 2) for {site id=9,satellite=S2}
Mar 22 02:45:52 localhost.localdomain start.sh[2387]: 2021-Mar-22 02:45:52.775 DEBUG [Scientific Data Hub-S2-1] r.c.t.d.r.s.SciHubDataQuery - Query {Scientific Data Hub-Sentinel2} has 1 subqueries: 8543375b-6369-44e0-aa0b-e50079f1736c
Mar 22 02:45:52 localhost.localdomain start.sh[2387]: 2021-Mar-22 02:45:52.775 DEBUG [Scientific Data Hub-S2-1] r.c.t.d.r.s.SciHubDataQuery - Executing query 8543375b-6369-44e0-aa0b-e50079f1736c: https://scihub.copernicus.eu/dhus/search?rows=50&start=0&q=endPosition%3A%5B2021-01-01T00%3A00%3A00.000Z%20TO%202021-03-22T02%3A45%3A52.000Z%5D%20AND%20filename%3A*31UGR*%20AND%20beginPosition%3A%5B2021-01-01T00%3A00%3A00.000Z%20TO%202021-03-22T02%3A45%3A52.000Z%5D%20AND%20productType%3AS2MSI1C%20AND%20platformName%3ASentinel-2&orderby=beginposition%20asc
Mar 22 02:45:54 localhost.localdomain start.sh[2387]: 2021-Mar-22 02:45:54.525 INFO [Scientific Data Hub-S2-1] r.c.t.d.r.s.SciHubDataQuery - Query 8543375b-6369-44e0-aa0b-e50079f1736c page 1 returned 48 products
Mar 22 02:45:54 localhost.localdomain start.sh[2387]: 2021-Mar-22 02:45:54.525 DEBUG [Scientific Data Hub-S2-1] r.c.t.d.r.s.SciHubDataQuery - Executing query 8543375b-6369-44e0-aa0b-e50079f1736c: https://scihub.copernicus.eu/dhus/search?rows=50&start=50&q=endPosition%3A%5B2021-01-01T00%3A00%3A00.000Z%20TO%202021-03-22T02%3A45%3A52.000Z%5D%20AND%20filename%3A*31UGR*%20AND%20beginPosition%3A%5B2021-01-01T00%3A00%3A00.000Z%20TO%202021-03-22T02%3A45%3A52.000Z%5D%20AND%20productType%3AS2MSI1C%20AND%20platformName%3ASentinel-2&orderby=beginposition%20asc
Mar 22 02:45:54 localhost.localdomain start.sh[2387]: 2021-Mar-22 02:45:54.591 INFO [Scientific Data Hub-S2-1] r.c.t.d.r.s.SciHubDataQuery - Query 8543375b-6369-44e0-aa0b-e50079f1736c page 2 returned 0 products
Mar 22 02:45:54 localhost.localdomain start.sh[2387]: 2021-Mar-22 02:45:54.592 INFO [Scientific Data Hub-S2-1] r.c.t.d.r.s.SciHubDataQuery - Query {Scientific Data Hub-Sentinel2} returned 48 products
Mar 22 02:45:54 localhost.localdomain start.sh[2387]: 2021-Mar-22 02:45:54.592 TRACE [Scientific Data Hub-S2-1] r.c.t.d.r.s.SciHubDataQuery - Data query completed in 1818 ms.
Mar 22 02:45:54 localhost.localdomain start.sh[2387]: 2021-Mar-22 02:45:54.592 DEBUG [Scientific Data Hub-S2-1] o.e.s.s.i.DownloadServiceImpl - Page #1 (query 1 of 2) for {site id=9,satellite=S2} returned 48 results
Mar 22 02:45:54 localhost.localdomain start.sh[2387]: 2021-Mar-22 02:45:54.592 DEBUG [Scientific Data Hub-S2-1] o.e.s.s.i.DownloadServiceImpl - Querying page #2 (query 1 of 2) for {site id=9,satellite=S2}
Mar 22 02:45:54 localhost.localdomain start.sh[2387]: 2021-Mar-22 02:45:54.593 DEBUG [Scientific Data Hub-S2-1] r.c.t.d.r.s.SciHubDataQuery - Query {Scientific Data Hub-Sentinel2} has 1 subqueries: 81a722f7-b802-49f4-99cb-98c0aeeb8b22
Mar 22 02:45:54 localhost.localdomain start.sh[2387]: 2021-Mar-22 02:45:54.593 DEBUG [Scientific Data Hub-S2-1] r.c.t.d.r.s.SciHubDataQuery - Executing query 81a722f7-b802-49f4-99cb-98c0aeeb8b22: https://scihub.copernicus.eu/dhus/search?rows=50&start=50&q=endPosition%3A%5B2021-01-01T00%3A00%3A00.000Z%20TO%202021-03-22T02%3A45%3A52.000Z%5D%20AND%20filename%3A*31UGR*%20AND%20beginPosition%3A%5B2021-01-01T00%3A00%3A00.000Z%20TO%202021-03-22T02%3A45%3A52.000Z%5D%20AND%20productType%3AS2MSI1C%20AND%20platformName%3ASentinel-2&orderby=beginposition%20asc
Mar 22 02:45:54 localhost.localdomain start.sh[2387]: 2021-Mar-22 02:45:54.695 INFO [Scientific Data Hub-S2-1] r.c.t.d.r.s.SciHubDataQuery - Query 81a722f7-b802-49f4-99cb-98c0aeeb8b22 page 2 returned 0 products
Mar 22 02:45:54 localhost.localdomain start.sh[2387]: 2021-Mar-22 02:45:54.695 INFO [Scientific Data Hub-S2-1] r.c.t.d.r.s.SciHubDataQuery - Query {Scientific Data Hub-Sentinel2} returned 0 products
Mar 22 02:45:54 localhost.localdomain start.sh[2387]: 2021-Mar-22 02:45:54.695 TRACE [Scientific Data Hub-S2-1] r.c.t.d.r.s.SciHubDataQuery - Data query completed in 103 ms.
Mar 22 02:45:54 localhost.localdomain start.sh[2387]: 2021-Mar-22 02:45:54.695 DEBUG [Scientific Data Hub-S2-1] o.e.s.s.i.DownloadServiceImpl - Page #2 (query 1 of 2) for {site id=9,satellite=S2} returned 0 results
Mar 22 02:45:54 localhost.localdomain start.sh[2387]: 2021-Mar-22 02:45:54.696 DEBUG [Scientific Data Hub-S2-1] o.e.s.s.i.DownloadServiceImpl - Querying page #1 (query 2 of 2) for {site id=9,satellite=S2}
Mar 22 02:45:54 localhost.localdomain start.sh[2387]: 2021-Mar-22 02:45:54.696 DEBUG [Scientific Data Hub-S2-1] r.c.t.d.r.s.SciHubDataQuery - Query {Scientific Data Hub-Sentinel2} has 1 subqueries: 58d14d65-8a22-4171-b2d3-916c0def6576
Mar 22 02:45:54 localhost.localdomain start.sh[2387]: 2021-Mar-22 02:45:54.697 DEBUG [Scientific Data Hub-S2-1] r.c.t.d.r.s.SciHubDataQuery - Executing query 58d14d65-8a22-4171-b2d3-916c0def6576: https://scihub.copernicus.eu/dhus/search?rows=50&start=0&q=endPosition%3A%5B2021-01-01T00%3A00%3A00.000Z%20TO%202021-03-22T02%3A45%3A52.000Z%5D%20AND%20filename%3A*32ULA*%20AND%20beginPosition%3A%5B2021-01-01T00%3A00%3A00.000Z%20TO%202021-03-22T02%3A45%3A52.000Z%5D%20AND%20productType%3AS2MSI1C%20AND%20platformName%3ASentinel-2&orderby=beginposition%20asc
Mar 22 02:45:54 localhost.localdomain start.sh[2387]: 2021-Mar-22 02:45:54.728 WARN [DefaultQuartzScheduler_Worker-9] o.e.s.scheduling.LookupJob - At least one query failed for site hetzerath (reason: ro.cs.tao.datasource.QueryException: The request
was not successful. Reason: Too Many Requests). It was saved in '/mnt/archive/dwn_def/s2/default/hetzerath/failed_queries' and will be retried later.