Comments (3)
I did some further tests and I still get duplicates. Anyone can confirm the issue?
from bigquery-python.
It's not clear to me why this would be happening since you're specifying an insert id. Have you tried uploading rows using the BigQuery API directly or using another client?
from bigquery-python.
I guess I found the problem in the Google Bigquery Docs.
To help ensure data consistency, you can supply insertId for each inserted row. BigQuery remembers this ID for at least one minute.
I thought that ID is cross-checked with the whole data set and not just remembered for one minute. So no surprise then. Thanks for the reply anyway!
from bigquery-python.
Related Issues (20)
- ImportError: cannot import name get_client HOT 6
- Queries results limited HOT 1
- get statistics of the job HOT 1
- specifying dataset location when using create_dataset method HOT 2
- create_table() documentation incorrect HOT 1
- Table expiration time should be a long HOT 1
- Functionality to upload/download file from local to gcs and vice versa
- not working anymore due to KeyError: 'google'
- Get Client with API key
- documentation typo "destination_urls" HOT 1
- bigquery.errors.JobInsertException: Reason:invalid. Message:Table wasel-95b26:com_mysada_news_ANDROID.app_events_20170611 cannot be exported as CSV because it has a nested schema. HOT 1
- get_query_rows offset option fails across pages
- Few typos in documentation HOT 1
- Cannot import get_client
- ImportError: No module named bigquery
- Not getting the full list of datasets when there are more than 50 datasets in the project HOT 1
- Standard SQL support HOT 3
- "Please look into the error stream for more details." HOT 5
- Request had insufficient authentication scopes when creating a table HOT 6
- Is this project still ongoing?
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from bigquery-python.