Does the emulator work with Pandas GBQ?

[jitendrawbd]

Does the emulator work with Pandas GBQ?

[jitendrawbd]

Using even the simplest of loading doesn't seem to work

def testapi():
    df = pd.DataFrame(
        {
            "my_string": ["a", "b", "c"],
            "my_int64": [1, 2, 3],
            "my_float64": [4.0, 5.0, 6.0],
            "my_bool1": [True, False, True],
            "my_bool2": [False, True, False]
        }
    )
    to_gbq(df, 'test_dataset.test_table', project_id='gcp-cap-dsml-core-dev')

Testing the above with bigquery emulator results in error

GenericGBQException("Reason: {0}".format(ex)) from ex
pandas_gbq.exceptions.GenericGBQException: Reason: 400 POST http://localhost:9050/bigquery/v2/projects/local-project/jobs?prettyPrint=false: unspecified job configuration query

[ohaibbq]

It looks like the jobs insert handler currently only handles query jobs, import from GCS, and extract to GCS jobs:
https://github.com/goccy/bigquery-emulator/blob/main/server/handler.go#L1372-L1391

to_gbq uses the BigQueryClient.load_table_from_dataframe method which POSTs a CSV / Parquet file to the API.

In our project, we use google_cloud.bigquery.Client.insert_rows to populate tables.

[jitendrawbd]

Ah, got it. Any plans to incorporate BigQueryClient.load_table_from_dataframe function in the future? For now, I will look for some workaround