Large Integers in JSONB (postgres) rounding

[jmbeekman]

Large Integers in JSONB (postgres) rounding

[TheInnerLight]

While it's theoretically possible to modify the Hasura console such that large numbers are propagated unchanged, doing so would not eliminate surprising behaviour because any producer or consumer of the JSON would be entitled to truncate numeric JSON columns.

The recommendation in RFC 8259 on good interoperability is to expect no more precision or range than double precision IEEE754.

For wide numeric types at database column level, Hasura provides the stringify-numeric-types option. Of course, this option does not exist within JSONB columns because Hasura has no way to infer a schema from arbitrary JSON.

We would recommend that you change the format of your provided JSON to use a string representation of the large number. This will ensure that your representation of numeric data will be properly portable, respected by all potential producers and consumers.

[bjartek]

Hey I am OP here thanks for filing.

I have used golang/pgx to insert my data. In golang this field was a uint64.

[soupi]

Hey folks, thanks for reporting. The underlying issue here is that most json implementations implement numbers as IEE-754, and as such big integers that go beyond the supported range can be truncated at various occasions, such as browsers parsing json:

Screencast.from.2024-02-14.16-54-16.webm

Specifically what's going on here is that the browser encodes and decodes these big int values outside of graphql engine.

[bjartek]

So what are issues that can be used to solve this? Would it be possible to have an option in engine to transform jsonb so that numbers are converted as strings?

[bjartek]

Would it be possible to have this fixed in cloud.hasura graphiql?

[jmbeekman]

I got such mixed results with my experiments. Manual insertion via Dbeaver worked fine, insertion via a mutation worked fine, it was only when I used the data tab to insert the row that this happened. @bjartek is using a data structure that should be able to handle that many digits, but something, somewhere is getting lost in the sauce.