Comments (7)
Can you try this as a workaround:
servers:
test:
type: dataframe
models:
test_table:
description: Test description.
type: table
fields:
test_field:
required: true
description: Another description.
type: array
title: Test
required: false
example: '[''02'',''03'']'
items:
type: string
description: Last description.
config:
databricksType: array<string>
from datacontract-cli.
Thank you for your response @jochenchrist. Unfortunately, I am still getting the same type mismatch. I am assuming that adding something here could fix my issue:
from datacontract-cli.
OK, need to dig deeper in here (
should respect the config option).Just to make sure: Are you using the latest version of the CLI tool?
from datacontract-cli.
@jochenchrist I am using version 0.10.7, not the latest one.
from datacontract-cli.
"More simple" data types seem to also have the same issue. For example, the data contract
servers:
test:
type: dataframe
models:
test_model:
description: Test description 1.
type: table
fields:
test_field:
required: true
description: Test description 2.
type: timestamp_tz
example: "2024-06-01T12:00:00.000Z"
config:
databricksType: timestamp
throws the output:
Column,Event,Details
test_field,:icon-fail: Type Mismatch, Expected Type: timestamp_tz; Actual Type: timestamp
from datacontract-cli.
Just to get sure, could you try testing with latest version v0.10.9
?
(you might need to install with extras pip install datacontract-cli[all] --upgrade
)
from datacontract-cli.
I now tried
%pip install datacontract-cli[all] --upgrade
dbutils.library.restartPython()
inside a notebook and ran the test again with the same outcome.
from datacontract-cli.
Related Issues (20)
- Can't import valid jsonschema HOT 4
- Decimal precision not supported - databricks HOT 3
- JsonSchema importer doesn't support array types HOT 2
- Trino tests are flaky
- Dbt model in data contract fails HOT 2
- Case issue on postgres table names HOT 2
- Avro import does not support 'enum' type HOT 5
- Pyspark dependency is required despite marked as optional HOT 4
- Application install installs every available package version for moto HOT 1
- Resolve to fields within a definition HOT 1
- Export to Unity Catalog
- Development Env. is broken HOT 3
- Enable tests in Google Cloud Buckets HOT 1
- Typo in a documentation HOT 1
- Import: No support of AWS Athena (Trino) DDLs HOT 2
- Glue import with database and glue-table parameters returns all tables in a Glue database HOT 2
- Glue: `map` data type is not supported HOT 5
- Delta table support for server type local is not implemented yet, it only checks for azure and then directly goes to AWS s3 HOT 1
- Breaking method is not working with bigint columns HOT 5
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from datacontract-cli.