Comments (6)
Thank you!
Please try with v0.4.2.
I've fixed this issue just now.
from clickhouse-backup.
It works! Thank you!
from clickhouse-backup.
So what is the issue ?
I am currently encountering this whilst running clickhouse-client from the official docker image.
I've created some comparable Create Table instead my actual, but it have the some structure.
I am trying to make table where it is ordered by, fields in the nested field.:
CREATE TABLE SOME_RAW_TABLE (
team Nested (
teamID UInt32,
employeeID UInt32,
employeeName String
),
task Nested(
taskID String,
employeeID UInt32,
details Nested (
taskDetailID UInt32,
description String
)
)
) ENGINE = MergeTree()
ORDER BY ( team.teamID, team.employeeID, task.details.taskDetailID, task.taskID);
Output:
CREATE TABLE SOME_RAW_TABLE
(
`team` Nested(teamID UInt32, employeeID UInt32, employeeName String),
`task` Nested(taskID String, employeeID UInt32, details Nested(taskDetailID UInt32, description String))
)
ENGINE = MergeTree
ORDER BY (team.teamID, team.employeeID, task.details.taskDetailID, task.taskID)
Query id: 43d6b811-47a3-4a32-8783-e88bb099a88f
0 rows in set. Elapsed: 0.002 sec.
Received exception from server (version 23.6.2):
Code: 47. DB::Exception: Received from localhost:9000. DB::Exception: Missing columns: 'task.details.taskDetailID' while processing query: 'team.teamID, team.employeeID, task.details.taskDetailID, task.taskID', required columns: 'team.teamID' 'task.details.taskDetailID' 'team.employeeID' 'task.taskID' 'team.teamID' 'task.details.taskDetailID' 'team.employeeID' 'task.taskID'. (UNKNOWN_IDENTIFIER)
from clickhouse-backup.
Oh, this is weird.
If I change task.details.taskDetailID
to task.details.1
it works!
If I exclude task.details.taskDetailID
from Order By (Primary Key Index) it will also work.
from clickhouse-backup.
@nahwinrajan
your issue is not related to clickhouse-backup
look to https://clickhouse.com/docs/en/sql-reference/data-types/nested-data-structures/nested
and https://clickhouse.com/docs/en/operations/settings/settings#flatten-nested
https://fiddle.clickhouse.com/55cd5988-bdc0-4610-9662-d8f51fed9970
Nested is "array of tuples"
looks like this you can't use named tuple element in primary key and it looks like clickhouse-server bug
from clickhouse-backup.
So I need to set the SET flatten_nested
to 0
first ?
that is global setting right ?
additional information: with the previous way even though it was successfully creted the table, each field of the nested fields become an array on its own. And am not successful to do insertion into it (even after making values of each field is and array and array of array).
Now back to start with SET flatten_nested = 0;
as it return the same error as this issue mentioned.
Edit:
- The insert work by doing
.IndexOfTheFileds
and it start from 1 instead of 0 (not zero based index) - Am aware of this Issue-43634 but I am trying to do insert with SQL command
- Interesting Resource: Clickhouse Online fiddle
from clickhouse-backup.
Related Issues (20)
- clickhouse is fail to start HOT 20
- skip ValidateObjectDiskConfig for --diff-from-remote when object disk doesn't contains data
- EKS Irsa doesnt work HOT 1
- Create_remote results in `error: data in objects disks` (Azure Blob) HOT 1
- Can i restore backups from one cluster to other? HOT 2
- restore stop works, if RBAC objects present in backup but user which used for connect to clickhouse don't have access_management
- wrong skip tables by engine when empty variables value "CLICKHOUSE_SKIP_TABLE_ENGINES=engine," instead of "CLICKHOUSE_SKIP_TABLE_ENGINES=engine"
- implements `--partitions=db.table:part_name1,part_name2` and `--partitions=db2.table2:*` to allow more flexible backup logic HOT 1
- create system.backup_version, add version to log, add GET /backup/version endpoint
- Implements `X/Y tables` logging for `done` logging HOT 1
- How to backup replica clickhouse cluster correctly ? HOT 1
- `acccess` and `configs` download should use archieve extensions the same manner as main data, for example allow download zstd instead of .tar
- API server should restart if `watch` command fails
- Unable to clean remote broken (can't stat metadata.json) HOT 6
- Multipart Upload to Minio Fails in Newest Minio Release HOT 1
- Permission denied while doing restore_remote if backup is also present locally HOT 10
- Authentication Failed When Configuring Automatic Backup HOT 12
- implements embedded BACKUP/RESTORE ON CLUSTER approach
- not supporter users with dot in name HOT 6
- URL is getting malformed while running restore_remote command with azure_blob_store HOT 4
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from clickhouse-backup.