Comments (9)
Yeah, ceramic commits are limited to 256kb. 4MB is very large for JSON text - why do you have such a large schema?
from js-ceramic.
from js-ceramic.
I see, thanks for the information. I've filed a feature request to support larger documents in Ceramic, but there's a few different things that would have to change to make this work. The HTTP request size limit that you noted is one, but there is also the Ceramic commit size limit, as well as possibly the IPFS block size limit, that would all need to be dealt with. I'll leave this ticket open for now and we can use it to report any update towards increasing the Ceramic document size limits.
from js-ceramic.
@stbrody What about the schema size limit on the server? This is an express setting, not something particular to ceramic. I tried setting it in the daemon config, but I wasn't exactly sure how to do it or if your Carmic's embedded express would lpick it up there. I would like to see us at least tackle a schema load. I would then worry about the size of commits. Data can be chunked, and the current stream might be just fine. Does the commit size constrain the size of the schema?
from js-ceramic.
Does the commit size constrain the size of the schema?
Yes, it does. Schemas are stored as documents in Ceramic same as any other data.
from js-ceramic.
IPFS says the block size limit is 1MB, but obviously a file can be written to more than 1 block. Must Ceramic commits exists in a single block or can they be over more than 1 block?
from js-ceramic.
IPFS says the block size limit is 1MB, but obviously a file can be written to more than 1 block. Must Ceramic commits exists in a single block or can they be over more than 1 block?
I think that questions is exactly one of the things we would need to investigate as part of the work to enable larger documents on Ceramic
from js-ceramic.
@fhirfly, could you take your large FHIR schema and break it up into multiple smaller schemas for different parts of the overall data?
from js-ceramic.
Unfortunately, the schemas are all related. Did you ever make the limitation go away?
from js-ceramic.
Related Issues (20)
- Ceramic Daemon fails to start IPFS in Docker container HOT 7
- loadStream is not re-entrant HOT 2
- Error: no supported interface HOT 4
- ERROR: Error: Invalid 'model' metadata property in Model stream HOT 2
- CeramicClient don't work on react native HOT 1
- JetLogger import in `@ceramicnetwork/common` is causing an error HOT 2
- Cannot install `@ceramicnetwork/cli` HOT 2
- Support S3 compatible state stores HOT 3
- `ModelInstanceDocument doc.replace`, there are some fields that are not updated in db table HOT 2
- Gateway timeout (504) when trying to retrieve /api/v0/pins HOT 1
- ceramic daemon --network=testnet-clay crashing my home network HOT 1
- Knex: Timeout acquiring a connection. The pool is probably full. HOT 1
- TypeError: Cannot destructure property 'controllers' of 'payload.header' as it is undefined.
- Unsupported method: personal_sign HOT 3
- could not coalesce error, "method": "eth_chainId", "params": [ ] } }, "message": "'args.method' must be a non-empty string." } HOT 4
- can't use webpack with @ceramicnetwork/http-client HOT 4
- Error: Cannot find package 'dag-jose' imported from C:\Git\project\node_modules\@ceramicnetwork\codecs\lib\ipld.js HOT 1
- Optionally resolve commits under consensus conflict
- The jws block contains a request path (/ceramic-instances/2b3d0c902caa1fdade4e3756e8294746061505d54041e78603b4146c5b0d9eb1/api/v0/admin/modelData) that doesn't match the request (/api/v0/admin/modelData) HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from js-ceramic.