Giter Site home page Giter Site logo

regen-network / sanity-graph-import Goto Github PK

View Code? Open in Web Editor NEW

This project forked from sanctuarycomputer/sanity-graph-import

0.0 2.0 0.0 5.9 MB

A tool for making partial imports of Sanity datasets with related references & assets

License: MIT License

Shell 1.70% JavaScript 3.68% TypeScript 94.62%

sanity-graph-import's Introduction

Sanity Graph Import

Code Coverage Latest Release Build Status Code Type Contributor Count

sanity-graph-import is a tool for making partial migrations from one Sanity dataset or project to another. This can be useful if you only want to import particular documents and those they reference. A common use case might be "refreshing" a staging dataset from production - when the production dataset is large and would otherwise take a lot of time and bandwidth to export & import.

This script will take a selection of initial documents (provided by you as simple Sanity queries), then traverse through all documents it references, find all assets used by any of these documents, then add them to your destination dataset as a "complete" dataset with fully resolved references.

Example: Your production dataset has 1000's of article documents, each of which contain references to one or more author documents. For your staging dataset, you only want the first 10 articles and their authors -- as well as any image & file assets these documents include.

Looking to copy an entire dataset? Use Sanity's CLI instead instead.

Coming Soon

  • Run from the command line
  • Specify the depth of graph traversal (current default is 1)

Installation

yarn add @sanctucompu/sanity-graph-import

Usage

// my-project/scripts/migrate.js
import { migrate } from '@sanctucompu/sanity-graph-import'
import CreateClient from '@sanity/client'

const sourceClient = CreateClient({
  projectId: 'abc123xyz',
  dataset: 'production',
})

const destinationClient = CreateClient({
  projectId: 'abc123xyz',
  dataset: 'staging',
  token: '789abc123xyz', // Required!
})

const initialQueries = [
  /* Fetch the 10 latest articles */
  {
    query: `
      *[_type == 'article']
      | order(releaseDate desc)
      | order(_createdAt desc) [0...$count]
    `,
    params: {
      count: 10,
    },
  },
  /* Fetch the homepage document */
  {
    query: `*[_type == 'homepage']`,
  },
]

async function run() {
  const config = {
    source: {
      client: sourceClient,
      initialQueries,
    },
    desitination: {
      client: destinationClient,
    },
  }

  await migrate(config)
}

run()

Then, run node my-project/scripts/migrate.js

This configuration will populate your destination dataset with:

  • 10 article documents
  • Every author document referenced in those articles
  • The homepage document
  • All assets from all of the above
  • And any other documents referenced in the articles or the homepage

API

migrate(config)

Returns

A promise that resolve's with the final mutation results.

config: ImportConfig

interface ImportConfig {
  source: SourceConfig
  destination: DestinationConfig
}

type QueryParams = Record<string, any>

interface QueryArgs {
  query: string
  params?: QueryParams
}

interface SourceConfig {
  initialQueries: QueryArgs[]
  client: SanityClient
}

interface DestinationConfig {
  /* The destination client must have a write token! */
  client: SanityClient
  /**
   * The number of documents to include in a batch.
   *
   * default: 35
   *
   * If you are getting 'content-length' errors during migration,
   * set this to a lower number.
   */
  batchSize?: number
  /**
   * Set this value to true or false to skip the prompt to delete
   * all documents in the target dataset.
   *
   * default: undefined
   *
   * Leave undefined to include the prompt.
   */
  deleteData?: boolean | void
}

Contributing

See CONTRIBUTING.md

License

MIT

Contributors โœจ

Thanks goes to these wonderful people (emoji key):


Joseph Thomas

๐Ÿ“– ๐Ÿ’ป โš ๏ธ

This project follows the all-contributors specification. Contributions of any kind welcome!

sanity-graph-import's People

Contributors

good-idea avatar semantic-release-bot avatar allcontributors[bot] avatar blushi avatar

Watchers

James Cloos avatar  avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.