Giter Site home page Giter Site logo

akashrajpurohit / snowflake-id Goto Github PK

View Code? Open in Web Editor NEW
18.0 3.0 3.0 267 KB

❄️ A simple and lightweight Node.js library to generate unique snowflake IDs.

Home Page: https://akashrajpurohit.com/blog/snowflake-id-generating-unique-ids-for-distributed-systems/?ref=github-about

License: MIT License

TypeScript 100.00%
snowflake-id distributed-systems uuid-generator

snowflake-id's Introduction

❄️ @akashrajpurohit/snowflake-id

A simple and lightweight Node.js library to generate unique snowflake IDs.


Build states npm latest version npm bundle size Visitors count Coverage NPM license follow on twitter

Bug report · Feature request



@akashrajpurohit/snowflake-id is a Node.js library for generating unique and distributed IDs that are suitable for use as primary keys in distributed systems.

It generates 64-bit IDs (in string format) that are composed of a timestamp, a worker ID, and a sequence number. These IDs are based on Twitter's Snowflake ID generation algorithm.

Read in detail about what are Snowflake IDs

Installation 🚀

You can install @akashrajpurohit/snowflake-id using pnpm/npm/yarn:

pnpm add @akashrajpurohit/snowflake-id

# OR

npm install @akashrajpurohit/snowflake-id

# OR

yarn add @akashrajpurohit/snowflake-id

Usage 💻

Here's an example of how to use @akashrajpurohit/snowflake-id:

import { SnowflakeId } from '@akashrajpurohit/snowflake-id';

const snowflake = SnowflakeId({
  workerId: 1,
  epoch: 1597017600000,
});

console.log(snowflake.generate()); // 14755887168818983731200

This will generate a unique ID in string format.

Configuration options ⚙️

The SnowflakeId constructor takes an options object with the following properties:

  • workerId (optional): A ID of the worker generating the Snowflake IDs.

    Defaults to 0 if not specified.

  • epoch (optional): A timestamp in milliseconds representing the start of the ID generation.

    Defaults to August 10, 2020 at 00:00:00 UTC if not specified.

Methods 🧮

The SnowflakeId instance has the following methods:

  • generate(): Generates a unique ID in string format.

Error Handling 😱

There are two errors that can be thrown by the SnowflakeId instance:

  • Invalid Epoch Error: The SnowflakeId instance throws an error if the epoch timestamp is invalid, i.e., if the epoch timestamp is greater than the current timestamp.

  • Clock Backwards Error: The SnowflakeId instance throws an error if the clock moves backwards, i.e., if the current timestamp is less than the last timestamp.

Examples 🔠

Here's an example of how to generate 10 IDs:

import { SnowflakeId } from '@akashrajpurohit/snowflake-id';

const snowflake = SnowflakeId();

for (let i = 0; i < 10; i++) {
  console.log(snowflake.generate());
}

And here's an example of how to generate IDs using different worker IDs:

import { SnowflakeId } from '@akashrajpurohit/snowflake-id';

const worker1 = SnowflakeId({ workerId: 1 });
const worker2 = SnowflakeId({ workerId: 2 });

console.log(worker1.generate()); // Generates an ID with worker ID 1
console.log(worker2.generate()); // Generates an ID with worker ID 2

While using it in distributed systems, it is highly recommended that you set a unique workerId to reduce collisions of IDS.

While the implementation detail depends on you, one simple way to set a possible unique workerId is to use process.pid.

import { SnowflakeId } from '@akashrajpurohit/snowflake-id';

const workerId = process.pid % 1024; // Using PID as workerId
const snowflake = SnowflakeId({ workerId });

const id = snowflake.generate(); // Generate a new Snowflake ID
console.log(id);

Notes 📝

  • The workerId parameter can be omitted, in which case the workerId would be set to 0. However, if you expect to generate IDs on multiple machines, it is recommended to set a specific workerId value to reduce the chance of ID collisions.

  • The epoch timestamp should be set as close to the current time as possible to maximize the lifespan of the generator. If the epoch is set too far in the past or future, the generator may not be able to generate IDs for the full lifespan of the generator.

    Learn more

    The epoch timestamp is used as the starting point for generating unique IDs. If the epoch timestamp is set too far in the past or future, it can limit the lifespan of the generator. This is because the timestamp portion of a generated ID is typically a smaller number of bits compared to the total number of bits in the ID, and as a result, the maximum value for the timestamp portion can be reached more quickly than the other portions.

    For example, if the epoch timestamp is set to January 1, 1970, which is the Unix epoch, and the generator is configured to use 41 bits for the timestamp portion, the maximum value for the timestamp portion would be reached in the year 2088. This means that after 2088, the generator would no longer be able to generate unique IDs.

    Therefore, it's important to set the epoch timestamp as close to the current time as possible to maximize the lifespan of the generator. This will ensure that the timestamp portion of the generated IDs will not reach their maximum value too quickly, allowing the generator to continue generating unique IDs for a longer period of time.

Bugs or Requests 🐛

If you encounter any problems feel free to open an issue. If you feel the project is missing a feature, please raise a ticket on GitHub and I'll look into it. Pull requests are also welcome.

Where to find me? 👀

Website Badge Twitter Badge Linkedin Badge Instagram Badge Telegram Badge

snowflake-id's People

Contributors

akashrajpurohit avatar renovate[bot] avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar

snowflake-id's Issues

Maximum ID value

Hello,

The project description says that we are generating 64-bit IDs but I am getting numbers far beyond what I thought 64-bit limits allow.

The unsigned 64-bit integer range should be: 0 - max.
((2^64) - 1 ) = 18446744073709551615

For signed it should be -max to max.
((2^63) -1) = 9223372036854775807

The the readme.md the sample code generates ID = 14755887168818983731200. From a test I ran, I generated 1832785790032599770841743360.

This numbers generated from this lib don't fit into a 64-bit number range. How can this project be used to generate 64-bit Ids?

Dependency Dashboard

This issue lists Renovate updates and detected dependencies. Read the Dependency Dashboard docs to learn more.

Open

These updates have all been created already. Click a checkbox below to force a retry/rebase of any.

Detected dependencies

github-actions
.github/workflows/test-and-release.yml
  • actions/checkout v4
  • davelosert/vitest-coverage-report-action v2
  • schneegans/dynamic-badges-action v1.7.0
  • actions/upload-artifact v4
  • actions/checkout v4
npm
package.json
  • @types/node ^20.8.10
  • @vitest/coverage-v8 ^1.0.0
  • conventional-changelog-conventionalcommits ^7.0.2
  • prettier ^3.0.3
  • semantic-release ^22.0.6
  • tsup ^8.0.0
  • typescript ^5.2.2
  • vitest ^1.0.0

  • Check this box to trigger a request for Renovate to run again on this repository

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.