Topic: pipeline Goto Github

👇 Here are 4813 public repositories matching this topic...

airbytehq / airbyte
pipeline,The leading data integration platform for ETL / ELT data pipelines from APIs, databases & files to data warehouses, data lakes & data lakehouses. Both self-hosted and Cloud-hosted.
Organization: airbytehq
Home Page: https://airbyte.com
data pipeline data-analysis data-engineering java python etl change-data-capture data-collection data-integration

alibaba / dawn
pipeline,:sunrise: Dawn is a lightweight task management and build tool for front-end and nodejs.
Organization: alibaba
Home Page: https://alibaba.github.io/dawn/
build-tool build front-end dawn dawn-cli task pack pipeline middleware construction

alibaba / pipcook
pipeline,Machine learning platform for Web developers
Organization: alibaba
Home Page: https://alibaba.github.io/pipcook/
js machine-learning tensorflow pipeline

alirezadir / production-level-deep-learning
pipeline,A guideline for building practical production-level deep learning systems to be deployed in real world applications.
User: alirezadir
machine-learning deep-learning pipeline scalable-applications production-system tfx kubeflow artificial-intelligence ai practical-machine-learning

apptension / saas-boilerplate
pipeline,SaaS Boilerplate - Open Source and free SaaS stack that lets you build SaaS products faster in React, Django and AWS. Focus on essential business logic instead of coding repeatable features!
Organization: apptension
Home Page: https://apptension.com/saas-boilerplate
cdk stack boilerplate frontend backend workers pipeline django docker saas

argoproj / argo-cd
pipeline,Declarative Continuous Deployment for Kubernetes
Organization: argoproj
Home Page: https://argo-cd.readthedocs.io
argo argo-cd cd ci-cd cicd continuous-delivery continuous-deployment devops docker gitops hacktoberfest helm ksonnet kubernetes pipeline

avaiga / taipy
pipeline,Turns Data and AI algorithms into production-ready web applications in no time.
Organization: avaiga
Home Page: https://www.taipy.io
automation data-engineering data-ops data-visualization datascience developer-tools mlops orchestration pipeline pipelines

axelderomblay / mlbox
pipeline,MLBox is a powerful Automated Machine Learning python library.
User: axelderomblay
Home Page: https://mlbox.readthedocs.io/en/latest/
machine-learning auto-ml kaggle deep-learning stacking pipeline optimization preprocessing encoding prediction distributed xgboost drift classification regression lightgbm keras automated-machine-learning automl data-science

bloodaxe / pytorch-toolbelt
pipeline,PyTorch extensions for fast R&D prototyping and Kaggle farming
User: bloodaxe
pytorch kaggle image-classification image-segmentation deep-learning segmentation python image-processing machine-learning focal-loss

brunch / brunch
pipeline,:fork_and_knife: Web applications made easy. Since 2011.
Organization: brunch
Home Page: https://brunch.io
javascript workflow build-automation pipeline brunch

chunelfeng / cgraph
pipeline,【A common used C++ DAG framework】 一个通用的、无三方依赖的、跨平台的、收录于awesome-cpp的、基于流图的并行计算框架。欢迎star & fork
User: chunelfeng
Home Page: http://www.chunel.cn
dag threadpool workflow taskflow cpp concurrency pipeline framework mediapipe ros2

edyoda / data-science-complete-tutorial
pipeline,For extensive instructor led learning
Organization: edyoda
Home Page: https://www.edyoda.com/program/data-scientist-program
machine-learning scikit-learn linear-regression nearest-neighbors feature-selection decision-trees numpy pandas pipeline

entilzha / pyfunctional
pipeline,Python library for creating data pipelines with chain functional programming
User: entilzha
Home Page: http://pyfunctional.pedro.ai
python datascience pipeline data functional-programming

epicgamesext / blendertools
pipeline,Blender addons that improve the game development workflow between Blender and Unreal.
Organization: epicgamesext
Home Page: https://epicgamesext.github.io/BlenderTools/
blender blender-addon pipeline python unreal

firecow / gitlab-ci-local
pipeline,Tired of pushing to test your .gitlab-ci.yml?
User: firecow
gitlab local pipeline git ci cd push untracked uncomitted gitlab-ci

gaia-pipeline / gaia
pipeline,Build powerful pipelines in any programming language.
Organization: gaia-pipeline
automation build continuous-delivery continuous-integration continuous-testing cplusplus deployment devops devops-tools distributed-systems gitops go java kubernetes pipeline python ruby

galaxyproject / galaxy
pipeline,Data intensive science for everyone.
Organization: galaxyproject
Home Page: https://galaxyproject.org
bioinformatics workflow genomics science sequencing ngs dna usegalaxy pipeline workflow-engine

gonglei007 / gamedevmind
pipeline,最全面的游戏开发技术图谱。帮助游戏开发者们在已知问题上节省时间，省出更多的精力投入到更有创造性的工作中去。
User: gonglei007
3d cpp devops framework game game-development game-framework game-server gamedev management mmorpg pipeline programming roadmap scrum shader unity unity3d unreal-engine unrealengine

google / xls
pipeline,XLS: Accelerated HW Synthesis
Organization: google
Home Page: http://google.github.io/xls/
compiler high-level-synthesis hls open-source pipeline verilog mid-level-synthesis

googlecloudplatform / vertex-ai-samples
pipeline,Notebooks, code samples, sample apps, and other resources that demonstrate how to use, develop and manage machine learning and generative AI workflows using Google Cloud Vertex AI.
Organization: googlecloudplatform
Home Page: https://cloud.google.com/vertex-ai
samples google-cloud-platform vertex-ai notebook ml genai generative-ai vertexai model-garden colab

great-expectations / great_expectations
pipeline,Always know what to expect from your data.
Organization: great-expectations
Home Page: https://docs.greatexpectations.io/
pipeline-tests dataquality datacleaning datacleaner data-science data-profiling pipeline pipeline-testing cleandata dataunittest

hu17889 / go_spider
pipeline,[爬虫框架 (golang)] An awesome Go concurrent Crawler(spider) framework. The crawler is flexible and modular. It can be expanded to an Individualized crawler easily or you can use the default crawl components only.
User: hu17889
spider crawler go schedule pipeline

iam-veeramalla / jenkins-zero-to-hero
pipeline,Install Jenkins, configure Docker as slave, set up cicd, deploy applications to k8s using Argo CD in GitOps way.
User: iam-veeramalla
Home Page: https://www.youtube.com/@AbhishekVeeramalla
argocd cicd docker gitops jenkins kubernetes pipeline

instill-ai / instill-core
pipeline,🔮 Instill Core is a full-stack AI infrastructure tool for data, model and pipeline orchestration, designed to streamline every aspect of building versatile AI-first applications
Organization: instill-ai
Home Page: https://www.instill.tech
unstructured-data low-code developer-tools etl no-code open-source hacktoberfest ai api cli generative-ai golang gpt llm pipeline python stable-diffusion typescript

internlm / huixiangdou
pipeline,HuixiangDou: Overcoming Group Chat Scenarios with LLM-based Technical Assistance
Organization: internlm
application assistance chatbot dsl lark llm multimodal ocr pipeline rag robot wechat

jenkins-x / jx
pipeline,Jenkins X provides automated CI+CD for Kubernetes with Preview Environments on Pull Requests using Cloud Native pipelines from Tekton
Organization: jenkins-x
Home Page: https://jenkins-x.io/
kubernetes cicd continuous-integration continuous-delivery accelerator openshift gitops environments pipeline devops golang tekton hacktoberfest

jina-ai / jina
pipeline,☁️ Build multimodal AI applications with cloud-native stack
Organization: jina-ai
Home Page: https://docs.jina.ai
neural-search cloud-native deep-learning machine-learning framework grpc kubernetes multimodal mlops pipeline

juliaai / mlj.jl
pipeline,A Julia machine learning framework
Organization: juliaai
Home Page: https://juliaai.github.io/MLJ.jl/
machine-learning julia pipelines tuning data-science tuning-parameters predictive-modeling classification regression statistics clustering stacking ensemble-learning pipeline

kedro-org / kedro
pipeline,Kedro is a toolbox for production-ready data science. It uses software engineering best practices to help you create data engineering and data science pipelines that are reproducible, maintainable, and modular.
Organization: kedro-org
Home Page: https://kedro.org
pipeline kedro hacktoberfest mlops experiment-tracking python machine-learning machine-learning-engineering

kestra-io / kestra
pipeline,Infinitely scalable, event-driven, language-agnostic orchestration and scheduling platform to manage millions of workflows declaratively in code.
Organization: kestra-io
Home Page: https://kestra.io
data data-engineering data-integration data-orchestration data-orchestrator data-pipeline data-quality elt etl low-code orchestration pipeline reverse-etl scheduler workflow workflow-engine

kubeflow / pipelines
pipeline,Machine Learning Pipelines for Kubeflow
Organization: kubeflow
Home Page: https://www.kubeflow.org/docs/components/pipelines/
kubeflow-pipelines mlops kubeflow machine-learning kubernetes pipeline data-science

lastbackend / lastbackend
pipeline,System for containerized apps management. From build to scaling.
Organization: lastbackend
Home Page: https://lastbackend.com
cloud docker hosting continuous-delivery continuous-integration backend go golang containers lastbackend

mage-ai / mage-ai
pipeline,🧙 Build, run, and manage data pipelines for integrating and transforming data.
Organization: mage-ai
Home Page: https://www.mage.ai/
machine-learning artificial-intelligence data data-engineering data-science python elt etl pipelines data-pipelines

mara / mara-pipelines
pipeline,A lightweight opinionated ETL framework, halfway between plain scripts and Apache Airflow
Organization: mara
data data-integration etl pipeline postgresql python

marimo-team / marimo
pipeline,A reactive notebook for Python — run reproducible experiments, execute as a script, deploy as an app, and version with git.
Organization: marimo-team
Home Page: https://marimo.io
notebooks python data-science machine-learning artificial-intelligence data-visualization developer-tools reactive pipeline web-app

moby / datakit
pipeline,Connect processes into powerful data pipelines with a simple git-like filesystem interface
Organization: moby
datakit filesystem-api data-flow database docker pipeline

nextflow-io / nextflow
pipeline,A DSL for data-driven computational pipelines
Organization: nextflow-io
Home Page: http://nextflow.io
bioinformatics workflow-engine pipeline pipeline-framework nextflow cloud groovy sge slurm aws

nteract / papermill
pipeline,📚 Parameterize, execute, and analyze notebooks
Organization: nteract
Home Page: http://papermill.readthedocs.io/en/latest/
julia jupyter notebook notebook-generator notebooks nteract pipeline publishing python r scala

prefecthq / prefect
pipeline,Prefect is a workflow orchestration framework for building resilient data pipelines in Python.
Organization: prefecthq
Home Page: https://prefect.io
python workflow data-engineering data-science workflow-engine prefect infrastructure ml-ops data-ops automation

projectdiscovery / httpx
pipeline,httpx is a fast and multi-purpose HTTP toolkit that allows running multiple probes using the retryablehttp library.
Organization: projectdiscovery
Home Page: https://docs.projectdiscovery.io/tools/httpx
http bugbounty ssl-certificate pipeline pentest-tool cybersecurity osint hacktoberfest cli lib

prql / prql
pipeline,PRQL is a modern language for transforming data — a simple, powerful, pipelined SQL replacement
Organization: prql
Home Page: https://prql-lang.org
data pipeline sql

reugn / go-streams
pipeline,A lightweight stream processing library for Go
User: reugn
Home Page: https://pkg.go.dev/github.com/reugn/go-streams
stream-processing pipeline etl kafka data-stream kafka-streams streams redis pulsar data-pipeline

ropensci / drake
pipeline,An R-focused pipeline toolkit for reproducibility and high-performance computing
Organization: ropensci
Home Page: https://docs.ropensci.org/drake
reproducibility high-performance-computing r data-science drake makefile pipeline workflow reproducible-research rstats

scipipe / scipipe
pipeline,Robust, flexible and resource-efficient pipelines using Go and the commandline
Organization: scipipe
Home Page: https://scipipe.org
scientific-workflows bioinformatics-pipeline workflow go dataflow pipeline cheminformatics bioinformatics fbp scipipe

tc39 / proposal-pipeline-operator
pipeline,A proposal for adding a useful pipe operator to JavaScript.
Organization: tc39
Home Page: http://tc39.github.io/proposal-pipeline-operator/
javascript tc39 proposal pipeline operator syntax

tektoncd / pipeline
pipeline,A cloud-native Pipeline resource.
Organization: tektoncd
Home Page: https://tekton.dev
tekton pipeline kubernetes cdf hacktoberfest

tencentmusic / cube-studio
pipeline,cube studio开源云原生一站式机器学习/深度学习/大模型AI平台，支持sso登录，多租户，大数据平台对接，notebook在线开发，拖拉拽任务流pipeline编排，多机多卡分布式训练，超参搜索，推理服务VGPU，边缘计算，serverless，标注平台，自动化标注，数据集管理，大模型微调，vllm大模型推理，llmops，私有知识库，AI模型应用商店，支持模型一键开发/推理/微调，支持国产cpu/gpu/npu芯片，支持RDMA，支持pytorch/tf/mxnet/deepspeed/paddle/colossalai/horovod/spark/ray/volcano分布式
Organization: tencentmusic
kubernetes inference mlops workflow ai pytorch spark argo kubeflow automl

towhee-io / towhee
pipeline,Towhee is a framework that is dedicated to making neural data processing pipelines simple and fast.
Organization: towhee-io
Home Page: https://towhee.io
machine-learning convolutional-networks embedding-vectors embeddings computer-vision image-processing video-processing feature-extraction image-retrieval unstructured-data

vectordotdev / vector
pipeline,A high-performance observability data pipeline.
Organization: vectordotdev
Home Page: https://vector.dev
router logs metrics rust observability forwarder vector parser events stream-processing

yuanzhoulvpi2017 / zero_nlp
pipeline,中文nlp解决方案(大模型、数据、模型、训练、推理)
User: yuanzhoulvpi2017
bert nlp transformers gpt2 chatglm-6b clip gpt gpt-neox pytorch text-generation