An end-to-end GoodReads Data Pipeline for Building Data Lake, Data Warehouse and Analytics Platform.
“data-pipeline” için sonuçlar
84 proje bulundu
pipelinedb/pipelinedb
GitHubHigh-performance time-series aggregation for PostgreSQL
Twitter Image Pipeline is a robust and performant image loading and caching framework for iOS clients
sematic-ai/sematic
GitHubAn open-source ML pipeline development platform
meltano/meltano
GitHubMeltano: the declarative code-first data integration engine that powers your wildest data and ML-powered product ideas. Say goodbye to writing, maint…
reugn/go-streams
GitHubA lightweight stream processing library for Go
nextflow-io/nextflow
GitHubA workflow language for data-driven computational pipelines
Few projects related to Data Engineering including Data Modeling, Infrastructure setup on cloud, Data Warehousing and Data Lake development.
instill-ai/instill-core
GitHub🔮 Instill Core is a full-stack AI infrastructure tool for data, model and pipeline orchestration, designed to streamline every aspect of building ver…
Build a data warehouse in SQL Server from two source systems, a CRM and an ERP, through bronze, silver and gold. The files and scripts of the free fu…
ropensci/drake
GitHubAn R-focused pipeline toolkit for reproducibility and high-performance computing
scipipe/scipipe
GitHubRobust, flexible and resource-efficient pipelines using Go and the commandline
bruin-data/bruin
GitHubBuild data pipelines with SQL and Python, ingest data from different sources, add quality checks, and build end-to-end flows.
marimo-team/marimo
GitHubA reactive notebook for Python — run reproducible experiments, query with SQL, execute as a script, deploy as an app, and version with git. Stored as…
sodadata/soda-core
GitHubData Contracts engine for the modern data stack. https://www.soda.io
mara/mara-pipelines
GitHubA lightweight opinionated ETL framework, halfway between plain scripts and Apache Airflow
yobix-ai/extractous
GitHubFast and efficient unstructured data extraction. Written in Rust with bindings for many languages.
LLMQuant/quant-mind
GitHubQuantMind is an open source agent-native knowledge extraction and retrieval framework for quantitative finance.
EntilZha/PyFunctional
GitHubPython library for creating data pipelines with chain functional programming
First open-source data discovery and observability platform. We make a life for data practitioners easy so you can focus on your business.
towhee-io/towhee
GitHubTowhee is a framework that is dedicated to making neural data processing pipelines simple and fast.
numaproj/numaflow
GitHubKubernetes-native platform to run massively parallel data/streaming jobs
salesforce/TransmogrifAI
GitHubTransmogrifAI (pronounced trăns-mŏgˈrə-fī) is an AutoML library for building modular, reusable, strongly typed machine learning workflows on Apache S…
elementary-data/elementary
GitHubThe dbt-native data observability solution for data & analytics engineers. Monitor your data pipelines in minutes. Available as self-hosted or cloud…