“data-pipeline” için sonuçlar

84 proje bulundu

An end-to-end GoodReads Data Pipeline for Building Data Lake, Data Warehouse and Analytics Platform.

airflowairflow-dagapache-airflowapache-spark
Python 1.6k 249 MIT 6 yıl önce

High-performance time-series aggregation for PostgreSQL

aggregationanalyticspipelinedbpostgresql
C 2.7k 242 Apache-2.0 4 yıl önce

Twitter Image Pipeline is a robust and performant image loading and caching framework for iOS clients

cacheimage-pipelineiosobjective-c
C 1.8k 106 Apache-2.0 2 yıl önce

An open-source ML pipeline development platform

aidata-sciencemachine-learningml
Python 1k 63 Apache-2.0 1 yıl önce

Meltano: the declarative code-first data integration engine that powers your wildest data and ML-powered product ideas. Say goodbye to writing, maint…

connectorsdatadata-engineeringdata-pipelines
Python 2.7k 282 MIT 23 saat önce

A lightweight stream processing library for Go

aerospikedata-pipelinedata-streametl
Go 2.2k 173 MIT 10 ay önce

A workflow language for data-driven computational pipelines

awsbioinformaticsclouddataflow
Groovy 3.5k 824 Apache-2.0 8 saat önce

Few projects related to Data Engineering including Data Modeling, Infrastructure setup on cloud, Data Warehousing and Data Lake development.

airflowairflow-operatorsawsaws-ec2
Python 2k 601 Özel lisans 4 yıl önce

🔮 Instill Core is a full-stack AI infrastructure tool for data, model and pipeline orchestration, designed to streamline every aspect of building ver…

aiapiclideveloper-tools
Python 2.3k 124 Özel lisans 5 ay önce

Build a data warehouse in SQL Server from two source systems, a CRM and an ERP, through bronze, silver and gold. The files and scripts of the free fu…

beginner-friendlydata-analyticsdata-cleaningdata-engineering
TSQL 1.1k 752 MIT 2 hafta önce

An R-focused pipeline toolkit for reproducibility and high-performance computing

data-sciencedrakehigh-performance-computingmakefile
R 1.3k 128 GPL-3.0 1 yıl önce

Robust, flexible and resource-efficient pipelines using Go and the commandline

bioinformaticsbioinformatics-pipelinecheminformaticsdataflow
Go 1.1k 74 MIT 2 yıl önce

Build data pipelines with SQL and Python, ingest data from different sources, add quality checks, and build end-to-end flows.

analyticsbigquerydata-analysisdata-ingestion
Go 1.8k 100 Apache-2.0 1 gün önce

A reactive notebook for Python — run reproducible experiments, query with SQL, execute as a script, deploy as an app, and version with git. Stored as…

artificial-intelligencedagdata-sciencedata-visualization
Python 23.7k 1.4k +22 ★ Apache-2.0 21 saat önce

Data Contracts engine for the modern data stack. https://www.soda.io

data-contractsdata-engineeringdata-governancedata-monitoring
Python 2.5k 306 Özel lisans 17 saat önce

A lightweight opinionated ETL framework, halfway between plain scripts and Apache Airflow

datadata-integrationetlpipeline
Python 2.1k 101 MIT 2 yıl önce

Fast and efficient unstructured data extraction. Written in Rust with bindings for many languages.

data-pipelinesdocxetletl-pipelines
Rust 1.8k 99 Apache-2.0 1 yıl önce

QuantMind is an open source agent-native knowledge extraction and retrieval framework for quantitative finance.

agentcontext-engineeringdataharness-engineering
Python 3.1k 499 MIT 3 ay önce

Python library for creating data pipelines with chain functional programming

datadatasciencefunctional-programmingpipeline
Python 2.5k 135 MIT 1 yıl önce

First open-source data discovery and observability platform. We make a life for data practitioners easy so you can focus on your business.

alertingbigdatadata-catalogdata-discovery
Java 1.4k 151 Apache-2.0 1 ay önce

Towhee is a framework that is dedicated to making neural data processing pipelines simple and fast.

computer-visionconvolutional-networksembedding-vectorsembeddings
Python 3.5k 255 Apache-2.0 2 yıl önce

Kubernetes-native platform to run massively parallel data/streaming jobs

data-processinghacktoberfestk8skubernetes
Rust 2.8k 188 Apache-2.0 2 gün önce

TransmogrifAI (pronounced trăns-mŏgˈrə-fī) is an AutoML library for building modular, reusable, strongly typed machine learning workflows on Apache S…

aiautomated-machine-learningautomldsl
Scala 2.3k 396 BSD-3-Clause 5 ay önce

The dbt-native data observability solution for data & analytics engineers. Monitor your data pipelines in minutes. Available as self-hosted or cloud…

analytics-engineerbigquerydata-analysisdata-governance
HTML 2.4k 242 Apache-2.0 3 gün önce