:blue_book: Making Data, the DataMade Way
datamadeetlmakefileprinciples
Source: GitHub repository metadata.
Repository search
Find public projects in our local index, with related guides and tools from MetaCyberGuru. Your search is not sent to GitHub.
Explore topic collections for selection checklists and useful search examples.
505 matching repositories.
5,477 indexed in total. Latest successful discovery check: 2026-11-08 09:40:22 UTC.
Dataplane is an Airflow inspired unified data platform with additional data mesh and RPA capability to automate, schedule and design data pipelines and workflows. Dataplane is written in Golang with a React front end.
airflowdatadata-analysisdata-engineeringdata-integrationdata-pipelinesdata-sciencedataplane
Source: GitHub repository metadata.
The data-validation toolkit for enhanced dbt (data build tool) PR review
analytics-engineeringdatadata-engineeringdata-validationdataopsdbtelt
Source: GitHub repository metadata.
Harness for building data engineering agents designed around human control, correctness, and safety.
apidata-engineeringdata-pipelineevent-drivenharnessharness-frameworkstreaming
Source: GitHub repository metadata.
Roadmap to becoming a data engineer in 2021
clouddata-engineer-roadmapdata-engineeringroadmap
Source: GitHub repository metadata.
Data Engineering Zoomcamp is a free 9-week course on building production-ready data pipelines. Join the course here 👇🏼
coursedata-engineeringdbtdockerfreekafkakestraspark
Source: GitHub repository metadata.
Know your data better！Datavines is Next-gen Data Observability Platform, support metadata manage and data quality.
cleandatadata-engineeringdata-profilersdata-profilingdata-qualitydata-quality-checksdata-quality-frameworkdata-quality-monitoring
Source: GitHub repository metadata.
Support agile Ontology DataOps Based on Flink, DataX and Flink-CDC with Web-UI
cdcchatbidataopsdataxetlflinkjavaontology
Source: GitHub repository metadata.
A free to use dbt package for creating and loading Data Vault 2.0 compliant Data Warehouses (powered by dbt, an open source data engineering tool, registered trademark of dbt Labs)
data-vaultdataengineeringdatalakedatavaultdatavault20datawarehousedatawarehousingdbt
Source: GitHub repository metadata.
A data lakehouse on Databricks with the medallion architecture: PySpark, Spark SQL, Delta Lake and Unity Catalog. The project of the free Databricks bootcamp.
apache-sparkbeginner-friendlybootcampdata-analyticsdata-engineeringdata-engineering-projectdata-lakehousedata-pipeline
Source: GitHub repository metadata.
Build a data warehouse in SQL Server from two source systems, a CRM and an ERP, through bronze, silver and gold. The files and scripts of the free full project.
beginner-friendlydata-analyticsdata-cleaningdata-engineeringdata-engineering-projectdata-modelingdata-pipelinedata-quality
Source: GitHub repository metadata.
The materials of the free 30-hour SQL course: the databases for SQL Server, MySQL and PostgreSQL, every query of the 41 chapters, and the slides.
beginner-friendlyctedata-analysisdata-analyticsdata-engineeringdata-with-baraadatabasejoins
Source: GitHub repository metadata.
Blazing-fast, Neuro-symbolic Data-Wrangling toolkit
aickancsvdata-engineeringdata-wranglingdcatexcelfair-data
Source: GitHub repository metadata.
A MCP (Model Context Protocol) server for interacting with dbt.
data-analyticsdata-engineeringdbtllmmcpmcp-servermodel-context-protocol
Source: GitHub repository metadata.
🥪🦘 An open source sandbox project exploring dbt workflows via a fictional sandwich shop's data.
analyticsanalytics-engineeringdatadata-engineeringdbtdbt-cloud
Source: GitHub repository metadata.
dbt adapter for SQL Server and Azure SQL
analytics-engineeringazure-sqlazure-sql-dbdata-engineeringdbtdbt-sqlservermicrosoftmicrosoft-sql-server
Source: GitHub repository metadata.
Learn to build your Second Brain AI assistant with LLMs, agents, RAG, fine-tuning, LLMOps and AI systems techniques.
agentsai-systemsdata-engineeringfine-tuninghuggingfacellmllmopsmlops
Source: GitHub repository metadata.
Deepnote is a drop-in replacement for Jupyter with an AI-first design, sleek UI, new blocks, and native data integrations. Use Python, R, and SQL locally in your favorite IDE, then scale to Deepnote cloud for real-time collaboration, Deepnote agent, and deployable data apps. https://deepnote.com/
artificial-intelligencedatadata-analysisdata-sciencedata-visualizationdeepnoteedajupyter
Source: GitHub repository metadata.
Desbordante is a high-performance data profiler that is capable of discovering many different patterns in data using various algorithms. It also allows to run data cleaning scenarios using these algorithms. Desbordante has a console version and an easy-to-use web application.
anomaly-detectioncorrelationsdata-analyticsdata-cleaningdata-cleansingdata-engineeringdata-explorationdata-mining
Source: GitHub repository metadata.
In-memory Java DataFrame library
data-analysisdata-framedataframedataframe-libraryetljavamicrobatchseries
Source: GitHub repository metadata.
What this index tells you
We collect selected public repository metadata through GitHub’s official API and store it on our server. This is not a complete index of GitHub. Categories come from discovery queries and topics; a “skills” or “plugins” result is not a verified installation format. We do not run or audit the projects listed here.
Check the original repository’s licence, installation instructions and maintenance history before using it. Stars do not establish security, and a recent push does not prove that a project works. GitHub may have newer information than our last indexed record.
Search is lexical, not an AI answer engine. Short words and spelling differences can affect matches. This site is independent of GitHub. Report a wrong category, stale result or removal request.