Sample project to demonstrate data engineering best practices
data-engineeringdelta-lakeetlgreat-expectationsminiopysparkspark
Source: GitHub repository metadata.
Repository search
Find public projects in our local index, with related guides and tools from MetaCyberGuru. Your search is not sent to GitHub.
Explore topic collections for selection checklists and useful search examples.
505 matching repositories.
5,477 indexed in total. Latest successful discovery check: 2026-11-08 09:40:22 UTC.
Code for "Efficient Data Processing in Spark" Course
apache-sparkdata-engineeringdata-pipelineminiopysparkpyspark-notebook
Source: GitHub repository metadata.
Practice Databricks coding skills with hands-on exercises. Import into Databricks Free Edition, write code, run assertions, check pass/fail. Covers Delta Lake, Spark SQL, PySpark, Auto Loader, medallion architecture, window functions, and more.
auto-loadercoding-practicedata-engineeringdatabricksdatabricks-certificationdelta-lakemedallion-architecturepyspark
Source: GitHub repository metadata.
Java dataframe and visualization library
chartdata-analysisdata-framedata-sciencedata-visualizationdataframehigh-performancejava
Source: GitHub repository metadata.
Metl is a simple, web-based integration platform that allows for several different styles of data integration including messaging, file based Extract/Transform/Load (ETL), and remote procedure invocation via Web Services. Read more at www.jumpmind.com/products/metl/overview
data-integrationdatabaseetl
Source: GitHub repository metadata.
数据接口：百度、谷歌、头条、微博指数,宏观数据，利率数据，货币汇率，千里马、独角兽公司，新闻联播文字稿，影视票房数据，高校名单，疫情数据…
covid19-datadatadata-analysisdata-sciencedatasetseconomic-datagopupindex-data
Source: GitHub repository metadata.
General Assembly's 2015 Data Science course in Washington, DC
clusteringcoursedata-analysisdata-cleaningdata-sciencedata-visualizationdecision-treesensemble-learning
Source: GitHub repository metadata.
Jupyter notebook and datasets from the pandas video series
data-analysisdata-cleaningdata-sciencejupyter-notebookpandaspythontutorial
Source: GitHub repository metadata.
Jayvee is a domain-specific language and runtime for automated processing of data pipelines
data-engineeringdata-pipelinedata-sciencedomain-specific-languageetl-pipelinetypescript
Source: GitHub repository metadata.
Turn any AI agent into an AI Scientist. The #1 Agent Skills library for science, used by 250,000+ scientists worldwide. 177 ready-to-use validated skills plus 100+ scientific databases covering biology, chemistry, medicine, and drug discovery. Compatible with Cursor, Claude Code, Codex, Pi, Antigravity, and the open Agent Skills standard.
agent-skillsai-scientistbioinformaticschemoinformaticsclaudeclaude-skillsclaudecodeclinical-research
Source: GitHub repository metadata.
ktx is an executable context layer for data and analytics agents 🐙 Allow Claude Code, Codex, or other AI agents to query analytical databases accurately and with full context of your company
agentagent-skillsagentsai-agentai-agentsanalyticsanalytics-engineeringbusiness-intelligence
Source: GitHub repository metadata.
An open source alternative to Tableau. Embeddable visual analytic
bidatadata-analysisdata-miningdata-visualizationedak6skanaries
Source: GitHub repository metadata.
PyGWalker: Turn your dataframe into an interactive UI for visual analysis
data-analysisdata-explorationdataframematplotlibpandasplotlytableautableau-alternative
Source: GitHub repository metadata.
Next generation of automated data exploratory analysis and visualization platform.
augmented-analyticsautomated-data-analysisautomated-visualizationautoviscausal-discoverycausal-inferencecausalitydata-analysis
Source: GitHub repository metadata.
The Open-Source Enterprise Data Platform in a single Portal
data-engineering
Source: GitHub repository metadata.
:bar_chart: :clipboard: Dashboards using YAML or JSON files
big-databusiness-intelligencechartcsvd3d3jsdashboarddata
Source: GitHub repository metadata.
:sunglasses: A curated list of awesome DataOps tools
awesomeawesome-listdata-engineerdata-engineeringdataops
Source: GitHub repository metadata.
Compilation of high-profile real-world examples of failed machine learning projects
aiartificial-intelligenceclassificationcomputer-visiondata-engineeringdata-qualitydata-sciencedeep-learning
Source: GitHub repository metadata.
Orchestrate everything, everywhere. The open-source control plane for workflows across data, infrastructure, business processes and AI agents. Declarative YAML, event-driven, any language, Git-versioned, scalable to millions of executions.
ai-agentsautomationcontrol-planedata-engineeringdata-orchestrationdata-orchestratordevopsetl
Source: GitHub repository metadata.
A lightweight CLI tool for versioning data alongside source code and building data pipelines.
data-engineeringdata-pipelinesdata-sciencedatasetdvcsmachine-learningmlops
Source: GitHub repository metadata.
What this index tells you
We collect selected public repository metadata through GitHub’s official API and store it on our server. This is not a complete index of GitHub. Categories come from discovery queries and topics; a “skills” or “plugins” result is not a verified installation format. We do not run or audit the projects listed here.
Check the original repository’s licence, installation instructions and maintenance history before using it. Stars do not establish security, and a recent push does not prove that a project works. GitHub may have newer information than our last indexed record.
Search is lexical, not an AI answer engine. Short words and spelling differences can affect matches. This site is independent of GitHub. Report a wrong category, stale result or removal request.