Event-driven OneLake pipeline with automated Upsert merge and Python reporting
activatordata-engineeringdata-factorydata-pipelinedelta-lakedp-600dp-700etl
Source: GitHub repository metadata.
Repository search
Find public projects in our local index, with related guides and tools from MetaCyberGuru. Your search is not sent to GitHub.
Explore topic collections for selection checklists and useful search examples.
505 matching repositories.
5,477 indexed in total. Latest successful discovery check: 2026-11-08 09:40:22 UTC.
Knee point detection in Python :chart_with_upwards_trend:
data-analysisdata-scienceelbow-methodknee-pointpythonscientific-computingsystems
Source: GitHub repository metadata.
🍁 Sycamore is an LLM-powered search and analytics platform for unstructured data.
aidataprepetlinformation-retrievalllmmlnlpopensearch
Source: GitHub repository metadata.
Feature engineering is the process of using domain knowledge to extract features from raw data via data mining techniques. These features can be used to improve the performance of machine learning algorithms. Feature engineering can be considered as applied machine learning itself.
data-analysisdata-miningdata-sciencedata-scientistsdata-visualizationdeep-learningfeature-engineeringfeature-extraction
Source: GitHub repository metadata.
A curated collection of 300+ engineering blog articles from top tech companies. Learn how the best engineering teams solve real-world problems at scale.
aidata-engineeringdatabasedistributed-systemsengineeringinfrastructuremlsystem-design
Source: GitHub repository metadata.
AI agent tooling for data engineering workflows.
agentic-workflowagentsaiai-agentsairflowapache-airflowclaudecursor
Source: GitHub repository metadata.
Polyglot workflows without leaving the comfort of your technology stack.
activeworkflowagentsdata-engineeringdata-opsevent-driveniftttorchestration-frameworkscheduler
Source: GitHub repository metadata.
Enforce structured output from LLMs 100% of the time
etljsonlarge-language-modelsllmregexunstructured-data
Source: GitHub repository metadata.
Turns Data and AI algorithms into production-ready web applications in no time.
automationdata-engineeringdata-integrationdata-opsdata-visualizationdatasciencedeveloper-toolshacktoberfest
Source: GitHub repository metadata.
A serverless architecture for orchestrating ETL jobs in arbitrarily-complex workflows using AWS Step Functions and AWS Lambda.
amazon-web-servicesathenaawsbig-databigdataeltetlextract
Source: GitHub repository metadata.
pandas on AWS - Easy integration with Athena, Glue, Redshift, Timestream, Neptune, OpenSearch, QuickSight, Chime, CloudWatchLogs, DynamoDB, EMR, SecretManager, PostgreSQL, MySQL, SQLServer and S3 (Parquet, CSV, JSON and EXCEL).
amazon-athenaamazon-sagemaker-notebookapache-arrowapache-parquetathenaawsaws-glueaws-lambda
Source: GitHub repository metadata.
Community-driven, simple, yet powerful framework for fast, cost-effective distributed Compute over Data.
ai-artai-data-collectionai-pipelinebatch-processingbioinformatics-pipelinedata-analysisdata-engineeringdata-science
Source: GitHub repository metadata.
No repository description was provided.
awscnndata-analysisdata-sciencedeep-learning-algorithmsflaskmachine-learningmlflow
Source: GitHub repository metadata.
Terminal-based toolkit for GitHub data analysis.
data-analysisgithub-datagithub-osint
Source: GitHub repository metadata.
Monopoly is a Python library & CLI that converts bank statement PDFs to CSV.
bank-statementbank-statement-parseretlpdf-converterpersonal-financesingapore
Source: GitHub repository metadata.
Easy and flexible data contracts
data-analyticsdata-contractsdata-engineeringdata-sciencepythontesting
Source: GitHub repository metadata.
A comprehensive list of 180+ YouTube Channels for Data Science, Data Engineering, Machine Learning, Deep learning, Computer Science, programming, software engineering, etc.
aiartificial-intelligenceawesomeawesome-listcodingdatadata-analysisdata-engineering
Source: GitHub repository metadata.
Practical Full-Stack Machine Learning
data-analysisdeep-learningmachine-learningpandas-python
Source: GitHub repository metadata.
Home of the Open Data Contract Standard (ODCS).
datadata-contractdata-contractsdata-engineeringdata-meshdata-qualitystandard
Source: GitHub repository metadata.
A visual ETL development and debugging tool for big data
apache-sparkbig-datacascadingetletl-framework
Source: GitHub repository metadata.
What this index tells you
We collect selected public repository metadata through GitHub’s official API and store it on our server. This is not a complete index of GitHub. Categories come from discovery queries and topics; a “skills” or “plugins” result is not a verified installation format. We do not run or audit the projects listed here.
Check the original repository’s licence, installation instructions and maintenance history before using it. Stars do not establish security, and a recent push does not prove that a project works. GitHub may have newer information than our last indexed record.
Search is lexical, not an AI answer engine. Short words and spelling differences can affect matches. This site is independent of GitHub. Report a wrong category, stale result or removal request.