Logical Replication extension for PostgreSQL 17, 16, 15, 14, 13, 12, 11, 10, 9.6, 9.5, 9.4 (Postgres), providing much faster replication than Slony, Bucardo or Londiste, as well as cross-version upgrades.
- Language
- C
- Licence
- Not specified
- Stars
- 1,244
- Last push
- 2026-07-28
- Indexed
- 2026-11-08
cdcdata-transformationdata-transportdatabase-replicationetllogical-decodingpostgresqlpublish-subscribe
Source: GitHub repository metadata.
安全场景、基于AI的安全算法和安全数据分析业界实践
- Language
- Not specified
- Licence
- Not specified
- Stars
- 1,780
- Last push
- 2021-07-28
- Indexed
- 2026-11-08
data-analysisdata-miningmachine-learningsecurity
Source: GitHub repository metadata.
Big Data Toolkit for the JVM
- Language
- Scala
- Licence
- Apache-2.0
- Stars
- 147
- Last push
- 2020-11-04
- Indexed
- 2026-11-08
big-dataetlhadoophivekafkakuduorcparquet
Source: GitHub repository metadata.
微舆:人人可用的多Agent舆情分析助手,打破信息茧房,还原舆情原貌,预测未来走向,辅助决策!从0实现,不依赖任何框架。
- Language
- Python
- Licence
- GPL-2.0
- Stars
- 42,610
- Last push
- 2026-10-16
- Indexed
- 2026-11-08
agent-frameworkdata-analysisdeep-researchdeep-searchllmsmulti-agent-systemnlppublic-opinion-analysis
Source: GitHub repository metadata.
📈📊📱💻🖥️An elegant modern declarative data visualization chart framework for iOS, iPadOS and macOS. Extremely powerful, supports line, spline, area, areaspline, column, bar, pie, scatter, angular gauges, arearange, areasplinerange, columnrange, bubble, box plot, error bars, funnel, waterfall and polar chart types. 极其精美而又强大的现代化声明式数据可视化图表框架,支持柱状图、条形图、折线图、曲线图、折线填充图、曲线填充图、气泡图、扇形图、环形图、散点图、雷达图、混合图等各种类型的多达几十种的信息图图表,完全满足工作所需.
- Language
- Swift
- Licence
- MIT
- Stars
- 2,524
- Last push
- 2026-11-05
- Indexed
- 2026-11-08
animationarea-chartbar-chartbubble-chartchartcolumn-chartdata-analysisdata-visualization
Source: GitHub repository metadata.
A Data Engineering & Machine Learning Knowledge Hub
- Language
- Python
- Licence
- Not specified
- Stars
- 1,146
- Last push
- 2024-02-02
- Indexed
- 2026-11-08
airflowdata-engineeringdatasciencedevopsinfrastructuremachine-learningmlopsspark
Source: GitHub repository metadata.
A COBOL parser and Mainframe/EBCDIC data source for Apache Spark
- Language
- Scala
- Licence
- Apache-2.0
- Stars
- 170
- Last push
- 2026-11-06
- Indexed
- 2026-11-08
cobolcobol-parsercopybookebcdicetlmainframescalablespark
Source: GitHub repository metadata.
Interview coding questions and experiences for several companies merged into one repository
- Language
- Python
- Licence
- Not specified
- Stars
- 212
- Last push
- 2025-12-02
- Indexed
- 2026-11-08
adobeamazonbigdatadata-engineeringflipkartgeeksforgeeksgoldman-sachsgoogle
Source: GitHub repository metadata.
The Lakehouse Engine is a configuration driven Spark framework, written in Python, serving as a scalable and distributed engine for several lakehouse algorithms, data flows and utilities for Data Products.
- Language
- Python
- Licence
- Apache-2.0
- Stars
- 293
- Last push
- 2026-10-30
- Indexed
- 2026-11-08
big-dataconfiguration-drivendata-engineeringdata-qualitydatabricksdelta-lakeframeworkgreat-expectations
Source: GitHub repository metadata.
A list of useful resources to learn Data Engineering from scratch
- Language
- Not specified
- Licence
- Not specified
- Stars
- 4,042
- Last push
- 2026-10-30
- Indexed
- 2026-11-08
cloud-providersdata-engineeringdata-pipelinedistributed-systemsscala
Source: GitHub repository metadata.
Workflow Automation Engine
- Language
- C#
- Licence
- MIT
- Stars
- 844
- Last push
- 2026-11-05
- Indexed
- 2026-11-08
automationcross-platformcsharpdotnetetlschedulerwexflowworkflow
Source: GitHub repository metadata.
Hundreds of agent skills for medical research, including protocol design, data analysis, evidence insights, and academic writing.
- Language
- Python
- Licence
- MIT
- Stars
- 2,026
- Last push
- 2026-09-17
- Indexed
- 2026-11-08
aibioinformaticsbiologycancer-genomicscomputational-biologydata-analysisdata-visualizationdifferential-expression
Source: GitHub repository metadata.
Open-source data movement for ELT pipelines and AI agents — from APIs, databases & files to warehouses, lakes, and AI applications. Both self-hosted and Cloud.
- Language
- Python
- Licence
- Not specified
- Stars
- 22,334
- Last push
- 2026-11-07
- Indexed
- 2026-11-08
bigquerychange-data-capturedatadata-analysisdata-collectiondata-engineeringdata-integrationdata-pipeline
Source: GitHub repository metadata.
PyAirbyte brings the power of Airbyte to every Python developer. Powers the Airbyte Cloud Replication MCP.
- Language
- Python
- Licence
- Not specified
- Stars
- 342
- Last push
- 2026-11-06
- Indexed
- 2026-11-08
data-engineeringeltpython
Source: GitHub repository metadata.
Example DAGs using hooks and operators from Airflow Plugins
- Language
- Python
- Licence
- Apache-2.0
- Stars
- 349
- Last push
- 2018-07-24
- Indexed
- 2026-11-08
airflowairflow-pluginsapache-airflowdagdbtetlfacebook-adsgoogle-analytics
Source: GitHub repository metadata.
An end-to-end data engineering pipeline that orchestrates data ingestion, processing, and storage using Apache Airflow, Python, Apache Kafka, Apache Zookeeper, Apache Spark, and Cassandra. All components are containerized with Docker for easy deployment and scalability.
- Language
- Python
- Licence
- Not specified
- Stars
- 370
- Last push
- 2025-02-14
- Indexed
- 2026-11-08
apache-airflowapache-kafkaapache-sparkapache-zookeeperbig-datacassandracontainerizationdata-engineering
Source: GitHub repository metadata.
100 data puzzles for pandas, ranging from short and simple to super tricky (60% complete)
- Language
- Jupyter Notebook
- Licence
- MIT
- Stars
- 3,117
- Last push
- 2024-07-10
- Indexed
- 2026-11-08
data-analysisnumpypandaspython
Source: GitHub repository metadata.
A visual process builder
- Language
- TypeScript
- Licence
- Not specified
- Stars
- 217
- Last push
- 2025-08-31
- Indexed
- 2026-11-08
etlflow-based-programmingjavascriptworkbench
Source: GitHub repository metadata.
AKShare is an elegant and simple financial data interface library for Python, built for human beings! 开源财经数据接口库
- Language
- Python
- Licence
- MIT
- Stars
- 23,257
- Last push
- 2026-11-06
- Indexed
- 2026-11-08
academicakshareasset-pricingbondcurrencydatadata-analysisdata-science
Source: GitHub repository metadata.
High performance, easy-to-use, and scalable machine learning (ML) package, including linear model (LR), factorization machines (FM), and field-aware factorization machines (FFM) for Python and CLI interface.
- Language
- C++
- Licence
- Apache-2.0
- Stars
- 3,091
- Last push
- 2023-08-28
- Indexed
- 2026-11-08
data-analysisdata-sciencefactorization-machinesffmfmmachine-learningstatistics
Source: GitHub repository metadata.