Databurst Data Engineering Wiki

Roadmap Step-by-Step
- Programming Language
  - Python
  - Java
  - Scala
  - Go
  - Rust
- Operating System
  - Linux
  - Windows
- Networking
  - Protocols
    - TCP/IP
    - DNS
    - HTTP
    - HTTPS
    - SSH
    - UDP
  - Concepts
    - Firewalls
    - VPN
- General Software Engineering Skills
  - OAuth
  - JWT
  - GraphQL
  - REST
  - gRPC
  - Caching
- Web Frameworks and API Development
  - Python
  - Go
  - Java
- Version Control System
  - git
- Version Control System Hosting
  - Github
  - Gitlab
  - BitBucket
- Distributed Systems Concepts
- SQL Fundamentals
  - Basic SQL
  - Advanced SQL
- Databases
  - Relational
  - NoSQL
    - Columnar
    - Document Based
    - Key-Value
    - Time Series
    - Vector
    - Graph
    - NewSQL
- Data Modeling
- Data Management Architecture
- Data Integration
  - ETL
  - ELT
  - CDC
  - Reverse ETL
- Storage
  - Block Storage
  - Object Storage
- File Formats and Serialization
  - File Formats
    - CSV
    - JSON
    - Parquet
    - XML
  - Serialzation
    - Avro
    - Protocol Buffer
- Query Engine
  - Apache Hive
  - SparkSQL
  - Trino
  - Presto
- Data Architecture
  - Kappa
  - Lambda
- Data Processing
- Pipeline Orchestration
- Messaging and Streaming Platform
- Data Governance
- Data Visualization
- Containerization
  - Docker
  - Podman
  - Containerd
- Container Orchestration
- CI/CD
- Infrastructure as Code
  - Configuration Management
  - Infrastructure Provisioning
- Observability

Data Lake

Introduction
Learning Resources

Data Lake #

Introduction #

Learning Resources #

Books #

Courses #

Miscellaneous #

Introduction
Learning Resources