Coursera 笔记

IBM

Introduction to Data Engineering

数据工程概论

77 notes · 77 images · 56/65 条官方条目有笔记 · certified

Coursera ↗

Module 01

What is Data Engineering? 什么是数据工程？

16 篇
  1. 01Welcome to Introduction to Data Engineering数据工程导论课程介绍
  2. 02Modern Data Ecosystem现代数据生态系统概览
  3. 03Key Players in the Data Ecosystem数据生态系统中的关键角色
  4. 04Specializations in Data Engineering数据工程生态系统中的专业化角色
  5. 05What is Data Engineering?数据工程的范畴与核心任务
  6. 06Viewpoints: Defining Data Engineering数据专业人士论数据工程：定义与区别
  7. 07Viewpoints: Evolution of Data Engineering数据工程的演变：近二十年来的变化
  8. 08Summary and Highlights总结与要点
  9. 09Practice Quiz练习测验
  10. 10Graded Quiz评分测验
  11. 11Responsibilities and Skillsets of a Data Engineer数据工程师的职责与技能要求
  12. 12Viewpoints: Skills and Qualities to be a Data Engineer成功数据工程师所需的技能与特质
  13. 13A Day in the Life of a Data Engineer数据工程实战案例：社交媒体情绪分析
  14. 14Practice Quiz练习测验
  15. 15Summary and Highlights总结与要点
  16. 16Graded Quiz评分测验
Module 02

The Data Engineering Ecosystem 数据工程生态系统

23 / 31 篇
  1. 01Overview of the Data Engineering Ecosystem数据工程师的生态系统构成
  2. 02Types of Data数据类型：结构化、半结构化与非结构化
  3. 03Understanding Different Types of File Formats常见数据文件类型与格式
  4. 04Sources of Data
  5. 05Languages for Data Professionals查询、编程与脚本语言概览
  6. 06Viewpoints: Working with Varied Data Sources and Types
  7. 07Metadata and Metadata Management
  8. 08Summary and Highlights总结与要点
  9. 09Practice Quiz练习测验
  10. 10Graded Quiz评分测验
  11. 11Overview of Data Repositories数据存储库概览：数据库、数据仓库和大数据存储
  12. 12RDBMS关系型数据库 (RDBMS)：结构、优势与应用场景
  13. 13NoSQL
  14. 14Data Warehouses, Data Marts, and Data Lakes数据仓库、数据集市与数据湖
  15. 15(Optional): Data Lakehouses Explained数据湖仓一体详解（可选）
  16. 16Viewpoints: Considerations for Choice of Data Repository
  17. 17ETL, ELT, and Data PipelinesETL、ELT 与数据管道
  18. 18Data Integration Platforms
  19. 19Viewpoints: Tools, Databases, and Data Repositories of Choice数据工程师访谈：常用工具、数据库和存储库
  20. 20Summary and Highlights总结与要点
  21. 21Practice Quiz练习测验
  22. 22Graded Quiz评分测验
  23. 23Optional Labs for IBM Cloud and Db2IBM Cloud 和 Db2 可选实验
  24. 24[Optional] Obtain IBM Cloud Feature Code and Activate Trial Account获取 IBM Cloud 功能码并激活试用账户（可选）
  25. 25[Optional ] Hands-on Lab: Provision an instance of IBM Db2 Lite plan
  26. 26Foundations of Big Data大数据 (Big Data) 概览：五大 V 特性及其应用
  27. 27Big Data Processing Tools: Hadoop, HDFS, Hive, and Spark
  28. 28Viewpoints: Impact of Big Data on Data Engineering大数据对数据工程的影响
  29. 29Summary and Highlights总结与要点
  30. 30Practice Quiz练习测验
  31. 31Graded Quiz评分测验
Module 03

Data Engineering Lifecycle 数据工程生命周期

24 篇
  1. 01Architecting the Data Platform数据平台架构分层：从采集到分析
  2. 02Factors for Selecting and Designing Data Stores数据存储设计考量：类型、规模与用途
  3. 03Security企业级数据平台安全：四大维度与 CIA 三元组
  4. 04Viewpoints: Importance of Data Security数据安全的重要性：组织的生命线
  5. 05Summary and Highlights总结与要点
  6. 06Practice Quiz练习测验
  7. 07Graded Quiz评分测验
  8. 08How to Gather and Import Data数据获取与导入：方法、工具与存储
  9. 09Data Wrangling数据整理 (Data Wrangling)：从原始数据到分析就绪
  10. 10Tools for Data Wrangling数据整理软件与工具
  11. 11Hands-On Lab: Load data into the Datasette from a CSV file动手实验：从 CSV 文件加载数据到 Datasette
  12. 12Summary and Highlights总结与要点
  13. 13Graded Quiz评分测验
  14. 14Querying and Analyzing Data数据库查询分析技术：基础与进阶应用
  15. 15Performance Tuning and Troubleshooting数据工程性能优化与监控：数据管道和数据库
  16. 16Lab: Explore your dataset using SQL queries using Datasette实验：使用 Datasette 通过 SQL 查询探索数据集
  17. 17Summary and Highlights总结与要点
  18. 18Practice Quiz练习测验
  19. 19Graded Quiz评分测验
  20. 20Governance and Compliance数据治理与合规
  21. 21Summary and Highlights总结与要点
  22. 22Practice Quiz练习测验
  23. 23Graded Quiz评分测验
  24. 24Optional: Overview of the DataOps Methodology可选：DataOps 方法论概述
Module 04

Career Opportunities and Data Engineering in Action 职业机会与数据工程实践

14 / 15 篇
  1. 01Career Opportunities in Data Engineering数据工程职业机遇：市场趋势与成长路径
  2. 02Reading: Data Warehousing Specialist阅读：数据仓库专家
  3. 03Reading: Data Manager阅读：数据经理
  4. 04Viewpoints: Get into Data Engineering走进数据工程：专业人士的职业发展之路
  5. 05Data Engineering Learning Path数据工程学习路径
  6. 06Viewpoints: What Do Employers Look for in a Data Engineer雇主期望：数据工程师的关键技能与特质
  7. 07Viewpoints: The Many Paths to Data Engineering数据工程入门路径：多维度的职业选择
  8. 08Viewpoints: Advice to Aspiring Data Engineers数据工程入门建议：构建基础与实践分享
  9. 09Summary and Highlights总结与要点
  10. 10Practice Quiz练习测验
  11. 11Graded Quiz评分测验
  12. 12Final Quiz期末测验
  13. 13Final Project Submission Guidelines and Deliverables
  14. 14Graded Assignment: Peer Reviewed Assignment评分作业：同行评审作业
  15. 15Congratulations and Next Steps祝贺与后续学习