Forwarded from Data Engineering / Инженерия данных / Data Engineer / DWH
The Data Engineering Cookbook (MOUSAIF, YASSINE) (z-lib.org).fb2
2.4 MB
The Data Engineering Cookbook
Mastering The Plumbing Of Data Science
September 12, 2021
https://github.com/andkret/Cookbook code examples
https://cookbook.learndataengineering.com/docs/01-Introduction - free online version
Mastering The Plumbing Of Data Science
September 12, 2021
https://github.com/andkret/Cookbook code examples
https://cookbook.learndataengineering.com/docs/01-Introduction - free online version
Forwarded from Data Engineering / Инженерия данных / Data Engineer / DWH
Introduction to Data Engineering (Daniel Beach) (z-lib.org).pdf
1.9 MB
Introduction to Data Engineering (Daniel Beach).pdf
With the rise of Data Science and Machine Learning, Data Engineering is quickly becoming an in-demand skill. Data Engineering requires a unique skill set that is hard to learn without experience. I will teach you how to write scalable data pipelines and more!
Introduction
Chapter 1 - The Theory
Chapter 2 - Data Pipeline Basics
Chapter 3 - Pipeline Architecture
Chapter 4 - Storage
Chapter 5 - Compute and Resources
Chapter 6 - Mastering SQ
Chapter 7 - Data Warehousing / Data Lakes
Chapter 8 - Data Modeling
Chapter 9 - Data Quality
Chapter 10 - DevOps for Data Engineers
With the rise of Data Science and Machine Learning, Data Engineering is quickly becoming an in-demand skill. Data Engineering requires a unique skill set that is hard to learn without experience. I will teach you how to write scalable data pipelines and more!
Introduction
Chapter 1 - The Theory
Chapter 2 - Data Pipeline Basics
Chapter 3 - Pipeline Architecture
Chapter 4 - Storage
Chapter 5 - Compute and Resources
Chapter 6 - Mastering SQ
Chapter 7 - Data Warehousing / Data Lakes
Chapter 8 - Data Modeling
Chapter 9 - Data Quality
Chapter 10 - DevOps for Data Engineers
Forwarded from Airbyte - ETL ELT Data Pipelines
Урок из марафона с разбором Airbyte
https://www.youtube.com/watch?v=bzjXuilsUuU
Материалы марафона https://github.com/Arkronus/cooking-data
https://www.youtube.com/watch?v=bzjXuilsUuU
Материалы марафона https://github.com/Arkronus/cooking-data
YouTube
6 Инструменты ETL на Python
В последнем уроке вы узнаете об современных открытых инструментах и библиотек для работы с ETL. Мы рассмотрим инструмент миграции данных Airbyte, библиотеку ELT трансформации данных DBT и посмотрим как создавать ETL-процессы с помощью библиотек Pandas и Petl.…
GitHub - ozlerhakan/datacamp: 🍧 DataCamp data-science and machine learning courses
https://github.com/ozlerhakan/datacamp
https://github.com/ozlerhakan/datacamp
GitHub
GitHub - ozlerhakan/datacamp: 🍧 DataCamp data-science and machine learning courses
🍧 DataCamp data-science and machine learning courses - ozlerhakan/datacamp
Forwarded from cube.dev & cube.js
Как построить систему аналитики на open-source — туториал по cube.js
https://habr.com/ru/post/658581/
https://habr.com/ru/post/658581/
Хабр
Как построить систему аналитики на open-source — туториал по cube.js
Сube (до недавнего времени cube.js) относительно молодой проект (первый релиз март 2019) - реализация концепции OLAP-куб. Несмотря на отличную документацию , в интернете пока что мало информации на...
Forwarded from Apache Superset BI
Apache Superset 1.5: Release Notes | Preset
https://preset.io/blog/apache-superset-1-5-release-notes/
https://preset.io/blog/apache-superset-1-5-release-notes/
preset.io
Apache Superset 1.5: Release Notes
Apache Superset 1.5 is now released! Superset 1.5 focuses on polishing the dashboard native filters experience, while improving performance and stability.
Embed Power BI analytics - Learn | Microsoft Docs
https://docs.microsoft.com/en-us/learn/paths/power-bi-embedded/
https://docs.microsoft.com/en-us/learn/paths/power-bi-embedded/
Docs
Embed Power BI analytics - Training
This learning path teaches you how to embed Power BI content in apps, develop programmatic solutions using the Power BI REST API and the Power BI Client APIs, enforce row-level security (RLS) for embedded content, automate common Power BI setup tasks, configure…
Forwarded from Инжиниринг Данных (Dmitry)
dbt известны своей относительной простотой, так как дает возможность создавать все трансформации данных на SQL. Согласно их roadmap на 2022 год, они добавляют поддержку Python - Python-language dbt models
GitHub
dbt-core/docs/roadmap/2022-05-dbt-a-core-story.md at main · dbt-labs/dbt-core
dbt enables data analysts and engineers to transform their data using the same practices that software engineers use to build applications. - dbt-labs/dbt-core
Forwarded from Datahub Project
Telegraph
DataHub: Popular metadata architectures explained
When I started my journey at LinkedIn ten years ago, the company was just beginning to experience extreme growth in the volume, variety, and velocity of our data. Over the next few years, my colleagues and I in LinkedIn’s data infrastructure team built out…
How to measure data quality. Practical guidelines for how to measure… | by Mikkel Dengsøe | May, 2022 | Medium
https://medium.com/@mikldd/how-to-measure-data-quality-cc3d81dd98be
https://medium.com/@mikldd/how-to-measure-data-quality-cc3d81dd98be
Medium
How to measure data quality
Practical guidelines for how to measure quality, engagement and productivity in a data team
5 ways to measure the ROI of Data & Analytics (The simple way) | by Santiago Tacoronte | Medium
https://santiagotacoronte.com/5-ways-to-measure-the-roi-of-data-analytics-the-simple-way-a61790eff7d1
https://santiagotacoronte.com/5-ways-to-measure-the-roi-of-data-analytics-the-simple-way-a61790eff7d1
Medium
5 ways to measure the ROI of Data & Analytics (The simple way)
“We need more data analysts” or “we have too many data analysts.” Where do you stand?.
Если вы рассматриваете варианты для замены западных вендоров - советую присмотреться к FineBI.
Чтобы получать оперативную информацию по продукту - подпишитесь на канал https://www.tg-me.com/finebi_russia
#реклама
Чтобы получать оперативную информацию по продукту - подпишитесь на канал https://www.tg-me.com/finebi_russia
#реклама
Telegram
FineBI Russia
Канал про FineBI & FineReport на русском - китайская система бизнес-аналитики. Платформа поставляется в комплекте с платформами управления и контроля корпоративного уровня. Fine BI Data Management — программное обеспечение для анализа данных
FlowingData
Graphics by Nathan Yau, borne out of everyday curiosities, learning experiments, and mild insomnia.
https://flowingdata.com/category/projects/
Graphics by Nathan Yau, borne out of everyday curiosities, learning experiments, and mild insomnia.
https://flowingdata.com/category/projects/
FlowingData
Projects – FlowingData
Graphics by Nathan Yau, borne out of everyday curiosities, learning experiments, and mild insomnia.
Интересный проект на тему Data Lineage
Generate and Visualize Data Lineage from query history
https://github.com/tokern/data-lineage
Generate and Visualize Data Lineage from query history
https://github.com/tokern/data-lineage
GitHub
GitHub - tokern/data-lineage: Generate and Visualize Data Lineage from query history
Generate and Visualize Data Lineage from query history - tokern/data-lineage
The_Enterprise_Data_Catalog_Early_Release_Ole_Olesen_Bagneux_z_lib.pdf
1.2 MB
The Enterprise Data Catalog (Early Release) (Ole Olesen-Bagneux).pdf
How do you search for data? Combing the internet is simple. But do you search for data at work? It can be difficult and time-consuming. Sometimes it even seems impossible. This book introduces a practical solution: the data catalog. Data analysts, data scientists, and data engineers will learn how to create true data discovery in their organizations, making the catalog a key enabler for data-driven innovation and data governance.
Learn what a data catalog is and how it can help your organization search for data
Organize data in a catalog, including its sources, where it belongs, and how to describe it with metadata
Manage your data catalog, create access to data sources, and browse relational graph structures across systems and domains
Learn how to search your data, including its sources, and how it travels and changes in data lineage
Implement a data catalog in a way that exactly matches the strategic priorities of your organization
How do you search for data? Combing the internet is simple. But do you search for data at work? It can be difficult and time-consuming. Sometimes it even seems impossible. This book introduces a practical solution: the data catalog. Data analysts, data scientists, and data engineers will learn how to create true data discovery in their organizations, making the catalog a key enabler for data-driven innovation and data governance.
Learn what a data catalog is and how it can help your organization search for data
Organize data in a catalog, including its sources, where it belongs, and how to describe it with metadata
Manage your data catalog, create access to data sources, and browse relational graph structures across systems and domains
Learn how to search your data, including its sources, and how it travels and changes in data lineage
Implement a data catalog in a way that exactly matches the strategic priorities of your organization
Democratize enterprise analytics with Microsoft Power BI
These announcements include:
🔵 Datamart in Power BI
🟡 Metrics in Power BI and other enhancements
💙 Data storytelling in PowerPoint
💛 Integration with Outlook and Office Hub
☮
https://powerbi.microsoft.com/en-us/blog/democratize-enterprise-analytics-with-microsoft-power-bi/
These announcements include:
🔵 Datamart in Power BI
🟡 Metrics in Power BI and other enhancements
💙 Data storytelling in PowerPoint
💛 Integration with Outlook and Office Hub
☮
https://powerbi.microsoft.com/en-us/blog/democratize-enterprise-analytics-with-microsoft-power-bi/
Microsoft
Democratize enterprise analytics with Microsoft Power BI
Microsoft Build represents the ultimate developer event. A hundred thousand developers from across the world gather for three days with their peers to learn, engage, and collaborate on the latest innovations and tools from Microsoft.
Forwarded from Data Engineering / Инженерия данных / Data Engineer / DWH
Self-service Business Intelligence, Powered by dbt
https://medium.com/modern-business-intelligence/self-service-business-intelligence-powered-by-dbt-3b7e24a92e27
https://medium.com/modern-business-intelligence/self-service-business-intelligence-powered-by-dbt-3b7e24a92e27
Medium
Self-service Business Intelligence, Powered by dbt
Self-service Business Intelligence (BI) is just around the corner, right?
Sad KPI
100 дней безуспешных попыток "привыкнуть" или хотя бы свыкнуться с реальностью 💛💙
100 дней безуспешных попыток "привыкнуть" или хотя бы свыкнуться с реальностью 💛💙