DEV Community

# dataengineering

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
From Script to Spreadsheet: Building a Self-Serve Etsy Competitor Tracker
anderecit profile

From Script to Spreadsheet: Building a Self-Serve Etsy Competitor Tracker

#webscraping #devops #python #dataengineering
2
Comments
5 min read
Building a 'Data-on-Demand' Microservice: Wrapping Alibaba Scrapers for Internal Tools
withatte profile

Building a 'Data-on-Demand' Microservice: Wrapping Alibaba Scrapers for Internal Tools

#webscraping #scraper #python #dataengineering
2
Comments
5 min read
Part 2: dbt Project Structure & Building Models 📁
abdelrahman_adnan profile

Part 2: dbt Project Structure & Building Models 📁

#data #dataengineering #sql #tutorial
Comments
4 min read
# Module 4 Summary - Analytics Engineering with dbt
abdelrahman_adnan profile

# Module 4 Summary - Analytics Engineering with dbt

#analytics #dataengineering #sql #tutorial
Comments
2 min read
Part 3: Testing, Documentation & Deployment 🚀
abdelrahman_adnan profile

Part 3: Testing, Documentation & Deployment 🚀

#analytics #dataengineering #sql #tutorial
Comments
5 min read
Machine Learning Starts With a WHERE Clause
brittany_37606c0775530a57 profile

Machine Learning Starts With a WHERE Clause

#dataengineering #datascience #machinelearning #sql
1
Comments
2 min read
Pandas 3.0's PyArrow String Revolution: A Deep Dive into Memory and Performance
kaniel_outis profile
Bato

Pandas 3.0's PyArrow String Revolution: A Deep Dive into Memory and Performance

#ai #datascience #dataengineering #machinelearning
2
Comments
6 min read
How We Built a Deterministic File Import Pipeline in TypeScript (CSV, XLSX, ZIP)
r_j_multischema profile

How We Built a Deterministic File Import Pipeline in TypeScript (CSV, XLSX, ZIP)

#backend #dataengineering #saas #typescript
Comments
2 min read
AWS Data Engineer Associate (DEA-C01): What Each Domain Actually Tests (From Someone Who Just Passed)
andy_youtube_371fe0c1a37e profile

AWS Data Engineer Associate (DEA-C01): What Each Domain Actually Tests (From Someone Who Just Passed)

#aws #cloud #certification #dataengineering
Comments
2 min read
Why Most Data Governance Tools Miss the Real Relationships — and What to Do About It
hello_arisyn_0dc948aa82b3 profile

Why Most Data Governance Tools Miss the Real Relationships — and What to Do About It

#datagovernance #dataengineering #dataarchitecture #datainfrastructure
Comments
2 min read
11 Compaction Optimizations for Iceberg Data Lakes
davidwr profile

11 Compaction Optimizations for Iceberg Data Lakes

#dataengineering #iceberg #snowflake
1
Comments
25 min read
Under the Hood of Arisyn: How Statistical Field Fingerprinting Enables Deterministic Data Linking
hello_arisyn_0dc948aa82b3 profile

Under the Hood of Arisyn: How Statistical Field Fingerprinting Enables Deterministic Data Linking

#dataengineering #dataarchitecture #databasesystems #ai
Comments
2 min read
ELI25: Apache Kafka Quick Notes for Interviews
haydencordeiro profile

ELI25: Apache Kafka Quick Notes for Interviews

#architecture #dataengineering #distributedsystems #interview
Comments
4 min read
Postmortem: Eliminating OOM Failures in Spark on Kubernetes (Azure) After Cloud Migration
pranavbhasker profile

Postmortem: Eliminating OOM Failures in Spark on Kubernetes (Azure) After Cloud Migration

#dataengineering #kubernetes #cloud #spark
Comments
5 min read
We All Accepted the "Python Tax.", Pandas 3.0 Just Reduced It.
kaniel_outis profile
Bato

We All Accepted the "Python Tax.", Pandas 3.0 Just Reduced It.

#python #pandas #performance #dataengineering
2
Comments
2 min read
👋 Sign in for the ability to sort posts by relevant, latest, or top.