Session Detail
#Platform#Data#DevelopmentExpertise#DevelopmentExperience#KnowledgeTransfer
MSA for ETL Pipeline Development, and Beyond Polyglot
2022.11.1616:25 - 16:50
Evan Park[Best Reviewer] Samsung Electronics / Big Data Center / Data Platform Group
Session Introduction
Every single morning, a new service is planned and new data sources are introduced. As data requirements expand quickly, data pipeline management and operation are challenging to satisfy business needs. As a data engineer, I want to share how we introduce the Microservice architecture to our pipeline management system and how we develop new pipelines with “No Code Pipeline Framework” to extract 10k source table information and run 1k data pipelines every day.
CommentsPlease leave your valuable comments on the sessions.
0/300
* Comments that are not in line with the event intent (including swear words and slanders) may be deleted by the administrator with no prior notice.Write