Sphynx: PUBG's Data Platform Powered by Apache Spark on Kubernetes Архитектуры, масштабируемость
Chun is a software engineer at PUBG Corporation who is enthusiastic about cloud infrastructure, container and Kubernetes. He has recently contributed to building a global-scale game server infrastructure for the video game called [Playerunknown’s Battlegrounds]. These days his main interest is building a robust and scalable data platform for data-driven development in game industry
Kubernetes has achieved one of the dominating platform for container-based infrastructure. Many platforms are starting to support Kubernetes as first-class and Apache Spark, analytics engine for large-scale data processing, is one of them. From Spark 2.3, Spark can run on clusters managed by Kubernetes. PUBG Corporation, serving an online video game for 10s of millions of users, decided to migrate its on-demand data analytics platform using Spark on Kubernetes. At this talk, Jihwan Chun and Gyutak Kim will describe the challenges and solutions building a brand-new data platform powered by Spark on Kubernetes.