Facing data bottlenecks, scalability issues and compliance challenges, the firm’s subsequent data infrastructure upgrade has unlocked more business speed and intelligence

With a workforce comprising over 10,000 individuals from approximately 40 countries and regions, LY Corporation of Japan is a tech firm formed in 2023 through the through the reorganization of firms including LINE Corporation and Yahoo Japan Corporation.

The firm serves over 320m customers across Asia, and operates in various sectors including social media (LINE), web search, advertising, electronic commerce, fintech, financial services (PayPay, PayPay Bank), and cloud-related services.

Running on information spanning over 1.1 exabytes of all clusters, the firm’s data platform manages a vast number of data loading, processing, and management tasks simultaneously. These tasks are crucial for business intelligence, classification and providing personalized recommendations to customers.

personalized recommendations to customers.

Progressively facing challenges such as data bottlenecks, scalability and performance issues, data protection and compliance upkeep, the firm’s mission to ensure data integrity and pipeline availability at all times necessitates infrastructural upgrading. This was duly accomplished by 2024 through the adoption of a data lakehouse architecture powered by the open source Apache Iceberg platform and designed for large-scale analytics, offering the following benefits:

Progressively facing challenges such as data bottlenecks, scalability and performance issues, data protection and compliance upkeep, the firm’s mission to ensure data integrity and pipeline availability at all times necessitates infrastructural upgrading. This was duly accomplished by 2024 through the adoption of a data lakehouse architecture powered by the open source Apache Iceberg platform and designed for large-scale analytics, offering the following benefits:

  • Enhanced data delivery: The system now delivers data at 10–12 times faster without straining the central data management system
  • Increased business intelligence: Addressing all previous data management issues helped the firm to make better use of data for business intelligence and personalized recommendations, leading to improved core revenues
  • Increased productivity: Efficient data processing tools and self-service data management features allow the firm’s data scientists and engineers to respond more quickly to regulatory requirements and policy updates, enhancing productivity all around
  • Increased productivity: Efficient data processing tools and self-service data management features allow the firm’s data scientists and engineers to respond more quickly to regulatory requirements and policy updates, enhancing productivity all around

According to the LY Corporation’s Senior Engineering Manager (Data Engineering Group), Tasuku Okuda: “We can now deliver data faster and more efficiently, empowering our teams to focus on driving value for our customers.”

The technology partner that orchestrated the data management system upgrade, Cloudera, has been providing its services to earlier entities of the LY Corporation for the past 10 years.