iTWire – Synology Builds Petabyte-Scale Data Warehouse for Leading AI Institute

Taiwan AI Labs is Asia’s leading non-profit artificial intelligence research organization and has chosen Synology’s comprehensive line of storage systems to form the core of its AI training infrastructure.

The research center works with the private and public sectors and has led cutting-edge research leveraging the power of AI, including the development of automated diagnostics for COVID-19 and the design and implementation of the Taiwan’s social distancing app.

However, with requirements ranging from massive parallel processing during the training phase to high availability of data and services when powering newly developed applications, there was a large and growing amount of data. This led the IT team at Taiwan AI Labs to search for a versatile solution to manage this ever-growing pool of data generated by its diverse portfolio of sophisticated projects.

This research led the team to Synology, stating that “Synology’s unparalleled performance, scalability, and reliability are exactly what we needed to build our petabyte-scale data warehouse.”

The team chose Synology enterprise storage systems to create a powerful object storage cluster, keeping scalability and reliability requirements in mind. Storage has been supplemented with all-flash systems for increased performance when handling latency-sensitive workloads.

Individual services are provisioned and managed by Kubernetes, running directly from Synology storage. To ensure availability and provide fault tolerance and avoid disasters, the solution was deployed using Synology High Availability (SHA) clusters.

Data security is also a critical factor, which is why the solution also uses a backup architecture designed with highly scalable Synology SA Series units and Snapshot Replication to create point-in-time copies of shared folders and LUNs. These can then be quickly restored in the event of data loss, whether accidental or malicious.

Taiwan AI Labs now plans to leverage Hyper Backup and C2 Storage as one of the solutions needed to complement its 3-2-1 backup architecture, adding resiliency to deployment and further reducing IT management overhead.

“From project conceptualization to final delivery and support, Synology solutions provide us with a solid foundation to focus on research and development without being limited by infrastructure,” explained Taiwan AI Labs.

ENABLE HYBRID CLOUD AND REDUCE NETWORK LATENCY WHITE PAPER

The hybrid cloud promises to bring together the best of both worlds, allowing businesses to combine the scalability and cost-effectiveness of the cloud with the performance and control you can get from your on-premises infrastructure.

Reducing WAN latency is one of the biggest hybrid cloud performance issues. Leveraging data compression and deduplication can reduce your network latency.

Markets and Markets research firm predicted that the size of the hybrid cloud market is expected to grow from US$38.27 billion in 2017 to US$97.64 billion by 2023.

Colocation facilities offer many benefits of having your servers in the cloud while maintaining physical control of your systems.

The cloud adjacency provided by colocation facilities can allow you to take advantage of their high-bandwidth, low-latency connections to the cloud, as well as provide a solid connection to your on-premises corporate network.

Download this white paper to learn what you need to know about enabling hybrid cloud in your organization.

DOWNLOAD NOW!