PinnedSupun KamburugamuveCylon Library for Fast, Scalable Data EngineeringLarge-scale data engineering has gone through a remarkable transformation over the past decade. We have seen wide adoption of Big Data…7 min read·Oct 21, 2020--2--2
Supun KamburugamuveHigh-Performance Network Fabrics and LibrariesNot long ago, high-performance network fabrics like InfiniBand, HPE Slingshot, or Intel Omni-Path (now CORNELIS) were primarily found in…3 min read·1 day ago----
Supun KamburugamuveThe Three Core Concepts behind Data FrameworksThe three most important aspect of a data framework that defines its capabilities.7 min read·Feb 6, 2023----
Supun KamburugamuveCylon DataFrames for Distributed Data ProcessingData engineering is becoming an increasingly important part of scientific discoveries with the adoption of deep learning and machine…5 min read·Apr 22, 2021----
Supun KamburugamuveWhy map-reduce is not a generic computation platformSimple solutions that are capable of solving a large class of problems ignites the creativity side of the people. Hadoop is a great system…4 min read·Dec 1, 2019----
Supun KamburugamuveTwister2 — A New Data Processing PlatformData processing is becoming part of everyday life for any organization looking into the future. Big data needs clusters of computers to…2 min read·Nov 27, 2019----