TES Global is a digital education company whose teaching resources platform enables teachers to share lessons and curriculum-based content. The platform supports the exchange of educational materials, helping educators draw on resources contributed by their peers. As a digital business, TES generates data through audience interactions and its supporting systems, creating opportunities to better understand how people use its services and to track business performance.

One Beyond built an extract, transform and load (ETL) platform using more than twenty Node.js microservices hosted on AWS. We created a Hadoop-based transformation layer to normalise, aggregate and enrich data, with Amazon Redshift providing the central data warehouse. Supporting databases and an integration layer using RabbitMQ and Amazon Kinesis made information available to applications, APIs and data scientists. Overnight processing used Hive and Spark through Amazon EMR, while Datadog dashboards and alerts provided visibility into the platform’s data flows and operations.