Latest Posts

Featured Posts

Filter By Categories:

Towards Industrial-Grade Machine Learning

By Roverso, Davide 27. November 2019

Towards Industrial-Grade Machine LearningAI and Machine Learning are undoubtedly soon to become pervasive technologies across society. The range of applications and the power of deployable solutions is proliferating. With this comes the growing need for replicable, robust, monitorable, maintainable, and scalable solutions.

This set of properties forms the basis of what we can call Industrial-Grade Machine Learning. Apart from simple one-of-a-kind or proof-of-concept applications, handcrafted models deployed, for example, as dedicated web services are insufficient when the value to be extracted spans a large number of assets, each requiring a personalized model.

The energy and power utilities sectors are characterized by high multiplicities that require scalable and replicable solutions. A representative example is load monitoring and forecasting at secondary substations. A typical electrical power distribution utility has from a few hundred to several thousand substations, each one having a unique load profile and requiring a tailor-made prediction model. Manually developing, deploying, integrating, operating, monitoring, and maintaining thousands of prediction models is neither feasible nor sustainable. Similar examples from the same industry are production forecasts for residential solar power installations, load forecasts for EV charging stations, flexibility forecasts for prosumers, and automated analysis of inspection data, such as imagery.

Read also: The Acceleration of Machine Learning and Its Vertical Realizations

Industrial-Grade Machine Learning entails, in our view, a set of basic requirements, illustrated in the following example of predictive analytics services, though the same principles apply equally well to inspection and other analytics services.

Standardization. Prediction services require a unified interface (API) to facilitate standardization, maintainability, and interchangeability between services. This also allows “consumers” to query the forecasting capability of each prediction service.

Logging and monitoring. The activity and performance of each prediction service should be logged and monitored to ensure traceability and early detection of performance degradation which might trigger a prediction model update or re-training. Supporting tools for large-scale monitoring such as graphical dashboards provide additional support.

Automated Routing. A prediction request should be automatically routed to the best available prediction service that can handle the request. Alternative services can potentially be available that differ in performance profile and data requirements, and a mechanism to select the best available service given the current conditions and constraints makes the system significantly more robust, for example in the case of missing data.

Automated Re-training. Re-training prediction service instances, either on a schedule, on demand, or triggered by observed performance degradation, must be possible.

Continuous Integration. Changes in prediction service code, trigger automated unit tests, code quality checks, configurations, and deployment.

Read also: Using Machine Learning and Smart Meter Data for Fraud Detection

As machine learning and AI applications continue to mature, there will be an increasing need for mass-produced intelligent systems, replacing handcrafting with automation, just as conveyor belts and assembly lines replaced artisan workshops and revolutionized the manufacturing industry.

At eSmart Systems, we have a continuous focus on Industrial-Grade Machine Learning. It spans from large-scale cloud deployment of deep learning models for automated image analysis to our newest Robust Predictive Analytics Architecture (RPAA) for deploying prediction models at scale. We firmly believe this is a fundamental strategic advantage for delivering economy of scale value to the energy and power utilities sector.

Read also our guide to efficient power grid operations for the digital age. 

Download for free: Next Gen Utility Infrastructure Operation 

Roverso, Davide's photo

By: Roverso, Davide

Davide is Chief Analytics Officer at eSmart Systems and leads the analytics team. He holds a PhD in Computing Science from Aberdeen University (UK). Davide has 25 years’ experience in the field of Machine Learning and Big Data Analytics, with applications in diagnostics, prognostics, condition monitoring, and early fault detection in complex processes, in sectors ranging from energy to medicine and environmental monitoring. He has authored over 90 publications in international journals, conference proceedings and edited books.

  • 1 Comment

A blog from eSmart Systems


eSmart Systems provides AI driven software solutions to the energy industry and service providers. Their cloud born platform is designed to handle and exploit IoT, Big Data and Analytics in real time. The company is based on more than 20 years of international experience in establishing and operating knowledge based, leading IT and energy related companies targeting global markets.


If you want to stay updated on artificial intellgence, the rapid development of the energy supply, the power grid and the energy consumption trends, Intelligence First is your water hole.