Batch monitor

Global Batch Monitoring and Control Project for the Corporate & Investment Banking area of a Multinational Entity, the objective of which is to develop an application for real-time monitoring of the various systems…

We developed the project based on a Kafka consumer for reading from a topic and generation of all the transformations necessary and storage in Elasticsearch. Design, maintenance and updating of the indexes are carried out in Elastic; with design of the dashboards in Kibana (mainly those particular to Accounting and Murex).

In addition to Kafka and Elastic technologies, the project is based primarily on process development with Apache NIFIs: the design process for reading Rest API (Accounting), the process for reading Syslog, as well as the process for dumping to Kafka after the necessary transformations.