CHALLENGES & OPPORTUNITIES
To support a transformation on this scale, a new limited company was created. The new company needed a brand new digital service to be created in six months to facilitate it’s operations in a cost effective manner, support onboarding of thousands of 3rd parties and contractors, and provide a flexible data analytics platform for it’s 15+ year lifespan. Valorem Reply UK was selected as the lead technology implementation partner.
With any migration to cloud or when building applications in the cloud, the visibility of the environment is critical to ensure the quality and availability of applications.
Traditional tools are too static or require too much ‘per-endpoint’ configuration to be useful in a dynamic environment.
Native tools, while being great at catering for rapid change, are generally focused on one particular cloud or use-case.
Customers need systems that provide Metrics, Logs, Events, Alerts and Application Traces. These inputs need to feed operational teams, security (SOC) teams as well as for general management information (MI).
To provide complete insight, it is also important to visualize the changes that might affect the running systems.
Whilst these requirements can all be met by point solutions, this would result in a duplication of data, a multitude of different up and downstream integrations and/or limited cross-consumption of useful data.
SOLUTIONS
Valorem Reply UK was engaged to design, build and operate a greenfield digital service capable of supporting 1000+ users. We leveraged a fully-cloud native solution using Elastic alongside Microsoft’s 365 and Azure service stack, integrated with ServiceNow, to build a bespoke, cost-effective common platform for the program.
To solve the problem of end to end visibility we deployed Valorem Reply UK Consolidated Observability.
The solution is based around Elastic.co - a massively scalable document store, specifically tuned for log and metric data combined with visualization and data ingestion frameworks.
Data is sourced from any number of external systems; each with their own format and API for collection or emiction of the data.
All data is normalized on the ingress path to a common schema so that queries and alerts are uniform regardless of the source system.
Complimentary features include:
- Integration into IT service management systems to collect and publish data on assets/configuration items, changes, problems and incidents.
- CMDB structures and best practices to cater for cloud-native resources as well as more traditional server-based infrastructure.
- Integration with continuous delivery to analyze and correlate changes as well as analysis of risk with integration into the ITSMS whilst still delivering agility, rapid iteration and DevOps alignment at scale.
And on top of that, we built common systems for alerting, reporting and data visualization.
RESULTS
Valorem Reply UK designed and built Valorem Reply UK Consolidated Observability with Elastic.
Leveraging Kubernetes clusters deployed on public cloud using Terraform, our platform aggregates data from a large variety of sources, providing a single, central view used by diverse stakeholder groups, with integration into ServiceNow to alert and track the resolution of issues.
Log collection, normalization and scalable ingestion are configured for the entire IT estate, covering Office 365 (including Endpoint Security), Azure and associated applications.
This provides complete visibility of the E2E environment and facilitates analysis, machine learning (actionable insights), alerting, dashboards and data exploration.
All elements built as Infrastructure as Code (IaC) to facilitate maximum flexibility and automation, with Azure DevOps underpinning agile delivery. Delivery of the solution was achieved within just four months from start to launch.
