AI/ML Engineer - ELK Stack at Distributed, Birmingham, £Contract Rate

Duration not stated Information Technology

Contract Description

AI/ML Engineer - ELK Stack

Birmingham/Onsite

6 months


Who are we?


We're a software development company building the world's Elastic Workforce, reinventing work and challenging the assumption that a local team the best team.

We help businesses deliver technical projects better than ever before through our platform and on-demand Elastic Teams.

What's in it for you? Our mission is to create freelance jobs with more benefits than permanent.

Want to know more? read: https://distributed.co/about

About this role

We're partnering with a global organisation as they replace their legacy threat hunting and intelligence platform with Elastic to enhance efficiency and speed. The new solution will simplify data searching and correlation across large-scale telemetry datasets, enabling quick detection of enterprise threats. With the capacity to ingest approximately 80TB of data daily, it will leverage AI and machine learning technologies. The implementation plan includes testing use cases to ensure effective performance in a production environment while understanding existing customisations.


Your Responsibilities

  • In-depth knowledge of Elastic’s Machine Learning features and experience with unsupervised learning for anomaly detection in time series data.
  • Proficiency in implementing single and multi-metric anomaly detection jobs for various data types, along with designing models for entity-centric analysis and rare event detection.
  • Ability to create time series forecasting models for predictive analytics and conduct trend analysis for long-term pattern recognition in security data.
  • Experience in designing custom Kibana dashboards to visualise ML job results, configuring ML-based alerts, and developing plugins for enhanced visualisation.
  • Familiarity with Elastic Common Schema (ECS) and optimising data mappings to enhance ML performance and accuracy.
  • Strong skills in scripting and automation, including using the Elasticsearch REST API and developing Python scripts for data preprocessing and model evaluation.

About You

We’re looking for passionate technologists who enjoy working in collaborative agile teams. You’ll need to be a clear, concise & engaging communicator with people on your team. We enjoy the big picture and the detail; we want people who excel at both.

  • Strong understanding of Elastic’s Machine Learning features, with hands-on experience in configuring and tuning ML jobs in Elasticsearch.
  • Proven experience in anomaly detection, including the implementation of single and multi-metric anomaly detection jobs and population anomaly detection models.
  • Ability to create time series forecasting models and conduct trend analysis for security data, with a focus on predictive security analytics.
  • Experience in designing custom Kibana dashboards and configuring ML-based alerts, along with developing custom plugins for enhanced visualisation.
  • Familiarity with Elastic Common Schema (ECS) and experience in optimising data mappings to improve ML performance and accuracy.
  • Proficient in scripting and automation, including using the Elasticsearch REST API and developing Python scripts for data preprocessing and model evaluation.
  • Experience in integrating ML capabilities within Elastic Security for enhanced threat detection and developing ML-driven correlation rules.
  • Strong collaborative skills to work closely with security specialists and provide guidance on leveraging ML features within the Elastic Stack.

About us

Distributed is proud to be an equal opportunities employer. Employees and contractors, as well as prospective employees and contractors, will all be treated equally and fairly. Distributed is committed to ensuring no less favourable treatment is experienced by any current or prospective employee because of any of the protected characteristics under the UK Equality Act 2010 or equivalent local equality legislation.

By submitting your application you give us permission to store and use the information from your CV and your answers to application questions.