Job Introduction

dmg::media own some of the world’s biggest news brands, and as such processes billions of data points every month in order to provide insights and targeting criteria for teams and stakeholders as part of our ambition to be the world’s leading Publisher when it comes to the sophisticated application of data – to power relentless growth.

dmg::media is seeking experienced and talented Senior Data Engineers to evolve its Big Data technologies and advance its overall data proposition. You will design and build data pipelines, data streams, data service APIs, data generators and other end-user information portals and insight tools – to be used across the group.

The Senior Data Engineer will be working as part of an Engineering Team responsible for a brand-new cutting-edge data platform based upon Microsoft Azure and Databricks Lakehouse technologies. They will assist in the creation of data products with a commercial and editorial focus – that have a direct impact on the performance of the business.  They will gather an understanding of dmg:media’s existing data architecture and how to combine their datasets effectively to produce the desired outcomes for the business.

The Senior Data Engineer designs and supports the business’s database/table schemas for new and existing data sources on the data platform. They create and support the ETL in order to facilitate the accommodation of new data into the platform. In this capacity, the Senior Data Engineer designs and develops systems for the maintenance of the business’s data warehouse, ETL processes, and business intelligence.

This role is highly collaborative and, as such, will work closely with data analysts, data scientists, and other data consumers within the business to support their analytical and reporting endeavours.

This individual should be smart, pragmatic and have a passion for solving complex problems.  The ability to communicate advanced solutions to less-technical stakeholders is essential, as is a general dedication to using data and technology effectively. The individual should demonstrate strong communication skills, be proactive and be committed to bringing business value to the role.

Applicants must be experienced in implementing data solutions based on DataBricks.

 

Main Responsibilities

• Plan, build and implement data solutions based on Azure/DataBricks
• Design and build modern Data Pipelines and Data Streams.
• Management of data processing and ETLs
• Management of data mart for defined data driven use cases
• Pre-processing of structured and unstructured data, define queries as required.
• Provide best-practices and frameworks for testing and data validation.
• Work on data-driven products such as user journey analysis and data driven editorial tools
• Consult and work with wider Tech Team to ensure ambitions are realized.
• Perform root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.
• Build processes supporting data transformation, data structures, metadata, dependency, and workload management.
• Manipulation, processing and extracting value from large, disconnected datasets.

 

Person Specification

Required

• Demonstrable experience of working with Databricks
• Demonstrable experience with and knowledge of Azure components – Azure Data Factory, Azure Data Lake, Azure SQL DW, Azure Synapse etc.
• Bachelor’s degree in Computer Science, Applied Mathematics, Engineering, or any other technology related field.
• Approximately 5 years of working experience as a data engineer
• Proficient in ETL solutions across Microsoft Azure and Google Cloud Platform.
• Very good practical knowledge SQL, Python and data platform management.
• Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases.
• Well experienced in extracting data from APIs
• Ability to conduct data profiling, cataloging, and mapping for technical design and construction of technical data flows.
• Knowledge of message queuing, stream processing, and highly scalable ‘big data’ data stores.
• Experience supporting and working with cross-functional teams in a dynamic environment.
• Experience in log management tools to troubleshoot issues as well as identify useful analytics data.

 

Preferred

• Experience preparing data for Data Science and Machine Learning
• Spark, Redshift, Hadoop Map-Reduce or other Big Data frameworks
• Code management tools (Git, Sbt, Maven)
• Scala or other functional programming languages
• Analytics tools such as R or SPSS
• Experience with visualization tools such as especially Microsoft Power BI
• Any understanding of Web Analytics data such as Adobe Analytics or Google Analytics is a plus, but not essential.

 

Package Description

In return for their energy and ideas we ensure our people are well rewarded. Our benefits package increases the longer you’ve been with us. Here’s what to expect:

• 25 days’ holiday (increasing by 1 per year up to a total of 30)
• Upon joining you will be automatically enrolled onto the Pension Plan at the minimum level of 5% employee contribution, 3% Company contribution.
• Life cover under the Pension Plan 4x your basic salary.
• DMGT Discounts (for discounts on online shopping, vouchers and reloadable cards)
• Subsidised canteen
• Onsite gym (Northcliffe House only)
• Onsite nurse and GP clinics (Northcliffe House only)
• Our Employee Assistance Programme
• Discounted dining cards

 

About dmg::media

“dmg media’s brands deliver highly engaging, trusted content to millions of loyal customers around the globe, 24-hours a day, seven days a week. The Mail brand reaches one in two Brits every month and is officially the best-read, most recognised, most engaged newsbrand in the country.*

 Together, Daily Mail, The Mail on Sunday, MailOnline, Mail+, Metro, Metro.co.uk, i and inews.co.uk reach more than 10.1m people daily in the UK.*

 Globally, dmg media’s brands reach 190M unique browsers every month across its domains and apps.**

 Our newsbrands maintain an unwavering commitment to uncovering the stories that matter most to our readers, ensuring that we remain experts at delivering relevant and insightful content.

 In October, the Mail became the largest news publisher on TikTok with over 7- million followers. 

 

*PAMCo H2 2023

**GA 2023 September”

 

Our Commitment

We are committed to increasing diversity and maintaining an inclusive workplace culture. We welcome applications from all qualified candidates regardless of their ethnicity, race, gender, religious beliefs, sexual orientation, age, marital status, or disability.

We are Disability Confident Committed. Please let us know if you require any recruitment documentation in other formats or if you require reasonable adjustments to be made during the recruitment process. Please be assured that any such information will be held separately to your recruitment application and will not be considered as part of the selection process.