Senior Data Engineer (Data Pipeline Testing)

Job Description

Chubb is the world’s largest publicly traded property and casualty insurer operating in 54 countries, Chubb is making significant investments to thrive in a digital age. Chubb launched its third Technology Hub in Thessaloniki in 2022 which is rapidly developing. Our new center of excellence in Greece is positioned to drive our ongoing business and to support our digital business transformation, as well as the company's operations in the European region which encompasses 27 countries.

Chubb is looking for a Senior Data Engineer (Data Pipeline Testing) to join our team. This is a permanent full-time position and a compelling opportunity to join a global, growing, financially stable and successful company. As an industry leader, Chubb is an employer of choice for skilled technology professionals aspiring to develop a meaningful career in a fast-paced, diverse company with offices in most major cities in the world. The successful candidate will be responsible for ensuring the quality and accuracy of our data systems and ETL pipelines. This role requires someone who can collaborate effectively with the data engineering and data science teams to drive improvements in data quality and correctness.

Responsibilities

• Collaborate with cross-functional teams to understand data requirements and define testing strategies for data quality assurance.
• Develop and execute test plans, test cases, and test scripts to validate data pipelines and identify potential issues.
• Perform extensive data analysis to identify anomalies, inconsistencies, and gaps in data quality.
• Work closely with data engineering and data science teams to remediate data quality issues and improve data integrity.
• Continuously monitor and evaluate the effectiveness of data quality processes and make recommendations for improvements.
• Contribute to the automation of data quality tests and processes using SQL scripts, Python, and PySpark.
• Collaborate with software developers in troubleshooting and resolving data-related issues.
• Implement data quality standards and processes and tools to ensure that data meets those requirements.
  
  

Qualifications

QUALIFICATIONS

• Bachelor's degree in Computer Science, Information Systems, or a related field.
• Minimum of 7 years of experience as a Data Engineer, Tester, or in a similar role.
• Strong knowledge of SQL, Python or Java, Spark, Manual and Automated Testing (within ETL/Data Engineering contexts)
• Experience with testing real-time/streaming data pipelines (e.g. via Kafka)
• Clear hands-on experience with database systems - Cloud technologies (e.g. AWS, Azure, Google), database systems - traditional RDBMS (e.g. Teradata, SQL Server, Oracle), and NoSQL databases (e.g. Cosmos, MongoDB, DynamoDB), Analytical datastore (e.g. Synapse & Snowflake)
• Exposure to DQ tools (e.g. Talend Data Quality, Oracle EDQ, Informatica IDMC, IBM InfoSphere QualityStage) as well as more recent big data tools
• Deep understanding of data quality concepts and best practices, including data profiling, data cleansing, data matching, and data governance.
• Ability to define and implement data quality standards for different types of data and systems.
• Ability to work with stakeholders to understand data quality needs and priorities, and to develop and implement data quality solutions that meet those needs.
• Ability to coach and mentor junior data quality engineers and educate on best practices
• Ability to stay up-to-date on the latest trends and best practices in data quality.
• Excellent communication and collaboration skills.
• Critical Thinking
  
  

Our team makes a difference, every time. For this reason, we offer in return!

We offer hybrid working model, explicit, structured career development, a competitive salary package, annual bonus, private medical cover, monthly allowance for lunch, continuous learning experiences, work in a fun, lively environment with mentoring from our ground-breaking senior mentors.

Integrity. Client Focus. Respect. Excellence. Teamwork

Our core values instruct how we live and work. We’re an ethical and honest company that’s wholly committed to its clients. A business that’s engaged in mutual trust and respect for its employees and partners. A place where colleagues perform at the highest levels. And a working environment that’s collaborative and encouraging.

Diversity & Inclusion

At Chubb, we consider our people our chief competitive advantage and as such we treat colleagues, candidates, clients, and business partners with equality, fairness, and respect, regardless of their age, disability, race, religion or belief, gender, sexual orientation, marital status or family circumstances. We strive to achieve an environment where all colleagues feel comfortable performing to their full potential and are recognized for their contributions.

Many voices, One Chubb!