Job Description
Position Overview: We are seeking a skilled and motivated Sr Data Engineer to join our team. The ideal candidate will have a strong background in designing, developing, and optimizing data pipelines and ETL processes, with hands-on experience in Python, Databricks, and/or IICS (Informatica) or similar. The ideal candidate will also have proven experience leading teams of data analysts & ETL developers for solution delivery. This role requires a collaborative mindset, a passion for data engineering best practices, and the ability to deliver scalable and efficient data solutions that align with business objectives.
Key Responsibilities
- Data Pipeline Development: Design, develop, and implement data pipelines and ETL processes using Python and Databricks and/or IICS (Informatica).
- Collaboration: Work closely with data scientists and analysts to understand data requirements and deliver solutions that meet business needs.
- Optimization: Optimize existing data workflows for performance, scalability, and reliability.
- Monitoring and Troubleshooting: Monitor and troubleshoot data pipeline issues, ensuring timely resolution to maintain data integrity and availability.
- Documentation: Document data processes, workflows, and technical specifications to ensure clarity and maintainability.
- Continuous Learning: Stay updated with the latest industry trends and technologies related to data engineering, cloud services, and data integration.
Qualifications
- Technical Expertise:
- Proven experience in Python programming and data manipulation.
- Knowledge of Databricks and its ecosystem (e.g., Spark, Delta Lake).
- Experience with IICS (Informatica) or similar cloud-based data integration tools.
- Familiarity with SQL and database management systems (e.g., SQL Server, Snowflake).
- Understanding of data warehousing concepts and best practices.
- Experience with cloud platforms (e.g., AWS, Azure, GCP).
- Leadership & Collaboration
- Ability to collaborate with business to determine technical solution requirements
- Experience leading dev teams using agile practices
- Problem-Solving and Optimization:
- Mid-level problem-solving skills with a focus on addressing performance issues in data workflows.
- Experience implementing optimization techniques and evaluating performance improvements using measurable metrics.
- Best Practices:
- Understanding of data engineering best practices, including data quality, reliability, and maintainability.
- Knowledge of robust monitoring practices and data governance principles.
- Soft Skills:
- Strong communication and collaboration skills.
- Familiarity with Agile development methodologies.
Preferred Skills
- Hands-on experience with data storage solutions such as data lakes and data warehouses.
- Knowledge of data orchestration frameworks and their practical application in past projects.
- Insights into common pitfalls in the data lifecycle and strategies to avoid them.
About Us
Chubb is a world leader in insurance. With operations in 54 countries, Chubb provides commercial and personal property and casualty insurance, personal accident and supplemental health insurance, reinsurance, and life insurance to a diverse group of clients. The company is distinguished by its extensive product and service offerings, broad distribution capabilities, exceptional financial strength, underwriting excellence, superior claims handling expertise and local operations globally.
At Chubb, we are committed to equal employment opportunity and compliance with all laws and regulations pertaining to it. Our policy is to provide employment, training, compensation, promotion, and other conditions or opportunities of employment, without regard to race, color, religious creed, sex, gender, gender identity, gender expression, sexual orientation, marital status, national origin, ancestry, mental and physical disability, medical condition, genetic information, military and veteran status, age, and pregnancy or any other characteristic protected by law. Performance and qualifications are the only basis upon which we hire, assign, promote, compensate, develop and retain employees. Chubb prohibits all unlawful discrimination, harassment and retaliation against any individual who reports discrimination or harassment.
