摘要
We are looking for a skilled and enthusiastic Data Engineer with expertise in any of the ETL tools, Databricks, Snowflake SQL, and PySpark to join our innovative team.
As a Data Engineer, you will be responsible for designing, implementing, and optimizing scalable data pipelines, ensuring data quality, and building robust data infrastructure.
You will collaborate closely with data scientists, domain experts, and other stakeholders to ensure the efficient and reliable flow of data across the organization.
About the Role
Key Responsibilities:
- ETL Development: Design, implement, and maintain scalable ETL pipelines to extract, transform, and load data from various sources into data warehouses or data lakes.
- Databricks Utilization: Leverage Databricks to develop, optimize, and scale data engineering workflows.
- Data Modelling: Design and implement robust data models to support analytics and reporting needs.
- SQL Proficiency: Write, optimize, and maintain complex SQL queries for data extraction and transformation tasks.
- PySpark Development: Utilize PySpark for big data processing tasks, developing scalable and efficient solutions.
- Data Quality and Validation: Implement data quality checks and validation processes to ensure data accuracy and consistency.
- Data Integration: Integrate data from multiple sources, ensuring data consistency and reliability.
- Collaboration: Work closely with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions that meet business needs.
- Documentation: Create and maintain comprehensive documentation for data pipelines, data models, and related processes.
- Performance Optimization: Optimize data processing performance by fine-tuning ETL pipelines and data storage solutions.
- Security and Compliance: Ensure compliance with data governance policies and security protocols to protect sensitive and confidential information.
- Continuous Improvement: Stay current with industry trends and emerging technologies, continuously improving data engineering practices.
Education (minimum/desirable):
Bachelor's or master’s degree in computer science, Engineering, Information Systems, or a related field.
Experience / Skills:
- 8+ years’ experience in a Global company as a data steward, engineer, modeler or data scientist, with a strong focus on ETL tools, SQL, and PySpark.
- Business understanding of pharmaceutical industry and data standards. Domain experience in at least one of the following areas – a) Pharma R&D, b) Manufacturing, Procurement and Supply Chain and c) Marketing and Sales. Experience in working in Pharma / Life Science industry strongly preferred
- Strong proficiency in SQL and experience with database management systems (e.g., PostgreSQL, MySQL, Oracle).
- Hands-on experience with Databricks for developing and optimizing data workloads.
- Proficiency in PySpark for big data processing tasks.
- Knowledge of data warehousing solutions (e.g. Snowflake).
- Experience of working with large codebase / repos using Git / Bitbucket
- Strong problem-solving skills and attention to detail.
- Excellent communication and collaboration skills with senior stakeholders
Preferred Qualifications:
- Experience with cloud platforms (e.g., AWS, Google Cloud, Azure) and their data services (Databricks).
- Familiarity with containerization and orchestration tools (e.g., Docker, Kubernetes).
- Knowledge of real-time data processing and streaming technologies.
- Proficiency in data visualization tools (e.g., Tableau, Power BI).
- Experience with DevOps practices and tools for CI/CD pipelines.
Why consider Novartis?
799 million. That’s how many lives our products touched in 2019. And while we’re proud of that fact, in this world of digital and technological transformation, we must also ask ourselves this: how can we continue to improve and extend even more people’s lives?
We believe the answers are found when curious, courageous and collaborative people like you are brought together in an inspiring environment. Where you’re given opportunities to explore the power of digital and data. Where you’re empowered to risk failure by taking smart risks, and where you’re surrounded by people who share your determination to tackle the world’s toughest medical challenges.
Imagine what you could do at Novartis!
Commitment to Diversity & Inclusion:
Novartis embraces diversity, equal opportunity and inclusion. We are committed to building diverse teams, representative of the patients and communities we serve, and we strive to create an inclusive workplace that cultivates bold innovation through collaboration and empowers our people to unleash their full potential.
Join our Novartis Network: If this role is not suitable to your experience or career goals but you wish to stay connected to learn more about Novartis and our career opportunities, join the Novartis Network here: https://talentnetwork.novartis.com/network
Why Novartis: Helping people with disease and their families takes more than innovative science. It takes a community of smart, passionate people like you. Collaborating, supporting and inspiring each other. Combining to achieve breakthroughs that change patients’ lives. Ready to create a brighter future together? https://www.novartis.com/about/strategy/people-and-culture
Join our Novartis Network: Not the right Novartis role for you? Sign up to our talent community to stay connected and learn about suitable career opportunities as soon as they come up: https://talentnetwork.novartis.com/network
Benefits and Rewards: Read our handbook to learn about all the ways we’ll help you thrive personally and professionally: https://www.novartis.com/careers/benefits-rewards
Accessibility and accommodation
Novartis is committed to working with and providing reasonable accommodation to individuals with disabilities. If, because of a medical condition or disability, you need a reasonable accommodation for any part of the recruitment process, or in order to perform the essential functions of a position, please send an e-mail to [email protected] and let us know the nature of your request and your contact information. Please include the job requisition number in your message.
Novartis is committed to building an outstanding, inclusive work environment and diverse teams' representative of the patients and communities we serve.
