Engenheiro(a) de Dados Júnior (Python, SQL, Big Data)
IBM
**Introduction**
A career in IBM Consulting is rooted by long-term relationships and close collaboration with clients across the globe.
You'll work with visionaries across multiple industries to improve the hybrid cloud and AI journey for the most innovative and valuable companies in the world. Your ability to accelerate impact and make meaningful change for your clients is enabled by our strategic partner ecosystem and our robust technology platforms across the IBM portfolio; including Software and Red Hat.
Curiosity and a constant quest for knowledge serve as the foundation to success in IBM Consulting. In your role, you'll be encouraged to challenge the norm, investigate ideas outside of your role, and come up with creative solutions resulting in ground breaking impact for a wide network of clients. Our culture of evolution and empathy centers on long-term career growth and development opportunities in an environment that embraces your unique skills and experience.
**Your role and responsibilities**
We are looking for a highly motivated Data Engineer to join our team and work on the development of robust data solutions, from modeling to the implementation of pipelines and ETL processes in modern, high-scale environments.
Responsibilities
- Develop, optimize and maintain data pipelines and ETL processes using Python and SQL.
- Working in development environments such as JupyterLab or Visual Studio Code, with code versioning via Gitlab.
- Modeling and architecting relational databases (DB2, Oracle, MySQL) and participating in the definition of data storage and retrieval strategies.
- Designing and implementing Big Data solutions using Hadoop, HDFS, Hive, Spark and Hue (desirable).
- Apply good programming practices and unit testing techniques to ensure data integrity and quality.
- Document processes, data flows and solution architecture to facilitate maintenance and team understanding.
- Collaborate with multidisciplinary teams to understand business requirements and transform demands into scalable solutions.
- Ensuring compliance with the General Data Protection Act (GDPR) at all stages of the data lifecycle (basic knowledge desirable).
**Required technical and professional expertise**
'- Proven experience in Python and SQL for data manipulation and transformation.
- Experience with relational databases (DB2, Oracle; MySQL desirable).
- Knowledge of data architecture and modeling.
- Experience in ETL processes and strategies, preferably using Datastage or NiFi (desirable).
- Familiarity with Big Data tools and frameworks: Hadoop, HDFS, Hive, Spark, Hue (desirable).
- Experience with JupyterLab or Visual Studio Code development environments and version control with Gitlab.
- Basic knowledge of the GDPR is a plus.
- Ability to work in a team, good communication skills and a collaborative profile.
**Preferred technical and professional experience**
'- Certifications in Big Data, Data Engineering or cloud platforms.
- Experience with pipeline automation and continuous integration.
- Experience in agile environments and highly scalable projects.
IBM is committed to creating a diverse environment and is proud to be an equal-opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, gender, gender identity or expression, sexual orientation, national origin, caste, genetics, pregnancy, disability, neurodivergence, age, veteran status, or other characteristics. IBM is also committed to compliance with all fair employment practices regarding citizenship and immigration status.
Confirm your E-mail: Send Email
All Jobs from IBM