We help the world run better

At SAP, we enable you to bring out your best. Our company culture is focused on collaboration and a shared passion to help the world run better. How? We focus every day on building the foundation for tomorrow and creating a workplace that embraces differences, values flexibility, and is aligned to our purpose-driven and future-focused work. We offer a highly collaborative, caring team environment with a strong focus on learning and development, recognition for your individual contributions, and a variety of benefit options for you to choose from.

Meet Your Team-

SAP Datasphere is a comprehensive end-to-end data management and decision-making cloud solution built on SAP Business Technology Platform (SAP BTP) that enables every data professional to deliver seamless and scalable access to mission-critical business data. With a unified experience for data integration, data cataloguing, semantic modelling, data warehousing, data federation, and data virtualization, SAP Datasphere enables data professionals to easily distribute mission-critical business data — with business context and logic preserved — across the data landscape. 

  

What you’ll do-  

As an associate architect in the SAP datasphere team, you will  

Develop and execute high-level architectural designs with respect the Apache Spark components in Datasphere ensuring that solutions are scalable, secure, and optimized for performance, meeting both technical and business requirements as well as product standards.   Provide technical leadership and guidance to development teams, ensuring adherence to architectural best practices and product standards.   Author clear technical documentation and presentations in collaboration with product engineers and architects to communicate architecture and design options to educate engineering teams and product managers.   

  

What you bring  

8-10 years of overall software development experience 

At least 4 years of development experience in Apache Spark framework 

In-depth knowledge of Spark Core, Spark SQL and Spark streaming  

Experience in working with Data Frames, Datasets and RDDs  

Experience in designing and implementing scalable and performance Spark-based systems 

Ability to implement real-time data processing and batch processing workflows  

Good understanding of Spark architecture including driver and executor interaction  

Proficiency in writing clean and efficient code in one or more Spark programming languages such as Python/Scala/Java   

Proficiency in Spark job optimization including partitioning, caching and resource allocation  

Familiarity with tuning techniques like adjusting executor memory, shuffle partitions, and broadcast joins.  

Experience building and managing ETL pipelines using Spark.  

Ability to connect and work with relational databases using JDBC/ODBC  

Experience deploying Spark jobs on cloud platforms such as AWS, Azure, Google Cloud  

Proficiency in using monitoring and debugging tools such as Spark UI, Grafana or Promethus  

Writing and optimizing complex SQL queries and understanding query execution plans and leveraging Spark SQL for distributed query processing.  

#SAPInternalT3

 

​Bring out your best

SAP innovations help more than four hundred thousand customers worldwide work together more efficiently and use business insight more effectively. Originally known for leadership in enterprise resource planning (ERP) software, SAP has evolved to become a market leader in end-to-end business application software and related services for database, analytics, intelligent technologies, and experience management. As a cloud company with two hundred million users and more than one hundred thousand employees worldwide, we are purpose-driven and future-focused, with a highly collaborative team ethic and commitment to personal development. Whether connecting global industries, people, or platforms, we help ensure every challenge gets the solution it deserves. At SAP, you can bring out your best.

We win with inclusion

SAP’s culture of inclusion, focus on health and well-being, and flexible working models help ensure that everyone – regardless of background – feels included and can run at their best. At SAP, we believe we are made stronger by the unique capabilities and qualities that each person brings to our company, and we invest in our employees to inspire confidence and help everyone realize their full potential. We ultimately believe in unleashing all talent and creating a better and more equitable world.
SAP is proud to be an equal opportunity workplace and is an affirmative action employer. We are committed to the values of Equal Employment Opportunity and provide accessibility accommodations to applicants with physical and/or mental disabilities. If you are interested in applying for employment with SAP and are in need of accommodation or special assistance to navigate our website or to complete your application, please send an e-mail with your request to Recruiting Operations Team: Careers@sap.com
For SAP employees: Only permanent roles are eligible for the SAP Employee Referral Program, according to the eligibility rules set in the SAP Referral Policy. Specific conditions may apply for roles in Vocational Training.

EOE AA M/F/Vet/Disability:

Qualified applicants will receive consideration for employment without regard to their age, race, religion, national origin, ethnicity, age, gender (including pregnancy, childbirth, et al), sexual orientation, gender identity or expression, protected veteran status, or disability.
Successful candidates might be required to undergo a background verification with an external vendor.

Requisition ID: 403761  | Work Area: Software-Design and Development  | Expected Travel: 0 - 10%  | Career Status: Professional  | Employment Type: Regular Full Time   | Additional Locations: #LI-Hybrid.