Senior Data Engineer

Description and Requirements
"At BMC trust is not just a word - it's a way of life"
Description And Requirements
CareerArc Code

CA-MH

Hybrid
"At BMC trust is not just a word - it's a way of life"
We are an award-winning, equal opportunity, culturally diverse, fun place to be. Giving back to the community drives us to be better every single day. Our work environment allows you to balance your priorities, because we know you will bring your best every day. We will champion your wins and shout them from the rooftops. Your peers will inspire, drive, support you, and make you laugh out loud

We help our customers free up time and space to become an Autonomous Digital Enterprise that conquers the opportunities ahead - and are relentless in the pursuit of innovation

The Control-M product line is BMC's orchestration and automation platform. It helps the world's largest companies to automate time-sensitive, business-critical workflows. We orchestrate data and machine learning pipelines, supply chains, production lines, financial transactions, and other processes in complex IT environments worldwide. We continuously grow by adding and implementing the most cutting-edge technologies, conducting innovative Just Do It marathons, thinking about new features to add and investing in our employee training programs

We are seeking a skilled
Senior Data Engineer (Python & Java)
to join our team to help develop and maintain a high scale, fully serverless cloud data platform.

Our product ingests and processes large volumes of data into Amazon S3 using a modern architecture based on AWS serverless services and enables powerful querying and analytics through Amazon Athena.

In this role, you'll work on a system that combines streaming ingestion (Firehose), data lake technologies (Parquet, Apache Iceberg), scalable storage (S3), event-driven processing (Lambda, EventBridge), fast access databases (DynamoDB), and robust APIs (Spring Boot microservices on EC2).

Your role will involve designing, implementing, and improving the data processing pipeline and platform services.

Key Responsibilities

• Design, build, and maintain serverless data processing pipelines using AWS Lambda, Firehose, S3, and Athena.
• Optimize data storage and querying performance using Parquet and Iceberg formats.
• Manage and scale event-driven workflows using EventBridge and Lambda.
• Work with DynamoDB for fast, scalable key-value storage.
• Develop and maintain Java Spring Boot microservices deployed on EC2 pods.
• Ensure observability, monitoring, and fault-tolerance across the system.
• Collaborate with DevOps, Data Engineering, and Product teams to design scalable, cost-effective cloud solutions.
• Maintain security best practices in a cloud-native environment.

Requirements

• 5+ years of experience in Java/Python backend development, preferably developing enterprise products
• Experience in a Data Engineer role / similar role in the data field
• Experience in designing and implementing Data Lake architectures, including Storage formats such as Parquet and Iceberg.
• Strong hands-on experience with AWS services: Lambda, S3, K8S.
• Experience with microservices architecture
• Experience with high-scale, event-driven systems and serverless patterns.
• Fast learner with passion for the data field
• Team Player with great interpersonal skills

Nice To Have

• Hands-on experience with Apache Spark for large-scale data processing and analytics
• Solid understanding of distributed systems, performance tuning, and cost-optimization in cloud environments with Kafka for data streaming
• Familiarity with CI/CD and infrastructure-as-code tools (e.g., Terraform, CloudFormation)
• Experience with observability tools (e.g., CloudWatch, OpenTelemetry)
• Proficiency in SpringBoot
• Experience working in a global enterprise software company

Our commitment to you
BMC's culture is built around its people. We have 6000+ brilliant minds working together across the globe. You won't be known just by your employee number, but for your true authentic self. BMC lets you be YOU

If after reading the above, You're unsure if you meet the qualifications of this role but are deeply excited about BMC and this team, we still encourage you to apply We want to attract talents from diverse backgrounds and experience to ensure we face the world together with the best ideas

BMC is committed to equal opportunity employment regardless of race, age, sex, creed, color, religion, citizenship status, sexual orientation, gender, gender expression, gender identity, national origin, disability, marital status, pregnancy, disabled veteran or status as a protected veteran. If you need a reasonable accommodation for any part of the application and hiring process, visit the accommodation request page.

BMC Software maintains a strict policy of not requesting any form of payment in exchange for employment opportunities, upholding a fair and ethical hiring process.