Remote
Full-Time
Software Development
About the Role
We are looking for a Senior Software Engineer with strong expertise in Apache Spark and distributed systems. The role involves working on Spark internals, contributing to the Apache Spark open-source community, and building scalable data processing solutions aligned with the platform requirements.
Key Responsibilities
- Contribute fixes and enhancements to the Apache Spark open-source project.
- Upgrade and maintain compatibility with newer Spark releases.
- Optimize Spark internals for performance, scalability, and reliability.
- Design and develop distributed data processing solutions.
- Debug complex Spark-related performance and stability issues.
- Collaborate with product and platform teams on architecture and technical initiatives.
Required Skills
- Strong experience with Apache Spark internals and distributed systems.
- Hands-on experience contributing to open-source projects.
- Strong Java and/or Scala programming skills.
- Expertise in query execution, distributed processing, and performance optimization.
- Strong debugging and problem-solving abilities.
- Ability to work independently and drive technical initiatives.
Good to Have
- Experience with Kubernetes and cloud-native environments.
- Knowledge of JVM tuning and system optimization.
- Contributions to Apache or other open-source communities.
- Experience with large-scale analytics or data platforms.
Originally posted on Himalayas
Similar opportunities
M
Full Stack Product Engineer
Morgan Pinnacle Group
United States of America
USD 180,000 - 320,000 per year
Remote
Full-Time
Software Development
HIMALA-CTENGINEER
1 hour, 49 minutes ago
S
Tech Lead - Software Development (.NET) (Remote, Full-Time) [HR230]
Smart Working
India
Remote
Full-Time
Software Development
HIMALA-LTIMEHR230
1 hour, 51 minutes ago
W
Mid-level Software Engineer | Professional Services Engineering
Wellhub
Brazil
Remote
Full-Time
Software Development
HIMALA-NGINEERING
1 hour, 52 minutes ago
A
Senior Software Engineer
Akamai Technologies
Spain
Remote
Full-Time
Software Development
HIMALA-1781889268
1 hour, 55 minutes ago