Senior/Staff Software Engineer - Data Platform
Are you prepared to join the X team and help build the ultimate real-time information-sharing app, revolutionizing how people connect? At X, we're on a mission to become a trusted global digital public square, committed to minimal censorship within legal boundaries. Our goal is to empower every user to freely create and share ideas, fostering open public discourse without barriers. Join us in shaping this thrilling journey where your contribution will be invaluable to our success!
Location: San Francisco or Seattle
Salary Range: $154,000 to $297,000
Who we are:
X serves our community of users and customers by working tirelessly to preserve free expression and choice, create limitless interactivity, and create a marketplace that enables the economic success of all its participants.
We value:
- Highly motivated individuals, focused on engineering excellence.
- Prioritizing impactful coding over extensive documentation.
- Focusing on delivering products and platforms, not just discussing roadmaps.
If this sounds like you, let’s talk.
What you will do:
The Data Platform team is responsible for developing and managing a distributed data processing platform. Our focus areas include Apache Kafka, Spark, Flink, and Trino, along with other supporting technologies. Our team tackles complex, impactful challenges at Petabyte scale. We develop vital platform components enabling ML and product teams to efficiently transport, process, and manage data at petabyte-scale.
As Senior/Staff engineer in our team, you will:
- Design and develop core functionalities in data ingestion and processing.
- Enhance and optimize Kafka and other transport layer technologies for real-time processing.
- Work closely with other engineers to ensure that our data platform is available, secure, and reliable.
- Uphold service quality throughout the software development lifecycle.
- Drive continuous improvement in our software solutions.
Qualifications:
We're looking for exceptional engineers who are passionate about our mission and have a strong desire to make a meaningful impact. The ideal candidate will have:
- Minimum 3+ years of backend development experience (5+ for Staff).
- Proficiency in languages like Java, Scala, Python, Rust.
- Experience in optimizing distributed data processing systems (Spark, Flink, Kafka, Hadoop, Storm) is highly desirable.
- Knowledge of ETL processes and data warehousing.
- Demonstrated experience building data pipelines.
- Independent learning capabilities for new technologies.
- Extremely committed, willing to work in a fast-paced environment.
- Excellent communication and interpersonal skills.
At X, our small but fast-paced team values innovation, creativity, and a strong commitment to our mission. As a Senior/Staff Data Platform Engineer, you'll have the opportunity to make a significant impact on the future of X and our aspiration to build the Everything App.
If you're an exceptional engineer who shares our passion for freedom of speech, we'd love to hear from you.
If you thrive in a dynamic, high-growth tech environment and relish the opportunity to collaborate with passionate, driven over-achievers, your career with us here at X will be both exhilarating and fulfilling!
#J-18808-Ljbffr