Senior Big Data Engineer - Scala

Company:  EPAM Systems
Location: San Francisco
Closing Date: 03/11/2024
Salary: £150 - £200 Per Annum
Hours: Full Time
Type: Permanent
Job Requirements / Description

Description

We are hiring a Senior Big Data Engineer who will support a critical digital transformation project for one of EPAM’s top clients. This is a high-impact role, with the opportunity to advance your skills and grow within a global organization. If you'd like to learn more about this position and project, apply now! Connect with a recruiter today!

Req.#533825107

Responsibilities

  1. Evaluate different technologies and suggest which technology suits the client's needs
  2. Complete POC and evolve it into production-ready solutions
  3. Select and integrate any Big Data tools and frameworks required to provide requested capabilities
  4. Implement ETL process
  5. Monitor performance and advise any necessary infrastructure changes
  6. Define data retention policies
  7. Elaborate on the technical design of new features

Requirements

  1. At least 2 years of experience with Scala
  2. At least 2 years of experience with Java or Python
  3. Proficient understanding of distributed computing principles
  4. Proficiency with HDFS
  5. Good knowledge of Big Data querying tools, such as Hive and Impala
  6. Proven history of building stream-processing systems, using solutions such as Spark-Streaming
  7. Experience with Spark RDD/DataFrame API using Java/Scala
  8. Experience with integration of data from multiple data sources
  9. Knowledge of various ETL techniques and frameworks
  10. Comfortable with various messaging systems, such as Kafka
  11. Experience with Cloudera platform

Nice to have

  1. Experience with Apache Kafka
  2. Experience with Apache Oozie

Benefits

  1. Medical, Dental and Vision Insurance (Subsidized)
  2. Health Savings Account
  3. Flexible Spending Accounts (Healthcare, Dependent Care, Commuter)
  4. Short-Term and Long-Term Disability (Company Provided)
  5. Life and AD&D Insurance (Company Provided)
  6. Employee Assistance Program
  7. Unlimited access to LinkedIn learning solutions
  8. Matched 401(k) Retirement Savings Plan
  9. Paid Time Off
  10. Legal Plan and Identity Theft Protection
  11. Accident Insurance
  12. Employee Discounts
  13. Pet Insurance
  14. Employee Stock Purchase Program

About EPAM

EPAM is a leading global provider of digital platform engineering and development services. We are committed to having a positive impact on our customers, our employees, and our communities. We embrace a dynamic and inclusive culture. Here you will collaborate with multi-national teams, contribute to a myriad of innovative projects that deliver the most creative and cutting-edge solutions, and have an opportunity to continuously learn and grow. No matter where you are located, you will join a dedicated, creative, and diverse community that will help you discover your fullest potential.

Additional

This posting includes a good faith range of the salary EPAM would reasonably expect to pay the selected candidate. The range provided reflects base salary only. Individual compensation offers within the range are based on a variety of factors, including, but not limited to: geographic location, experience, credentials, education, training; the demand for the role; and overall business and labor market considerations. Most candidates are hired at a salary within the range disclosed. Salary range: $90k – $150k. In addition, the details highlighted in this job posting above are a general description of all other expected benefits and compensation for the position.

EPAM welcomes all applicants and will consider qualified candidates with criminal history such as arrest and conviction records in a manner consistent applicable law, including the San Francisco Fair Chance Ordinance and Los Angeles Fair Chance Initiative for Hiring.

Apply

#J-18808-Ljbffr
Apply Now
An error has occurred. This application may no longer respond until reloaded. Reload 🗙