Senior Data Engineer

Company:  Verizon
Location: San Jose
Closing Date: 08/11/2024
Salary: £125 - £150 Per Annum
Hours: Full Time
Type: Permanent
Job Requirements / Description

When you join Verizon

Verizon is one of the world's leading providers of technology and communications services, transforming the way we connect around the world. We're a human network that reaches across the globe and works behind the scenes. We anticipate, lead, and believe that listening is where learning begins. In crisis and in celebration, we come together - lifting up our communities and striving to make an impact to move the world forward. If you're fueled by purpose, and powered by persistence, explore a career with us. Here, you'll discover the rigor it takes to make a difference and the fulfillment that comes with living the #NetworkLife.


What you'll be doing...

As a part of our Big Data Product team, the Data Solutions Engineer will be responsible for developing and validating Big data products and applications which run on the large Hadoop cluster and Cloud. The qualified engineer will be developing and testing ETL processes, migrating different applications to cloud, and developing Data validation tools used for performing quality assessments and measurements on different data sets that feed data & AI products.


  • Performing data migration and conversion activities on different applications and platforms.
  • Designing, developing and testing of data ingestion pipelines, performing end to end automation of ETL processes for various datasets that are being ingested into the big data platform.
  • Performing data profiling/analysis, discovery, analysis, suitability and coverage of data, and identifying the various data types, formats, and data quality issues which exist within a given data source.
  • Developing transformation logic, interfaces and reports as needed to meet project requirements.
  • Participating in discussions for technical architecture, data modeling and ETL standards, collaborating with Product Managers, Architects and Senior Developers to establish the physical application framework (e.g. libraries, modules, execution environments).
  • Improving and performance-tuning the optimization of data pipelines.
  • Developing unit and integrated automated test suites to validate end to end data pipeline flow, data transformation rules, and data integrity.
  • Developing tools to measure the data quality and visualize the anomaly pattern in source and processed data.
  • Integrating automated processes into continuous integration workflows.
  • Contributing to data quality assurance standards and procedures.

What we're looking for...

You're curious about new technologies and the game-changing possibilities it creates. You like to stay up-to-date with the latest trends and apply your technical expertise to solve business problems. You thrive in a fast-paced, innovative environment working as a phenomenal teammate to drive the best results and business outcomes.


You'll need to have:

  • Bachelor's degree or four or more years of work experience.
  • Four or more years of relevant work experience.
  • Programming experience in Scala, Java or Python.
  • Experience in data engineering, preferably in Google Cloud Platform with BigQuery.
  • Hands-on experience in designing, building, testing and deploying data pipelines in Teradata and Hadoop platform with experience in HDFS, Hive, Spark, Streaming, HBase, Kafka, Oozie etc.
  • Good organizational skills and strong written and verbal communication skills.

Even better if you have one or more of the following:

  • Bachelor's degree in Computer Science or equivalent education/training.
  • Five or more years of Software development and Testing experience.
  • Experience with development and automated testing in a CI/CD environment.
  • Hands-on experience in dashboard development using Looker/Tableau.
  • Knowledge of GIT/Jenkins and pipeline automation is a must.
  • Experience with developing and testing real-time data-processing and Analytics Application Systems.
  • Strong knowledge in SQL development on Database and/or BI/DW.
  • Strong knowledge in shell scripting and experience in Web Services - API development and testing.
  • A solid understanding of common software development practices and tools.
  • Strong analytical skills with a methodical approach to problem solving applied to the Big Data/AI domain.
  • Experience with incident management tools (Opsgenie, PagerDuty etc) is a plus.

If Verizon and this role sound like a fit for you, we encourage you to apply even if you don't meet every "even better" qualification listed above.


Where you'll be working

In this hybrid role, you'll have a defined work location that includes work from home and a minimum of eight assigned office days per month that will be set by your manager.


Scheduled Weekly Hours
40


Equal Employment Opportunity

We're proud to be an equal opportunity employer - and celebrate our employees' differences, including race, color, religion, sex, sexual orientation, gender identity, national origin, age, disability, and Veteran status. At Verizon, we know that diversity makes us stronger. We are committed to a collaborative, inclusive environment that encourages authenticity and fosters a sense of belonging. We strive for everyone to feel valued, connected, and empowered to reach their potential and contribute their best. Check out our diversity and inclusion page to learn more.


Our benefits are designed to help you move forward in your career, and in areas of your life outside of Verizon. From health and wellness benefits, short term incentives, 401(k) Savings Plan, stock incentive programs, paid time off, parental leave, adoption assistance and tuition assistance, plus other incentives, we've got you covered with our award-winning total rewards package. For part-timers, your coverage will vary as you may be eligible for some of these benefits depending on your individual circumstances.


If you are hired into a California, Colorado, Connecticut, Hawaii, Maryland, Nevada, New York, Rhode Island, Washington or Washington, D.C. work location, the compensation range for this position is between $116,000.00 and $216,000.00 annually based on a full-time schedule. The salary will vary depending on your location and confirmed job-related skills and experience. This is an incentive-based position with the potential to earn more. For part-time roles, your compensation will be adjusted to reflect your hours.

#J-18808-Ljbffr
Apply Now
An error has occurred. This application may no longer respond until reloaded. Reload 🗙