Principal Data Engineer

Dice is the leading career destination for tech experts at every stage of their careers. Our client, Spiceorb , is seeking the following. Apply via Dice today!

Principal Data Engineer to work for CONTRACT on ONSITE basis in Bellevue, WA

If you are interested and a good fit for the position, then please email me an updated copy of your resume with the best time and number to contact you.

Preferred PST Zone Candidate

Must Have Skills

1. Skill 1: 8 Yrs. of Exp Azure Cloud
2. Skill 2: 8 Yrs. of Exp, Database Design
3. Skill 3: 4 Yrs. of Exp, Azure Data Lake, Databricks

Job Description

We operate in an Azure + Databricks Lakehouse. We'll need a person with:

1. Azure experience - ADF for orchestration, ADLS for storage, Azure DevOps for CI/CD
2. Databricks experience - all compute/ETL leverages Databricks and is programmed leveraging Spark (PySpark, SparkSQL)
3. PowerShell experience - this is our scripting language of choice
4. SQL proficiency - it's used everywhere (TSQL, PostgreSQL)
5. Proficiency with parquet and delta formats

Additionally, they will need experience in:

1. SDLC + CI/CD - we follow a standard deployment process (dev, test, prod) that includes peer-reviewed code. They need to be comfortable with standard DevOps practices.
2. Deep understanding of indexes and partitioning.
3. Proficient in optimizing code for performance (able to read a DAG, determine where CBO is using most resources).
4. Proficient in writing code in a manner that it can run repeatedly and produce the same state (we have a custom SQL Deployment framework).