Principal Data Engineer

Principal Data Engineer

#HOME6514

Job Description

Data Axle provides data, applications, and services that help organizations make and save money. Our commitment to accuracy, service and innovation drive customer acquisition, retention, and product enhancement. We are currently seeking a Principal Data Engineer.

We are seeking a highly experienced Principal Data Engineer to lead the design, implementation, and optimization of our modern data architecture. In this role, you will be responsible for developing and maintaining data pipelines using Databricks and Redshift, ensuring high-performance and cost-efficient workflows. The ideal candidate has a strong background in data engineering, expertise in Python and SQL programming, and a passion for creating scalable solutions to support business needs. You will collaborate with internal teams to ensure data models are robust and aligned with best practices in data engineering, including version control and documentation standards.

Essential Job Functions:

1. Collaborate with internal teams to design and implement a modern data architecture using Databricks and Redshift.
2. Develop, maintain, and troubleshoot data pipelines and workflows within Databricks, ensuring reliability and performance.
3. Create and maintain robust data models to support the ingestion and transformation of diverse data sources.
4. Monitor data workflows, optimizing them for performance, scalability, and cross-efficiency.
5. Establish and enforce best practices for data engineering, including version control, code reviews, and comprehensive documentation.
6. Ensure the data infrastructure is resilient and can scale as data volume grows.
7. Lead initiatives to automate manual data processes and improve overall system efficiency.

Supportive Job Functions:

1. Travel as required.
2. Stay updated with the latest developments in data engineering, cloud technologies, and tools.
3. Participate in client-facing meetings as necessary.
4. Perform other miscellaneous duties as assigned by management.

Qualifications

Knowledge, Skills, and Abilities:

1. Have a strong "team presence" to build credibility and trust.
2. Excellent problem-solving skills and attention to detail.
3. Energetic and self-starter -- The ability to be self-motivated and self-directed while staying on course with overall company objectives.
4. Collaborator and team player -- Ability to work with associates at all levels and functions of both Data Axle and client-side organizations.
5. Creative thinker, excellent problem solver, and solution designer -- who can evaluate the cost, feasibility and return on investment for a proposed analytic solution.

Education, Experience, and Certification:

1. 7+ years experience in data engineering, with a focus on building and maintaining scalable data pipelines.
2. 5+ years experience in relational marketing database analysis (data query, report development, and audience segmentation).
3. Proficient in Python and SparkSQL/SQL programming.
4. Ability to work with large datasets and optimize performance for high-throughput environments.
5. Strong communication skills, with the ability to work collaboratively across teams.
6. Experience with Tableau is also a plus.

If you are a resident of the state of California, Colorado, New York, or Washington, please contact us or email us at to receive compensation and benefits information for this role. Please include the job title and/or job ID of the role you are interested in.

Affirmative Action/EEO Statement:

At Data Axle, we are committed to attracting, retaining, and engaging employees from all walks of life. Diversity is an important part of our values and business operations. We are dedicated to creating an inclusive environment that promotes professional development for everyone. As part of that commitment, Data Axle does not discriminate on the basis of age, color, national origin, citizenship status, physical or mental disability, race, religion, creed, gender, sex, sexual orientation, gender identity and/or expression, marital status, status with regard to public assistance, status as a disabled veteran and or Vietnam Era or any other characteristic protected by federal, state, or local law. All qualified applicants will receive consideration for employment. In addition, Data Axle will provide reasonable accommodation for otherwise qualified disabled individuals.

Position Type: Full Time