Data Engineer

The Data Engineer is responsible for all aspects of the Company technology data lake and analytics platform built using the AWS ecosystem. The Data Engineer collaboratively works with technology, business analyst, and product team members to design and implement innovative analytic data and AI solutions. We are seeking a unique individual that excels working in a fast-paced environment, where creativity and risk-taking are encouraged and production stability and quality is expected. This is a great opportunity to be a key contributor to our next-generation data analytics and AI development initiatives.

Requirements

Essential Duties and Responsibilities:

1. Define and implement a Data Lake reference architecture on AWS.
2. Define the data pipeline and ingestion workflow, incorporating AI modeling from different data sources and types, including voice recordings.
3. Design and build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and AWS big data technologies.
4. Build analytics tools that provide actionable insights into customer acquisition, operational efficiency, and key business performance metrics, leveraging AI modeling techniques for enhanced analysis.
5. Assemble large, complex data sets that meet functional / non-functional business requirements, integrating AI modeling considerations for improved data understanding and interpretation.
6. Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
7. Work with stakeholders including Executive, Product, Data and Design teams to assist with data-related technical issues and support their data infrastructure needs, including AI modeling requirements for data analysis.
8. Create data tools for analytics and business analyst team members that assist them in building and optimizing our product into an innovative industry leader, integrating AI modeling features.
9. Provide stewardship to maintain data quality, uphold regulatory guidelines, and keep data secure.
10. Manage the data dictionary, ensuring alignment with AI modeling terminology and standards.

Skills and Abilities:

1. Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases.
2. Experience building and optimizing big data data pipelines, architectures, and data sets, with expertise in integrating AI modeling components.
3. Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement, utilizing AI modeling techniques for comprehensive analysis.
4. Strong analytic skills related to working with structured and unstructured datasets, augmented by AI modeling capabilities for enhanced data interpretation.
5. Build processes supporting data transformation, data structures, metadata, dependency, and workload management integrating AI modeling tools for real-time analysis.
6. A successful history of manipulating, processing, and extracting value from large, disconnected datasets, with proficiency in AI modeling techniques for data extraction and pattern recognition.
7. Working knowledge of message queuing, stream processing, and highly scalable data stores, complemented by AI modeling tools for real-time data analysis.
8. We are looking for a candidate with 5 years of experience in a Data Engineer role, who has attained a degree in Computer Science, Statistics, Information Systems, or another quantitative field.
9. Experience with data pipeline and workflow management tools, with a focus on integrating AI modeling functionalities.
10. Experience with AWS cloud services: EC2, Lake Formation, Athena, Glue, Redshift Spectrum, S3 Storage, IAM, and KMS.
11. Excellent verbal and written communication skills, presentation skills and relationship building skills, with the ability to convey complex AI modeling concepts to diverse audiences.
12. Spanish speaking is a plus.

Benefits

1. Competitive Salary.
2. 401k with Match.
3. Health insurance.
4. Dental & Vision Insurance.
5. Life insurance.
6. Paid time off.
7. Office Snacks.
8. Monthly events.

OPF is an Equal Opportunity Employer (EOE) and takes great pride in building a diverse work environment. Qualified applicants are considered for employment without regard to age, race, religion, gender, national origin, sexual orientation, disability, or veteran status.