Company:
Open Systems Technologies
Location: Jupiter
Closing Date: 08/11/2024
Salary: £100 - £125 Per Annum
Hours: Full Time
Type: Permanent
Job Requirements / Description
A financial firm is looking for a Health Senior Data Engineer/Architect to join their team in Jupiter, FL.
Compensation: $200-250k
Responsibilities:
- Collaborate with Stakeholders, Project Managers, Software Engineers, Data Analysts, QA Analysts, DBAs, and Data Engineers
- Build and maintain data pipelines based on functional and non-functional requirements
- Ensure that data pipelines incorporate best practices related to performance, scaling, extensibility, fault tolerance, instrumentation, and maintainability
- Ensure that data pipelines are kept simple and not overly engineered
- Produce and maintain design and operational documentation
- Analyze complex data problems and engineer elegant solutions
- Upgrade existing data models and pipelines leveraging newer features and techniques
- Work in a Kanban environment
- Mentor less experienced data engineers
- Participate in engineering standards and best practices evolution
- Participate in an on-call rotation
- Lead investigations to troubleshoot pipeline issues
Qualifications:
Required:
10+ years with hands-on data engineering and deep knowledge of data architecture fundamentals including:
- Extensive experience building ETL/ELT pipelines from a variety of data sources
- Experience with database and associated technologies for moving and storage of data
- Experience evaluating and selecting tools and technologies based on fitness for purpose and stakeholder requirements
- Knowledge and experience with concepts such as performance tuning, execution plan analysis, and index optimization in at least one database technology (e.g., T-SQL, PL-SQL, NoSQL, etc.)
- Extensive experience creating and maintaining a wide variety of database objects including, tables, views, functions, stored procedures, etc.
- Experience with data modeling indexes, temporal tables, CLR, etc.
- Deep understanding of the development of data pipelines using multiple external data sources and transport mechanisms
- Strong initiative, collaboration, accountability, impartiality, and communication
- Strong analytical skills, a real passion for working with data and strong interest in solving data problems
- Strong track record for judging core requirements and meeting deadlines
- Experience managing master data
- Experience writing C#, PowerShell, and Python
- Experience with Git source control
- Experience working in a Kanban SDLC and a strong understanding of traditional Kanban SDLC workflows
- Experience with deploying changes through segregated Development, QA, UAT and Production SDLC stages
- Experience owning mission-critical processes
- A Bachelor's degree in Computer Science, Information Systems, or related disciplines
Preferred:
- Python programming using libraries such as Pandas, Numpy, csv, Traceback, JSON, PyODBC, Math
- Experience with source code branching and pull requests / code reviews
- Experience with AWS
- Experience working with clinical and/or consumer healthcare data
- Experience with tools such as Red Gate, Grafana, OpsGenie and JAMS
- MS/PhD in Computer Science, Information Systems, or related disciplines
Share this job
Open Systems Technologies