Company:
Trident Consulting
Location: Pennington
Closing Date: 08/11/2024
Hours: Full Time
Type: Permanent
Job Requirements / Description
Trident Consulting is seeking a " Big Data Principal " for one of our clients in " Pennington, NJ " A global leader in business and technology services
Role : Big Data Principal
Location : Pennington, NJ
Job type : Contract
Job Description
Hands on development experience and understanding in designing and developing data processing patterns to simplify the complexity of real-world data engineering architecture. Patterns which are cost- efficient and scalable provide performance and reliability of a modern Lakehouse, with low latency of streaming.
Understand the design and develop the standard framework modules, high performance services and client libraries for big data using one o rmore tools from AWS, Azure, Kubernetes, Spark, DBT, Databricks and snowflake, AWS S3, Azure Blob Store.
Hands on experience in operationalizing tens of hundreds of data pipelines, deploy, test & upgrade pipelines and best practices to
Eliminate operational burdens for managing and building high quality data pipelines.
Experience in query optimizer and execution engine that's fast, tuning free, scalability, ACID transactions and time travel patterns using spark jobs, DBT on Databricks and snowflake.
Quickly evaluate various technologies and complete POC driving architecture design for the applications.
Working complex environment with multi location teams.
Working team of agile developers.
About Trident: Trident Consulting is an award-winning IT/engineering staffing company founded in 2005 and headquartered in San Ramon, CA. We specialize in placing high-quality vetted technology
Some of our recent awards include:
2022, 2021, 2020 Inc. 5000 fastest-growing private companies in America 2022, 2021 SF Business Times 100 fastest-growing private companies in Bay Area.
Role : Big Data Principal
Location : Pennington, NJ
Job type : Contract
Job Description
Hands on development experience and understanding in designing and developing data processing patterns to simplify the complexity of real-world data engineering architecture. Patterns which are cost- efficient and scalable provide performance and reliability of a modern Lakehouse, with low latency of streaming.
Understand the design and develop the standard framework modules, high performance services and client libraries for big data using one o rmore tools from AWS, Azure, Kubernetes, Spark, DBT, Databricks and snowflake, AWS S3, Azure Blob Store.
Hands on experience in operationalizing tens of hundreds of data pipelines, deploy, test & upgrade pipelines and best practices to
Eliminate operational burdens for managing and building high quality data pipelines.
Experience in query optimizer and execution engine that's fast, tuning free, scalability, ACID transactions and time travel patterns using spark jobs, DBT on Databricks and snowflake.
Quickly evaluate various technologies and complete POC driving architecture design for the applications.
Working complex environment with multi location teams.
Working team of agile developers.
About Trident: Trident Consulting is an award-winning IT/engineering staffing company founded in 2005 and headquartered in San Ramon, CA. We specialize in placing high-quality vetted technology
Some of our recent awards include:
2022, 2021, 2020 Inc. 5000 fastest-growing private companies in America 2022, 2021 SF Business Times 100 fastest-growing private companies in Bay Area.
Share this job
Trident Consulting