Senior Data Platform Engineer

Description

Innovate, Impact, Inspire – Your Future Begins Here!

ABOUT US: At Nexus Cognitive, we are at the forefront of technological innovation, driving transformative solutions in the world of data and analytics. Our mission is to enable your business to harness the power of big data, transforming complex data sets into actionable insights that disrupt industries and deliver a competitive advantage for our clients. We are a trusted advisor that handles the heavy lifting of big data management and governance, so our clients can focus on making informed, strategic decisions that drive growth and innovation. Nexus Cognitive firmly grasps the transformative power of data and artificial intelligence. We have a spirited team of employees across the U.S. dedicated to redefining the boundaries of technology and cognitive solutions.

THE OPPORTUNITY: As we continue our journey, we are building a team of sharp, intelligent innovators who can move fast with great agility and passion. We are currently searching for a Senior Data Platform Engineer to join our high-performing product and fulfillment center of excellence. You will contribute to implementing new product features and rapidly onboarding new enterprise customers. The ideal candidate will be a proactive problem solver with strong technical skills and meticulous attention to detail. This person will be intellectually curious with a relentless desire to learn the latest modern data architecture platforms and patterns.

WHAT YOU’LL DO:

• Manage daily operations of Nexusone products on on-premises and cloud-based technologies using open-source Linux-based data technologies.
• Install, configure, and support CDP clusters in both cloud (AWS, Azure, GCP) and on-premises environments, ensuring seamless integration and functionality.
• Lead and mentor less experienced members of platform engineering and support teams.
• Maintain, patch, and upgrade existing CDP setups, ensuring minimal downtime and adherence to Cloudera’s best practices.
• Evaluate and optimize complex distributed production deployments, identifying bottlenecks and recommending performance enhancements.
• Configure and manage security using tools like Ranger and Kerberos, ensuring robust data protection and compliance.
• Develop and maintain technical documentation, including administration runbooks and knowledge base articles, to support operational excellence and knowledge sharing.
• Work in an agile team and participate in an on-call rotation, providing expert-level support and troubleshooting for critical issues.
• Lead and mentor junior team members, fostering a culture of continuous learning and improvement.
• Collaborate with cross-functional teams, including data engineers, solution architects, and DevOps, to design and implement scalable data solutions.
• Stay current with emerging technologies and industry trends, applying this knowledge to improve the CDP environment and drive innovation.

WHO YOU ARE:

• In-depth understanding of both on-premises and cloud network architectures, ensuring seamless integration and efficient data flow.
• Minimum of 5 years of experience in installing and administering the Cloudera Data Platform (Public or Private Cloud), with a proven track record of managing large-scale deployments.
• Hands-on experience with open-source Linux-based data technologies, including Iceberg, Spark, Nifi, Jupyter Notebooks, Cloudera, Databricks, Kubeflow, MLFlow, and Kafka.
• Proven ability to build and support solutions across major cloud platforms (AWS, Azure, GCP), leveraging cloud-native tools and open source for optimal performance.
• Strong Cloudera expertise, with a deep understanding of Spark and Airflow for orchestrating complex data workflows.
• Experience integrating Azure Active Directory with FreeIPA and other directory services such as LDAP, enhancing security and user management.
• Up-to-date knowledge of the Hadoop Big Data ecosystem, staying current with the latest technologies and best practices.
• Excellent troubleshooting skills, with a thorough understanding of CDP capacity planning, identifying bottlenecks, and optimizing memory utilization, CPU usage, OS performance, storage, and network configurations.
• Strong analytical and problem-solving abilities, capable of diagnosing and resolving complex technical issues efficiently.

WHY NEXUS COGNITIVE: At Nexus Cognitive, you’ll be stepping into a youthful and vibrant work culture. Our work environment thrives on teamwork, creativity, and the shared ambition to redefine what’s possible. Our team is our greatest asset, and we are deeply committed to fostering a collaborative, supportive, and dynamic atmosphere where every voice is valued, and every team member can flourish. We understand that our success hinges not just on the quality of our work but also on the well-being of our team members. We’ve crafted a comprehensive benefits package designed to support you not just at work but in all facets of life. Here’s a snapshot of just some of the typical benefits you can expect when joining our dynamic team:

• Competitive salary
• Company matched 401(k) contributions
• Unlimited PTO
• Comprehensive Medical, Dental, and Vision Insurance
• Life and Disability Insurance
• STD/LTD Insurance
• Mental Health Support
• Fitness Discount Programs

If you're ready to take your career to the next level and have a substantial impact in a company that's shaping the future of technology, Nexus Cognitive is your ultimate destination. Let’s explore new horizons together—apply today!