Senior Java Engineer w/ Big Data
Location: Jersey City, NJ (3 days onsite - Hybrid)
Duration: 12 months
*please ensure your candidates can interview in-person*
Job Description:
Additional Note- Team, in terms of spark and impala experience - manager confirmed that If the candidate has good experience in spark and does not have experience in Impala that’s ok . They will train on the job but atleast candidates should have hands on Spark .
Note on 10/21- Team, really need more resumes here that are solid because we need to close this up. This is feedback from most recent in-person interview that happened today. There are no candidates in process besides the ones I shortlisted today (pending manager review). Please screen candidates for all the skills necessary and ensure they can go into JC for in-person.
FEEDBACK FROM IN-PERSON INTERVIEW -
Core-Java: Failed to answer simple visibility modifiers during inheritance related to member-fields/methods. Could not answer simple exception-handling, resource-leaks, spring framework questions.
Kafka: Did not answer basic Kafka questions like what’s the reason it is preferred over traditional messaging solutions (MQ, Tibco-EMS) for big-data
Big-Data: Did not show understanding of commonly used big-data formats (that any entry-level big-data developer is also expected to know)
Note on 10/18- have another final interview on Monday, but need more strong resumes. This is general feedback, really need stronger candidates...
Just to reiterate both Java and big data are required but decent in Big Data and strong in java will cut it . Decent does not mean theoretical knowledge . Person should have some experience of writing spark code , creating impala tables , configuring hive metastore etc.
Note on 10/2- team - giving 24 hours as we really need STRONG java/big data candidates here as we had another fall off...please ensure your candidates are thoroughly screened and have the experience needed also that they can do in-person interviews in JC. Please make this a priority.
Re-intake Call Notes- Looking for a Hands-on person and need to be very strong on Java. Need Spark for sure, but Impala can be nice to have. Need the basics to be very clear on Java and Big Data along with being honest during the interview about the experience as team is for sure looking forward to. Need tech-screening to be included within the resume.
Intake call notes:
- Lead engineer in Jersey City office
- Very strong in Java and performance tuning (7+ years of java development)
- Very good big data experience - especially spark and impala
- Linux system experience
- Financial industry experience is a plus
Job Description:
Role Summary:
- A senior java engineer with very strong java understanding along with subject matter expertise in big data.
- The role demands for Java, any flavor of Spark, Hadoop, Linux, Bash, NoSQL, MPP Databases and Columnar file formats, CI/CD, DevOps understanding, and Containerization hands on.
Responsibilities:
- Implement application features/function using Java , Spring, Big Data technologies.
- Tune and optimize JAVA processes using various techniques such as JVM tuning like heap dumps , thread dumps and JDK dynamic monitoring.
- Tune various Big Data processes for egress/ingress optimization, monitoring, scaling.
- Participate in daily scrums and application roadmap meetings. Present ideas to improve application framework and own the execution.
- Ensure the application development standards are maintained and enhanced related to readability, testability and continuous integration.
Required Skills & Experience:
- Minimum of 10 years of hands-on development experience.
- At least 7 years of working as a lead developer on Java backends.
- At least 5 years of working as a Big Data Developer.
- Must have worked as an architect on multi-tier applications, has design experience, and hands on coding skills.
- Must have strong understanding of the big data framework and understands Spark, Hive, HDFS, Impala, Presto and can query and tune those systems.
- Must have understanding of latest java versions along with Spring Framework, Executor patterns, and Lambda. Deep understanding of data structures also required along with basic principles of Java.
- Must have understanding of Linux , Bash and basic scripting along basics like Unix group , host group etc.
- Must have basic understanding of RDBMS vs NO SQL vs Columnar Databases. Understanding of the file formats like Parquet, AVRO, ORC, and Iceberg also required.
- Must have basic understanding of basics of Microservice Architecture, Containerization, and Orchestration.
- Must have basic understanding of Helm, Jenkins, Bitbucket, Gradle, and Maven.
- Must have basic understanding of the telemetry specifically open telemetry, ELK, Grafana, and Prometheus.
Note:
COVID-19 considerations: All individuals working on-site must be fully vaccinated against COVID-19.
12 Months
Location – Jersey City - 3 days in office
MAKE SURE CANDIDATES CAN DO IN-PERSON INTERVIEWS IN JC & ENSURE TO VERIFY IDENTITY!
2 subs max
NEED TO BE STRONG IN BIG DATA AND JAVA.
Please ensure your candidates can interview in-person.
Role: Senior Java Engineer
From Kick off Call on 8/5/24
Lead engineer in Jersey City office.
Very strong in Java and performance tuning (7+ years of java development).
Very good big data experience -- especially spark and impala.
Linux system experience.
Financial industry experience is a plus.