Founding AI Data Engineer

Company:  LlamaIndex Inc.
Location: San Francisco
Closing Date: 20/10/2024
Salary: £150 - £200 Per Annum
Hours: Full Time
Type: Permanent
Job Requirements / Description

Help us build the future of AI!

Join our team to pioneer the future of Large Language Model (LLM) applications.

Values we are looking for:

  • Integrity, alignment and passion

  • Adaptability and the ability to work with limited resources

  • Intellectual horsepower (smart x get things done)

  • Level up the people around you

  • Domain specific knowledge

Responsibilities:

You will be responsible for architecting and scaling LlamaCloud's integrations to meet the needs of the next generation of agentic applications. This includes working on both data loading and agentic tool interfaces.

  1. Data loading refers to connecting to a data source, loading unstructured data, and performing ETL steps to transform and index it into a storage system (e.g. a vector database). It is vaguely similar to traditional ETL workloads (e.g. with dbt) but with very different steps.

  2. Agentic tool interfaces is a forward looking concept where LLM agents interact with every data system through a set of API interfaces. For each service, this not only includes API interfaces to load and retrieve data, but also API interfaces to take actions. As an example, you can treat Github as a data loader where you only load and index code files and issues; but you can also treat it as a more general tool where an LLM agent not only reads code/issues, but also responds to/triages issues, submits PRs, adds/removes organization members, and more.

Qualifications:

  • You have a proven track record of building scalable B2B data infrastructure systems that process large amounts of data. This includes the full lifecycle of architecting scalable infrastructure, implementing data connectors for enterprise systems, and ensuring data integrity and security.

  • You're an expert at building quickly but scaling as necessary.

  • You should know the ins and outs of working with various data sources, APIs, and authentication protocols.

  • You're also passionate about LLMs and the immense opportunities they offer for developers and end users.

  • You're able to contextualize all data integration decisions with the goal of creating an amazing set of tools for developers to use in AI-powered applications.

  • Prior experience with ETL, data orchestration, or distributed data processing is strongly preferred.

Benefits:

  • Competitive salary (100-300K, based on experience and location)

  • Equity options in a rapidly growing company

  • Comprehensive medical/dental/vision coverage for you and your family

  • Unlimited paid time off policy

  • Catered lunch and snacks in the San Francisco office

Location:

We offer a hybrid-friendly culture based out of our downtown San Francisco office, but are also open to hiring exceptional candidates worldwide!

#J-18808-Ljbffr
Apply Now
An error has occurred. This application may no longer respond until reloaded. Reload 🗙