Office Location: Lower Manhattan, NY - Hybrid

Accrete is a dynamic and innovative company focused on transforming the future of artificial intelligence. We specialize in creating advanced AI solutions that turn complex data into actionable insights, driving real-world impact for businesses and government organizations. Our team thrives on creativity and collaboration, working together to push the boundaries of AI technology.

At the core of our offerings are our AI agents, designed to autonomously analyze data, generate insights, and make intelligent recommendations. These agents help businesses streamline operations, improve decision-making, and also empower government entities to enhance security, intelligence, and operational efficiency

We are seeking a highly skilled Prompt Engineer with a PhD in a relevant field to join our team in a forward deployed capacity. In this client-facing role, you will work closely with end-users to design, test, and optimize prompt strategies that unlock the full potential of large language models (LLMs) for real-world applications. This position blends deep technical expertise in NLP and AI with a consultative approach to delivering tailored solutions that meet the operational needs of our customers.

Responsibilities

  • Forward Deployment: Engage directly with clients to understand domain-specific challenges and deliver customized, high-performing prompt solutions that integrate seamlessly with their workflows.

  • Prompt Optimization: Develop, test, and refine prompts to improve the performance, accuracy, and reliability of AI-generated outputs.

  • Applied Research: Conduct research on prompt engineering techniques, contextual learning, model interpretability, and fine-tuning methodologies.

  • Collaboration: Partner with data scientists, NLP engineers, and product teams to enhance model outputs based on real-world use cases.

  • Evaluation Frameworks: Design and implement evaluation tools and metrics to measure the effectiveness of prompt strategies.

  • Continuous Learning: Stay current with the latest advances in LLMs, NLP, and AI alignment, and apply findings to production systems.

  • Model Analysis: Analyze model behavior to provide actionable insights for performance improvement and bias mitigation.

  • Tool Development: Contribute to the creation of internal tools for automated prompt generation, testing, and refinement.

Requirements

  • PhD in Computer Science, Artificial Intelligence, Machine Learning, NLP, or a related field

  • Deep understanding of large language models, prompt engineering, instruction tuning, and fine-tuning techniques

  • Hands-on experience with LLM APIs (e.g., OpenAI, Anthropic, Cohere)

  • Proficiency in Python and NLP libraries such as Hugging Face, spaCy, or NLTK

  • Demonstrated expertise in prompt design, few-shot learning, and contextual optimization

  • Strong analytical skills and experience designing experiments for AI model evaluation

  • Ability to thrive in fast-paced, client-facing environments and collaborate with cross-functional teams

Salary Range: 140k-180k

The salary range provided reflects the estimated compensation for this role based on the expected qualifications and experience level. The final offer may vary depending on factors such as skills, experience, and alignment with role requirements.

Cultural Fit & Values

At Accrete, success goes beyond technical expertise—we value innovation, collaboration, and accountability. Our team members embody:

  • Ownership & Accountability – Drive projects to completion with high standards and proactive problem-solving.
  • Transparency & Communication – Share information openly, give and receive constructive feedback.
  • Strategic Thinking & Problem-Solving – Analyze challenges critically and implement effective solutions.
  • Collaboration & Professionalism – Work as a team, contribute meaningfully, and uphold mutual respect.
  • Passion for AI & Innovation – Stay curious, continuously learn, and push AI’s potential.
  • Going Beyond the Job Description – Seek opportunities to contribute beyond core responsibilities.

These principles shape our culture, performance evaluations, and growth opportunities, ensuring we build a mission-driven organization together.

Company Benefits

  • Competitive Salary: Aligned with experience and market standards.
  • Comprehensive Insurance: Health, dental, and vision coverage to keep you and your family secure.
  • 401(k) Plan: Build your financial future with our retirement savings plan.
  • Flexible PTO & Hybrid Work: Take time off when you need it and enjoy remote flexibility per company guidelines.
  • Growth & Development: Access professional development, learning opportunities, and career advancement support.
  • Onsite Perks: Enjoy catered lunches, snacks, and a stocked kitchen.
  • Team Bonding: Company-sponsored happy hours and social events to connect and unwind.