AI Engineer – Senior Software Engineer

Converge Squad 2 is hiring a Senior Software Engineer to design, build, and productionize AI-powered solutions across ML, generative AI, and LLM-based systems.

Responsibilities

• Design and develop scalable AI-powered applications and services.
• Build and integrate Generative AI and LLM capabilities into production applications.
• Create AI/ML pipelines covering data preparation, model training, evaluation, deployment, and monitoring.
• Work with LLMs, embeddings, vector databases , RAG (Retrieval-Augmented Generation) , prompt engineering, and AI agents.
• Design and implement APIs and backend services that connect AI capabilities to existing products and platforms.
• Compare models and approaches using accuracy, latency, cost, scalability, and reliability criteria.
• Develop strategies for prompt optimization, model evaluation, hallucination reduction, and response quality.
• Deliver production-ready systems with observability, logging, monitoring, security controls, and failure handling.
• Collaborate with product managers, software engineers, data scientists, and other stakeholders to translate business requirements into technical solutions.
• Contribute to architecture and design discussions and help drive technical decisions.
• Conduct code reviews and help set engineering best practices.
• Mentor other engineers and support technical growth within the team.
• Stay current with developments in AI, machine learning, and LLM technologies and identify ways to apply them to products.

Requirements

• Bachelor’s or Master’s degree in Computer Science, Engineering, or a related technical field.
• 5+ years of professional software engineering experience building and deploying production systems.
• Strong programming skills in Python and/or Java .
• Strong understanding of software engineering principles, object-oriented design, data structures, algorithms, and system design.
• Hands-on experience with Generative AI , LLMs , or machine learning systems.
• Experience working with APIs and integrating AI/ML models into applications.
• Experience with cloud platforms: AWS , Azure , or Google Cloud .
• Experience with databases and data processing systems.
• Strong testing and debugging skills, plus experience with CI/CD , version control, and production operations.

Technologies

• Python, Java, SQL
• Machine Learning, Generative AI, LLMs, NLP
• Embeddings, RAG, prompt engineering, model evaluation
• LangChain, LlamaIndex, Semantic Kernel
• PyTorch, TensorFlow, scikit-learn
• REST APIs, microservices, distributed systems
• AWS, Azure, Google Cloud
• SQL and NoSQL databases, vector databases
• Git, CI/CD, Docker, Kubernetes
• Monitoring and observability
• OpenAI, Anthropic, Gemini
• Pinecone, Weaviate, Milvus, OpenSearch, pgvector
• scikit-learn, MLOps/LLMOps

Preferred Qualifications

• Experience with OpenAI, Anthropic, Gemini, or other foundation models.
• Experience building RAG -based applications using embeddings and vector databases.
• Experience with vector databases such as Pinecone, Weaviate, Milvus, OpenSearch, or pgvector.
• Experience with frameworks such as LangChain, LlamaIndex, or Semantic Kernel.
• Experience developing AI agents and tool-using LLM applications.
• Experience with ML frameworks such as PyTorch, TensorFlow, or scikit-learn.
• Experience with model evaluation, fine-tuning, or parameter-efficient fine-tuning.
• Familiarity with MLOps/LLMOps practices.
• Experience with Docker, Kubernetes, and cloud-native application development.
• Knowledge of AI security, data privacy, responsible AI, and model safety practices.
• Experience designing highly scalable distributed systems.

Role Details

• Location: Randolph, NJ (onsite)
• Employment type: Full-time
• Department: Engineering / Artificial Intelligence
• Salary: USD 50,000 - 600,000 per yearly
• Experience: 5+ years
• Additional note: All information is kept confidential according to EEO guidelines.