Data ScientistPosition: Data ScientistLocation: Lexington, MA (Hybrid)Length: 5 Month ContractJob Description: Designs, develops, and implements methods, processes, and systems to consolidate and analyze diverse data sets including structured and unstructured. Develops software programs, algorithms, dashboards, information tools, and queries to clean, model, integrate and evaluate datasets. Keeps abreast of new analytic methodologies and technologies.
Collaborates with functional business units to drive business solutions and direction.Essential Duties and ResponsibilitiesDesign, implement, and maintain enterprise-scale search solutions using Apache SolrDevelop and optimize semantic search capabilities using vector embeddings and neural search modelsBuild custom indexers and indexing pipelines that support vector embeddings alongside traditional text fieldsImplement and tune Approximate Nearest Neighbor (ANN) algorithms for efficient similarity search at scaleDesign and optimize similarity functions (cosine, dot product, Euclidean) for various search use casesBuild hybrid search systems that combine traditional keyword-based search with vector-based semantic searchPerform traditional relevancy engineering including query analysis, field weighting, boosting strategies, and result tuningConduct relevancy analysis using quantitative metrics and qualitative evaluation methodsMonitor search performance metrics and implement continuous improvementsWork cross-functionally with product, engineering, and data teams to define search requirementsQualifications5+ years of hands-on experience with Apache Solr or Lucene in production environmentsStrong expertise in traditional relevancy engineering including query parsing, field boosting, function queries, and relevance tuningProven experience conducting relevancy analysis using both automated metrics and manual evaluation techniquesStrong expertise in vector embeddings and their application to semantic searchProven experience building hybrid search systems that combine keyword and vector-based approachesKnowledge of search relevance metrics (NDCG, MRR, precision/recall)Excellent problem-solving and analytical skillsStrong communication skills and ability to work in collaborative environmentsPOST-OFFER BACKGROUND CHECK IS REQUIRED. Digital Prospectors is an Equal Opportunity Employer and all qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, veteran status, or any other characteristic protected by law. Digital Prospectors affirms the right of all individuals to equal opportunity and prohibits any form of discrimination or harassment.