Billennium is a global technology company with over 20 years of experience, committed to innovation and empowering businesses. As an employer, we offer a supportive, growth-focused environment where collaboration and creativity thrive. Join us to shape the future of technology together!
Role Purpose
Build and maintain scalable data pipelines that power GenAI applications. You will transform enterprise documents into structured, high-quality data for Retrieval-Augmented Generation (RAG) and LLM solutions by developing reliable ETL pipelines, document processing, and vector indexing.
Key Responsibilities
- Design, build, and maintain automated ETL/ELT pipelines using Apache Airflow.
- Ingest, clean, transform, and structure documents from enterprise data sources (PIM, PIOS, CMP, Product Line, Affiliate, CE/IVD).
- Build document processing pipelines including metadata extraction, chunking, embedding generation, and vector store updates.
- Load and maintain data in Snowflake, MongoDB, and vector databases.
- Ensure data quality, versioning, monitoring, and pipeline reliability.
- Support the Lead Data Scientist with RAG, embeddings, semantic search, and vector retrieval.
Required Skills
- Strong experience with Apache Airflow for workflow orchestration and pipeline automation.
- Strong Python (pandas) and SQL.
- Experience building ETL/ELT and document processing pipelines.
- Experience with Docker.
- Experience with Snowflake or other cloud data warehouses.
- Experience with vector databases/vector stores.
- Experience with Jupyter Notebook and VS Code.
- Strong analytical and problem-solving skills.
- Clear communication and collaborative mindset.
Perks and benefits:
- Comprehensive benefits - enjoy Udemy for Business, private medical care, Multisport card, veterinary package, language lessons, and shopping vouchers.
- Flexibility - adaptable working hours and remote/hybrid work options to suit your lifestyle & location.
- Career growth - access opportunities for professional development and learning, including perks related to our official partnerships with global IT giants: Microsoft, AWS, Snowflake, Salesforce & more.
- Global collaboration - work with a diverse, international team.
- Innovative environment - be part of a forward-thinking and growth-oriented workplace.
- Engaging community - Work with passionate professionals and participate in team-building events, hackathons, and CSR initiatives to make an impact beyond work.
- Team-building events including our company tradition (annual company event in Mazury).
- A pleasant surprise to start your journey with us in the form of a welcome pack.
Recruitment process:
- HR call
- Technical Interview
- Interview with the dedicated Client