Paragon are seeking a Lead Data Engineer to help design and build the data infrastructure underpinning investment and research workflows at a world class trading house.
This is a senior, hands-on engineering role working with large, complex financial and alternative datasets. You’ll be responsible for building scalable data platforms and pipelines that allow investment teams to consume high-quality, reliable data with low latency.
You’ll take technical ownership of critical parts of the data engineering stack, working closely with quantitative researchers, investment professionals, data scientists and other engineering teams.
The focus is on building robust data infrastructure rather than simply maintaining ETL processes. You’ll be expected to make architectural decisions, establish engineering standards and remain close to the code.
Key responsibilities include:
- Architecting and building scalable batch and real-time data pipelines
- Designing platforms for ingesting, normalising and distributing large financial and alternative datasets
- Building robust ETL/ELT frameworks with strong observability, lineage and data-quality controls
- Developing data models and APIs that make complex datasets easily consumable by researchers and investment teams
- Improving the performance, reliability and scalability of existing data infrastructure
- Designing distributed and event-driven data processing systems
Python | SQL | Spark | Kafka | Airflow | Snowflake | AWS | Kubernetes | Distributed Systems | Data Modelling | Streaming & Batch Processing
#J-18808-LjbffrLead Data Engineer | Systematic Data Platform in new york at Unknown Company
This position is listed as full time and onsite.