Back to search
Perennial Resources International Linkedin · Posted 3d ago

Data Engineering and Reporting Analyst

New York, United States

Linkedin
Continue to application Add your email once, then Caio opens the original posting.

Indexed description

ABSOLUTELY NO 3RD PARTY CANDIDATES.



Our client, a leading financial services firm in the New York metro area, is seeking a Data Engineer with deep Python expertise, GraphQL API experience, and hands-on machine learning pipeline skills. This role sits at the intersection of data infrastructure and applied AI — you will design and own scalable pipelines that serve both analytical teams and production ML systems, working closely with quants, data scientists, and front-office stakeholders.

KEY RESPONSIBILITIES

  • Design, build, and maintain high-performance data pipelines using advanced Python — including async patterns, generator-based streaming, distributed processing architectures, and caching strategies
  • Develop and maintain GraphQL APIs for internal data services, enabling flexible, efficient querying across trading, risk, and analytics platforms
  • Build and operationalize ML data pipelines: feature engineering, data validation, model serving infrastructure, and real-time inference support
  • Integrate with external market data providers (e.g., Bloomberg) and internal systems including risk, settlement, and portfolio management platforms
  • Optimize pipeline performance through profiling, memory management, and distributed execution strategies
  • Partner with data scientists and ML engineers to productionize models and ensure data quality throughout the feature lifecycle
  • Support production data systems during trading hours; participate in release management and deployment workflows
  • Contribute to data platform architecture decisions, documentation, and engineering best practices

REQUIRED QUALIFICATIONS

  • 4–7 years of experience in data engineering, software engineering, or a closely related role
  • Advanced Python proficiency: async/await, generators, multiprocessing, performance optimization, OOP design patterns
  • Hands-on GraphQL experience: schema design, resolvers, query optimization, and API federation
  • Machine learning pipeline experience: feature stores, data preprocessing, model serving, MLOps tooling (e.g., MLflow, Feast, Airflow/Prefect)
  • Strong SQL and NoSQL skills; experience with Redis or other caching layers
  • Experience with REST API design and integration (Flask or FastAPI preferred)
  • Familiarity with distributed systems and scalable data architecture patterns
  • Experience in financial services, trading systems, or data-intensive production environments a strong plus
  • B.S. in Computer Science, Information Technology, Engineering, or equivalent practical experience

PREFERRED QUALIFICATIONS

  • Experience with LangChain, LLM APIs, or AI agent frameworks (e.g., MCP protocol)
  • Familiarity with Bloomberg API, FactSet, or other market data integrations
  • Exposure to fixed-income, derivatives, or collateral management data domains
  • Experience with cloud data platforms (AWS, GCP, or Azure) and containerized deployments
  • Track record supporting global production releases or serving as release manager

REPRESENTATIVE TECH STACK

Languages

Python (advanced), SQL, JavaScript

API / Query

GraphQL, REST, Flask / FastAPI

ML / AI

LangChain, OpenAI APIs, MLflow, Feast, Airflow

Data & Caching

PostgreSQL, Redis, NoSQL, Spark (plus)

Infrastructure

Git, Docker, Jira, cloud platforms


#PRITechJobs

Free. 20 seconds. No password. See every match in this search.

Create a free Caio profile to unlock more results and save your role and location preferences.

Unlock free search
Want help applying to roles like this? Search Caio for free. If CV tailoring and application tracking get heavy, Full Caio Agent adds a human specialist.
View Full Agent