Data Integration Engineer (Real-Time Systems)

About Subsurface Dynamics

Subsurface Dynamics Inc. is a Calgary-based engineering and technology company building real-time systems for one of the most operationally demanding environments in energy — hydraulic fracturing.

We don’t build dashboards after the fact.

We build systems that run live during operations — where data is messy, decisions matter, and failures are not theoretical.

Our platform processes high-frequency field data in real time to detect issues while pumping is happening — not days later.

We Operate At The Intersection Of

• Physics-based engineering
• Real-time data systems
• Operational decision-making

Our clients rely on us during active operations — which means reliability, clarity, and speed are not optional.

We’re a small, highly technical team focused on solving real problems, not building generic software.

If you enjoy working on systems where things break, data is imperfect, and the impact is immediate — you’ll fit in well here.

📍 Location

Calgary (preferred) or Remote (Americas time zones)

🎯 Role Summary

We are looking for a Data Integration Engineer to own the ingestion and data layer of our real-time frac monitoring platform.

This Role Focuses On

• Integrating with multiple vendor APIs
• Handling real-time data streams
• Managing channel mapping and schema changes
• Debugging data issues during live operations

You will work directly with our core platform team to ensure reliable, clean data flows into our processing engine.

🧱 What You’ll Be Responsible For

🔹 Data Integration & APIs

• Maintain and improve integrations with 5–6 external vendor APIs with focus on efficiency and real-time performance
• Handle authentication, rate limits, retries, and failures
• Monitor and respond to API or schema changes

🔹 Data Pipeline Ownership

• Own the ingestion layer from raw data → standardized format
• Debug issues like missing data, lag, incorrect channel mapping
• Ensure stable real-time data flow during operations

🔹 Channel Mapping & Data Normalization

• Maintain mapping between vendor-specific channels and internal schema
• Handle frequent channel name / structure changes
• Implement validation checks and fallback logic

🔹 Operational Support (On-Call Rotation)

• Participate in light on-call rotation for ingestion-related issues
• Diagnose and resolve production issues quickly
• Communicate clearly with internal team during incidents

🔹 System Improvement

• Help modularize and clean up ingestion architecture
• Build tools to reduce manual intervention (validation, alerts, mapping config)
• Improve observability of data pipeline

🛠 Tech Expectations

Must Have

• Strong backend experience (Python, Node.js, or similar)
• Experience working with REST APIs, SCADA, WebSockets and JSON data
• Comfortable debugging production issues
• Understanding of asynchronous / streaming data

Nice To Have

• Experience with real-time systems or data pipelines
• Experience with time-series data
• Familiarity with cloud environments (AWS/Azure)

🧠 What We Care About (More Than Tech)

• You can figure things out quickly without perfect specs
• You’re comfortable working with messy real-world data
• You don’t panic during production issues
• You communicate clearly and concisely
• You care about reliability, not just writing code

🚫 What This Role Is NOT

• Not a frontend role
• Not pure feature development
• Not a research/ML role
• Not a “big tech process-heavy” environment

📈 Why This Role Matters

Our platform operates in real-time during frac operations.

Data quality and reliability directly impact field decisions.

This Role Is Critical To

• System stability
• Client confidence
• Scalability of the platform

💰 Compensation

Competitive salary based on experience

⚙️ How We Work

• Small, highly technical team
• Fast decision-making
• No unnecessary process
• Focus on real-world impact, not vanity metrics

🔚 Hiring Process

• Short intro call
• Technical discussion (real scenarios, not leetcode)
• Practical exercise (API/data handling)
• Final discussion

🔥 Optional (Strong Signal Candidates)

Experience With

• Oil & gas / frac / industrial data
• Real-time monitoring systems
• Working with unreliable external data sources