Data Platform Engineer, Data Pipelines
About the Job
- As a Data Platform Engineer, Data Pipelines, you will design and build the systems and integrations that help move data reliably from robots in the field to the teams and services that depend on it — analytics, autonomy, ML training, and deployment operations. You will collaborate with cross-functional teams spanning robotics, autonomy, and deployment to build the data backbone of a field robotics company.
About the Data Platform Team
- Every robot we deploy generates a continuous stream of telemetry, sensor logs, and operational data from environments around the world. The Data Platform team builds the systems that capture every autonomy intervention, anomaly, and operational signal from globally deployed robots, classify them, and turn them into the ranked problem list that drives our engineering roadmap.
What You'll Get To Do
-
Build and own ingestion pipelines that land robot data (ROS2 bags/MCAP, LiDAR, camera, IMU, logs) in cloud storage and the lakehouse
-
Handle the realities of field data: intermittent connectivity, very large sensor payloads, edge-to-cloud sync, partial or truncated uploads, and backfill from offline deployments
-
Write and operate Airflow DAGs that process, validate and catalog every mission's data
-
Build reusable ingestion SDKs, APIs and services so teams can onboard a new data source with minimal custom code
-
Build integrations that deliver processed data to external platforms and customers (REST APIs, webhooks, cloud storage drops)
-
Own pipeline reliability end to end: schema contracts, idempotent retries, re-delivery, backfills and alerting
-
Optimize pipeline throughput and cost as the fleet grows
What You Have
-
Bachelor's or Master's degree in Computer Science, Engineering, or a related field
-
3–5+ years of experience in data engineering or backend engineering focused on pipelines
-
Strong Python and SQL
-
Production experience with an orchestrator such as Airflow or Dagster
-
Experience with cloud object storage at scale (S3 or equivalent) and event-driven processing (queues, Lambda, Kinesis, Kafka or Pub/Sub)
-
Experience building integrations with third-party APIs and designing APIs others consume
-
A habit of building for failure: retries, idempotency, monitoring and clear alerts
-
You own problems from start to finish: from "the data didn't show up" to the root cause, the fix, the backfill and the alert that catches it next time
The Extras That Set You Apart
-
Experience with ROS/ROS2, MCAP or rosbag, or other robotics or automotive telemetry
-
Experience with edge computing or intermittently connected data collection
-
Experience with large binary media: point clouds, 360° video, images
-
Experience with Iceberg, Delta or another open table format
-
Some infrastructure experience, enough to ship and debug your own pipelines: Docker, Kubernetes, Terraform, or basic AWS IAM and networking
Source: the employer's careers page. Last checked 2026-11-17. Posted 2026-07-10.
More jobs at FieldAI · Jobs in Irvine · On-site jobs in United States · Software development jobs