Software Engineer - Data Platform Job at Avride, Austin, TX

UTAyU0ZZMFRiUklZU0p1WUpBOG9PR1hDaFE9PQ==
  • Avride
  • Austin, TX

Job Description

About the Team


Our team is responsible for the collection, storage, and processing of large-scale datasets generated by autonomous vehicles and delivery robots. This includes sensor data from cameras, lidars, radars, and other onboard systems. Scaling reliable storage and providing efficient compute tools is essential for supporting downstream teams—such as machine learning, simulation, and algorithm development. Our data processing stack incorporates specialized algorithms similar to those deployed directly on autonomous systems in the field.

About the Role



As a Software Engineer, Data Platform at Avride, you will be responsible for designing, building, and maintaining the core data and machine learning infrastructure with a strong focus on software design and code quality. You will design systems to ingest, process, and organize petabytes of telemetry and sensor data into a globally distributed data lake, enabling high-throughput, low-latency access to data for both model training and online inference. Your work will help ML engineers and data scientists iterate faster and deliver better-performing systems.

‍What You'll Do





  • Build and maintain robust data pipelines and core datasets to support simulation, analytics, and machine learning workflows, as well as business use cases

  • Design and implement scalable database architectures to manage massive and complex datasets, optimizing for performance, cost, and usability

  • Collaborate closely with internal teams such as Simulation, Perception, Prediction, and Planning to understand their data requirements and workflows

  • Evaluate, integrate, and extend open-source tools (e.g., Apache Spark, Ray, Apache Beam, Argo Workflows) as well as internal systems

What You'll Need




  • Strong proficiency in Python (required); experience with C++ is highly desirable

  • Proven ability to write high-quality, maintainable code and design scalable, robust systems

  • Experience with Kubernetes for deploying and managing distributed systems

  • Hands-on experience with large-scale open-source data infrastructure (e.g., Kafka, Flink, Cassandra, Redis)

  • Deep understanding of distributed systems and big data platforms, with experience managing petabyte-scale datasets

Nice to Have




  • Experience building and operating large-scale ML systems

  • Understanding of ML/AI workflows and experience with machine learning pipelines

  • Experience optimizing resource usage and performance in distributed environments

  • Familiarity with data visualization and dashboarding tools (e.g., Grafana, Apache Superset)

  • Experience with cloud-based infrastructure (e.g., AWS, GCP, Microsoft Azure)

Candidates are required to be authorized to work in the U.S. The employer is not offering relocation sponsorship, and remote work options are not available.

Job Tags

Full time, Remote work, Relocation,

Similar Jobs

L3Harris Technologies

Integration and Test Engineers Job at L3Harris Technologies

 ...of national security. Job Title: Chief Engineer - Avionics Modification & Maintenance...  ...processes. Innovation and Improvement: Drive innovation by researching and...  ...performs pre-employment substance abuse testing and background checks, where permitted by... 

Meijer

Cashier Part Time Job at Meijer

 ...Meijer, Inc. - West Main St [Retail Cashier / Team Member] As a Cashier at Meijer, you'll: Create 'WOW' moments that have a positive and lasting impact on the customers; Complete transactions, handle money and maintain accuracy of point of sale purchases; Use good eye... 

Neighborhood Legal Services

Staff Attorney - Family Law (Trauma-Informed) Job at Neighborhood Legal Services

 ...A legal aid organization is seeking a Staff Attorney to provide high-quality legal representation in family law matters. The role involves supporting clients, conducting legal research, and working closely with domestic violence programs. Applicants must be admitted to... 

OpenX

Senior Account Executive, Health & Pharma vertical Job at OpenX

 ...Pharma vertical. This position will play a critical role in the expansion of the OpenX business with brand advertisers and global ad agencies at a time of hyper-growth for our company. This critical member of the Buyer Development team will have a unique opportunity... 

Actalent

Entry Level Recruiter/ Sales Trainee Job at Actalent

 ...Job Description Actalent connects passion with purpose. Were looking for a highly motivated Entry-Level Recruiter | Sales Trainee to join our team and help us advance the careers of skilled professionals doing impactful work. Building trusted relationships with...